The growing push to address the lack of diversity in physics has come with an array of curriculum reforms and interventions. There has been work in Physics Education Research (PER) that has supported these reforms, including studying the experiences and identity development of students from minoritized backgrounds. However, there has been a lack of critical reflection on the core methodologies and constructs used in PER. Here, we present a critical analysis of qualitative and quantitative work used to define and measure "expert-like" thinking, beliefs, and practices in physics. We show that this work has largely omitted any consideration of race or cultural backgrounds of participants, instead defining "experts" as either physics faculty or Ph.D. holders. Research in critical theory demonstrates that failing to intentionally address potential biases tends towards reinforcing those biases. Thus, work in PER on expert-like thinking may unintentionally replicate, rather than challenge, existing biased structures in physics. We conclude with recommendations for constructing more inclusive views of what it means for students to develop "expert-like" thinking.