Racial bias in research impacts a study's relevancy, validity and reliability, though presently this aspect is not addressed in critical appraisal tools, and consequently appraisers may not take racial bias into account when assessing a paper's quality. Drawing on critical race theory (CRT) tenets that racism is ubiquitous and race a social construct, this paper discusses concerns regarding racism in research which have been broadly divided into two categories for critical appraisers to consider: the underrepresentation of minoritised ethnic groups in health studies, especially where minoritised populations see higher rates of disease occurrence and; the utilisation of racial/ethnicity data to interpret disparities in outcomes, including speculation of biological race, the misinterpretation of genetic ancestry as race, and the lack of investigation into social determinants of health, including systemic, institutional and interpersonal forms of racism. The injustices exposed in this paper impact the health of minoritised ethnic groups and are therefore a Black Lives Matter issue. They risk resurrecting dangerous theories regarding biological inferiority among minoritised ethnic populations, as well as hindering study findings. The application of CRT frameworks in health science research quality appraisal is discussed in relation to the above themes--using largely UK-based contexts with supporting examples from the US--followed by recommendations for critically appraising for antiracism. Further information to support critically appraising for antiracism can be found via https://www.criticallyappraisingantiracism.org/.