Purpose: We investigated and compared the outcomes from two standardized, norm-referenced screening assessments of language (i.e., Clinical Evaluation of Language Fundamentals Preschool--Second Edition [CELFP-2], Diagnostic Evaluation of Language Variation--Screening Test [DELV-ST]) with African American preschoolers whose spoken dialect differed from that of General American English (GAE). We (a) described preschoolers' performance on the CELFP-2 Core Language Index (CLI) and its subtests with consideration of degree of dialect variation (DVAR) observed, (b) investigated how the application of dialect-sensitive scoring modifications to the expressive morphology and syntax Word Structure (WS) subtest affected CELFP-2 CLI scores, and (c) evaluated the screening classification agreement rates between the DELV-ST and the CELFP-2 CLI. Method: African American preschoolers (N = 284) completed the CELFP-2 CLI subtests (i.e., Sentence Structure, WS, Expressive Vocabulary) and the DELV-ST. Density of spoken dialect use was estimated with the DELV-ST Part I Language Variation Status, and percentage of DVAR was calculated. The CELFP-2 WS subtest was scored with and without dialect-sensitive scoring modifications. Results: Planned comparisons of CELFP-2 CLI performance indicated statistically significant differences in performance based on DELV-ST--determined degree of language variation groupings. Scoring modifications applied to the WS subtest increased subtest scaled scores and CLI composite standard scores. However, preschoolers who demonstrated strong variation from GAE continued to demonstrate significantly lower performance than preschoolers who demonstrated little to no language variation. Affected-status agreement rates between assessments (modified and unmodified CELFP-2 CLI scores and DELV-ST Part II Diagnostic Risk Status) were extremely low. Conclusions: The application of dialect-specific scoring modifications to standardized, norm-referenced assessments of language must be simultaneously viewed through the lenses of equity, practicality, and psychometry. The results of our multistage study reiterate the need for reliable methods of identifying risk for developmental language disorder within children who speak American English dialects other than GAE.