ERIC Number: EJ1450092
Record Type: Journal
Publication Date: 2024-Dec
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-2159-2020
EISSN: EISSN-2161-1505
Are Two Screeners Better than One? A Simulation Study of Correlation and Classification in Universal Screening
Contemporary School Psychology, v28 n4 p607-620 2024
Universal screening to predict students' risk for reading problems is a foundational component of the Multi-Tiered Systems of Support framework and is required by law in many US states. School or district administrators are tasked with selecting screening assessments that are both technically adequate and feasible given the resources of their local context. One common recommendation is that educational screening assessments should have at least a sensitivity of 0.9 and a specificity of 0.8. The two studies presented here used simulation methodology to identify the screener-outcome correlation(s) needed to achieve these recommended levels of sensitivity and sensitivity with a one-indicator (study 1) or two-indicator (study 2) screening battery. In both studies, the base rates of non-proficiency were manipulated. Results showed that the minimum correlations needed to achieve this recommendation were higher than what is typically observed in practice, and also varied across samples with differing base rates. Furthermore, screening assessments with the recommended levels of sensitivity and specificity had high rates of false positive classifications that depended on the base rate, cut-point, and method of assigning risk. These results suggest that the practice of issuing specific criteria for the sensitivity and specificity of screeners may be misguided. Implications for the evaluation of the technical adequacy of screening assessments and recommendations for practitioners are discussed.
Descriptors: Screening Tests, Reading Tests, Reading Difficulties, Classification, Multi Tiered Systems of Support, Simulation, Student Evaluation, Evaluation Criteria, Cutting Scores, At Risk Students, Test Validity, Correlation, Predictive Validity
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://bibliotheek.ehb.be:2123/
Related Records: ED660527
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305B200020
Data File: URL: https://osf.io/xwyr8/