Multiple popular math curriculum-based measures have recently been revised in ways that may improve their utility for universal screening. However, the applied use of these tools has yet to be evaluated independently. We conducted a retrospective analysis of the diagnostic accuracy of prior year statewide test results and aimswebPlus math…

This study evaluated the forecasting accuracy of trend estimation methods applied to time-series data from computer adaptive tests (CATs). Data were collected roughly once a month over the course of a school year. We evaluated the forecasting accuracy of two regression-based growth estimation methods (ordinary least squares and Theil-Sen). The…

Universal screening is the first mechanism by which students are identified as at risk of failure in the context of multitiered systems of supports. This study examined the validity and diagnostic accuracy of a reading computer-adaptive test as a screener to identify state achievement test performance for third through fifth graders (N = 1,696).…

Schools have become the largest provider of mental health services to children, thus increasing the need to identify children at risk before problems worsen. The Social, Academic, and Emotional Behavioral Risk Screener-Student Rating Scale (SAEBRS-SRS) student version is a universal screener that assesses pre-symptomology of internalizing and…

Interim tests are a central component of district-wide assessment systems, yet their technical quality to guide decisions (e.g., instructional) has been repeatedly questioned. In response, the study purpose was to investigate the validity of a series of English Language Arts (ELA) interim assessments in terms of dimensionality and prediction of…

District and state education leaders frequently use screening assessments to identify students who are at risk of performing poorly on end-of-year achievement tests. This study examines the use of a universal screening assessment of reading skills for early identification of students at risk of low achievement on nationally normed tests of reading…

We examined the criterion validity and diagnostic efficiency of oral reading fluency (ORF), word reading accuracy, and reading comprehension (RC) for students in Grades 7 and 8 taking into account form effects of ORF, time of assessment, and individual differences, including student designations of limited English proficiency and special education…

Out-of-school time (OST) youth programs are inherently difficult to assess. They are often very dynamic: Many youth interact with one another and with staff members in various physical environments. Despite the challenge, measuring quality is critical to help program directors and policy makers identify where to improve and how to support those…

Data-mined models often achieve good predictive power, but sometimes at the cost of interpretability. We investigate here if selecting features to increase a model's construct validity and interpretability also can improve the model's ability to predict the desired constructs. We do this by taking existing models and reducing the feature set to…

The aim of this study was to examine students' performance calibration in physical education. One hundred fifth and sixth grade students provided estimations regarding their performance in a dribbling test after practicing dribbling for 16 minutes under different self-regulatory conditions (i.e., receiving feedback, setting goals, self-recording).…