ERIC Number: EJ1414459
Record Type: Journal
Publication Date: 2024
Pages: 23
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1082-4669
EISSN: EISSN-1532-7671
An Evaluation of the Forecasting Accuracy of Two Trend Estimation Methods from Two Computer Adaptive Tests
Ethan R. Van Norman; Emily R. Forcht
Journal of Education for Students Placed at Risk, v29 n1 p1-22 2024
This study evaluated the forecasting accuracy of trend estimation methods applied to time-series data from computer adaptive tests (CATs). Data were collected roughly once a month over the course of a school year. We evaluated the forecasting accuracy of two regression-based growth estimation methods (ordinary least squares and Theil-Sen). The precision, or accuracy, of predictions were heavily influenced by how far performance was forecasted into the future (1, 3, or 5 months) and the number of observations available to estimate growth (3, 4, or 5). When performance was forecasted further and growth estimates were based upon fewer observations, predictions were off by as much as two times the average conditional standard error of measurement for a grade level. No combinations of data collections schedule, forecasting length, or estimation method led to consistent bias in predictions. Educators should be cautious when using trend-line decision rules to predict future performance. Suggestions for alternate decision rules to explore with CATs are offered.
Descriptors: Data Collection, Predictive Measurement, Predictive Validity, Predictor Variables, Growth Models, Trend Analysis, Longitudinal Studies, At Risk Students, Grade 4, Grade 6, Grade 8, Adaptive Testing, Computer Assisted Testing, Accuracy, Progress Monitoring, Mathematics Achievement, Reading Achievement
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Grade 4; Intermediate Grades; Grade 6; Middle Schools; Grade 8; Junior High Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A