ERIC Number: ED635696
Record Type: Non-Journal
Publication Date: 2023-Jul
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Asymptotic Standard Errors of Model-Based Oral Reading Fluency Score Equating
Xin Qiao; Akihito Kamata; Cornelis Potgieter
Grantee Submission, Paper presented at the Annual Meeting of the International Meeting of Psychometrics Society (IMPS) (College Park, MD, Jul 2023)
Oral reading fluency (ORF) assessments are commonly used to screen at-risk readers and to evaluate the effectiveness of interventions as curriculum-based measurements. As with other assessments, equating ORF scores becomes necessary when we want to compare ORF scores from different test forms. Recently, Kara et al. (2023) proposed a model-based equating method for ORF scores. However, they did not provide closed-form asymptotic standard errors (SEs) of the equated ORF scores while it is advocated to report SEs of equating in practice. Therefore, this study aims to address this remaining question. Specifically, the delta method was adopted to derive the asymptotic SEs of equated ORF scores. The ORF scoring was conducted using an approach that takes into account the calibration error. Its performance was compared to the standard practice that ignores calibration errors. It is expected that the two scoring approaches would further have impact on the recovery of equated ORF score SEs. A simulation study was conducted to evaluate the recovery of derived equating SEs in various conditions. Results suggested satisfactory recovery of the derived asymptotic SEs of equated ORF scores. In addition, taking into account the calibration error in ORF scoring can produce more accurate and precise equated ORF score SEs under larger sample sizes and longer test lengths.
Descriptors: Error of Measurement, Oral Reading, Reading Fluency, Equated Scores, Reading Tests, Scoring
Publication Type: Speeches/Meeting Papers; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305D200038