ERIC Number: EJ1167484
Record Type: Journal
Publication Date: 2018
Pages: 23
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0969-594X
EISSN: N/A
Addressing Omitted Prior Achievement Bias in International Assessments: An Applied Example Using PIRLS-NPD Matched Data
Caro, Daniel H.; Kyriakides, Leonidas; Televantou, Ioulia
Assessment in Education: Principles, Policy & Practice, v25 n1 p5-27 2018
Omitted prior achievement bias is pervasive in international assessment studies and precludes causal inference. For example, reported negative associations between student-oriented teaching strategies and student performance are against expectations and might actually reflect omitted prior achievement bias. Namely, that these teaching strategies are negatively correlated with unobserved prior achievement performance, because teachers offer more support to lower performing students, and not that these strategies "cause" lower performance. This paper examines omitted prior achievement bias in teaching effects with prior achievement data available for students in England participating in the Progress in International Reading Literacy Study. Further, it proposes an analytical approach to account for omitted prior achievement bias in international estimates. The paper argues that the bias is not simply a technical artefact, but reflects educational mechanisms unobserved in international assessment studies, which can be captured with matched assessment data-sets or with evidence from previous studies. Estimates of these mechanisms can be used to postulate scenarios of the bias across education systems and thereby adjust international estimates of teaching effects as if prior achievement were observed. Potentials and limitations of this approach for studying educational effectiveness with international assessment data are discussed.
Descriptors: Achievement Tests, Foreign Countries, International Assessment, Grade 4, Reading Achievement, Reading Tests, Bias, Statistical Analysis, Teaching Methods, Socioeconomic Status, Elementary School Students
Taylor & Francis. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 4
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom (England)
Identifiers - Assessments and Surveys: Progress in International Reading Literacy Study
Grant or Contract Numbers: N/A