NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED620355
Record Type: Non-Journal
Publication Date: 2022
Pages: 43
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Is the Treatment Weak or the Test Insensitive: Interrogating Item Difficulties to Elucidate the Nature of Reading Intervention Effects
David J. Francis; Paulina A. Kulesz; Shiva Khalaf; Martin Walczak; Sharon R. Vaughn
Grantee Submission
Intervention research in education is sometimes criticized for the use of experimenter developed assessments, especially when these are over aligned with treatment. At the same time, intervention researchers sometimes prefer locally developed assessments because they appear to be more sensitive to treatment effects even when the test is not subject to the criticism of over alignment. This paper examines the question of test sensitivity to treatment effects for experimenter developed and standardized tests for the specific case of reading in grade 8. We examine similarities and differences between a specific experimenter developed test and widely used standardized reading assessment. Analyses show these particular tests to be quite comparable. The paper concludes with an examination of test sensitivity by simulating treatment effects of different magnitudes. These analyses highlight some potential limitations of the standardized test for detecting small to moderate effects depending on the ability range of the students participating in intervention. The implications for intervention research and identification of students under response to intervention are discussed. [This paper was published in "Learning and Individual Differences" v97 2022.]
Publication Type: Reports - Research
Education Level: Elementary Education; Grade 8; Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) (DHHS/NIH)
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Gates MacGinitie Reading Tests
IES Funded: Yes
Grant or Contract Numbers: R305F100013; R305A170251; P50HD052117