ERIC Number: ED517968
Record Type: Non-Journal
Publication Date: 2011-Apr
Pages: 184
Abstractor: ERIC
ISBN: N/A
ISSN: N/A
EISSN: N/A
Impact of the Thinking Reader[R] Software Program on Grade 6 Reading Vocabulary, Comprehension, Strategies, and Motivation: Final Report. NCEE 2010-4035
Drummond, Kathryn; Chinen, Marjorie; Duncan, Teresa Garcia; Miller, H. Ray; Fryer, Lindsay; Zmach, Courtney; Culp, Katherine
National Center for Education Evaluation and Regional Assistance
"Thinking Reader" is a software program for students in Grades 5-8 that incorporates elements commonly identified in policy reports as being key components of effective adolescent literacy instruction. This evaluation of the impact of "Thinking Reader" use by Grade 6 students focused on two confirmatory research questions about the effect of the program on two measures of students' reading achievement: (1) What is the effect of "Thinking Reader" on students' reading vocabulary?; and (2) What is the effect of "Thinking Reader" on students' reading comprehension? A statistically significant impact on either outcome measure would signal the program's success. The study also examined whether "Thinking Reader" has an effect on two ancillary, but important, measures of students' approaches to reading: (1) What is the effect of "Thinking Reader" on students' use of reading comprehension strategies?; and (2) What is the effect of "Thinking Reader" on students' motivation to read? This study also addressed four exploratory research questions. These questions investigate whether the impact of the "Thinking Reader" intervention on students' reading achievement varied across subgroups of students formed on the basis of baseline reading vocabulary, baseline reading comprehension, and baseline motivation to read measures: (1) Does the effect of "Thinking Reader" on students' reading vocabulary vary according to their baseline reading vocabulary scores?; (2) Does the effect of "Thinking Reader" on students' reading comprehension vary according to their baseline reading comprehension scores?; (3) Does the effect of "Thinking Reader" on students' reading vocabulary vary according to their baseline reading motivation scores?; (4) Does the effect of "Thinking Reader" on students' reading comprehension vary according to their baseline reading motivation scores? The impact results for the primary research questions indicate that "Thinking Reader" was no more effective than business as usual in improving students' reading vocabulary (effect size of -0.04) or reading comprehension (effect size of 0.03). Results for the ancillary research questions indicate that "Thinking Reader" was also no more effective than business as usual in improving student' use of reading comprehension strategies (effect size of 0.03) or their motivation to read (effect size of -0.03). None of these results are statistically significant. Sensitivity analyses found no changes in the direction or magnitude of the intervention effects. Appendices include: (1) Examples From the "Thinking Reader" Program; (2) Data Collection; (3) Missing Data, Baseline Equivalence of the Analytic Sample, and the Impact Model; (4) Sensitivity Analyses; and (5) Exploratory Analyses. (Contains 89 tables, 10 figures, 6 boxes, 7 exhibits and 51 footnotes.)
Descriptors: Reading Programs, Computer Software, Program Evaluation, Program Effectiveness, Reading Achievement, Grade 6, Vocabulary, Reading Comprehension, Reading Strategies, Reading Motivation, Intervention, Effect Size, Statistical Significance
National Center for Education Evaluation and Regional Assistance. Available from: ED Pubs. P.O. Box 1398, Jessup, MD 20794-1398. Tel: 877-433-7827; Web site: http://ies.ed.gov/ncee/
Publication Type: Numerical/Quantitative Data; Reports - Research
Education Level: Elementary Education; Grade 6
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: National Center for Education Evaluation and Regional Assistance (ED)
Identifiers - Location: Connecticut; Massachusetts; Rhode Island
IES Funded: Yes
Grant or Contract Numbers: N/A
What Works Clearinghouse Reviewed: Meets Evidence Standards without Reservations
WWC Study Page: http://ies.ed.gov/ncee/wwc/study/72031
IES Cited: ED534779
IES Publication: http://ies.ed.gov/ncee/edlabs/projects/project.asp?ProjectID=46