NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED613693
Record Type: Non-Journal
Publication Date: 2011-Nov
Pages: 160
Abstractor: ERIC
ISBN: N/A
ISSN: N/A
EISSN: N/A
Evaluation of "System 44." Final Report [2011]
Beam, Margaret; Faddis, Bonnie J.; Hahn, Karen
RMC Research Corporation
Scholastic's "System 44" is a foundational reading program intended for older struggling readers who have not mastered basic phonics and decoding skills. Combining researched-based phonics instruction with adaptive technology, "System 44" is designed to improve students' word reading accuracy, fluency, and comprehension. The "System 44" program delivers research-based instruction through an adaptive computer component; teacher-led small group instruction; and individual student practice involving high-interest, leveled materials. Thus students who have not responded to classroom reading instruction may benefit from the more intensive and specific decoding instruction provided through "System 44." Using a randomized design, this evaluation assessed the effectiveness of "System 44" in terms of improving the foundational reading skills of struggling readers in Grades 4-8 in a large suburban school district in southern California during the 2010-2011 school year. The evaluation of the implementation and impact of "System 44" involved 7 of the 11 elementary schools and all 4 middle schools in the district. A 2-step process was used to establish student eligibility for "System 44." The Scholastic Reading Inventory (SRI) was used to screen students in Grades 4-8 who performed below the 50th percentile on the spring 2010 California Standards Test (CST) for "System 44" eligibility. Those students who scored below 600 Lexiles on the SRI were administered the Scholastic Phonics Inventory (SPI), a computer-based test used to identify students in need of additional phonics instruction. Students who scored in the Beginning or Developing reader categories on the SPI were randomly assigned (stratified by school and grade level) to either the "System 44" treatment group or the control group. Data collection activities for the "System 44" evaluation included student reading tests, teacher surveys, "System 44" classroom observations, a professional development observation, and staff interviews. RMC Research hired and trained 4 local testers to administer a battery of standardized reading tests to all treatment and control students. The testers administered the tests to each student separately over a 3-week period in September and October 2010 to establish baseline scores and again in May 2011 to attain follow-up scores. Listed in order of administration, the tests included the following: (1) Test of Silent Reading Efficiency and Comprehension (TOSREC); (2) Comprehensive Test of Phonological Processing (CTOPP) Elision subtest; (3) Woodcock-Johnson III Word Identification subtest; (4) Woodcock-Johnson III Word Attack subtest; (5) Test of Word Reading Efficiency (TOWRE) Sight Word Efficiency subtest; and (6) Test of Word Reading Efficiency (TOWRE) Phonetic Decoding Efficiency subtest. This report details the program impact findings and concludes with recommendations from the evaluation team.
RMC Research Corporation. 1000 Market Street Building 2, Portsmouth, NH 03801. Tel: 603-422-8888; Fax: 603-436-9166; Web site: https://rmcresearchcorporation.com/
Publication Type: Reports - Research; Tests/Questionnaires; Numerical/Quantitative Data
Education Level: Elementary Education; Junior High Schools; Middle Schools; Secondary Education; Grade 4; Intermediate Grades; Grade 5; Grade 6; Grade 7; Grade 8
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: RMC Research Corporation; Scholastic Inc.
Identifiers - Location: California
Identifiers - Assessments and Surveys: Woodcock Johnson Tests of Achievement; Test of Word Reading Efficiency
Grant or Contract Numbers: N/A
What Works Clearinghouse Reviewed: Meets Evidence Standards without Reservations