ERIC Number: EJ990688
Record Type: Journal
Publication Date: 2012-Nov
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1531-7714
EISSN: N/A
A Meta-Analysis of Growth Trends from Vertically Scaled Assessments
Dadey, Nathan; Briggs, Derek C.
Practical Assessment, Research & Evaluation, v17 n14 Nov 2012
A vertical scale, in principle, provides a common metric across tests with differing difficulties (e.g., spanning multiple grades) so that statements of "absolute" growth can be made. This paper compares 16 states' 2007-2008 effect size growth trends on vertically scaled reading and math assessments across grades 3 to 8. Two patterns common in past research on vertical scales, score deceleration (grade-to-grade growth that decreases over time) and scale shrinkage (variability in scale scores that decreases from lower to higher grades), are investigated. Pervasive, but modest, patterns of score deceleration are found for both math and reading. Limited evidence of scale shrinkage was found for reading, and virtually no evidence was found for math. In addition, linear regression was used to show that little of the considerable variability in the growth effect sizes across states could be explained by readily identifiable characteristics of the vertical scales. However, many scale characteristics were not well documented in available technical reports. The most important of these characteristics, along with their implications for interpretations of growth, are discussed. The results serve both as a normative baseline against which other scaling efforts can be compared. (Contains 5 tables, 4 footnotes, and 5 figures.)
Descriptors: Meta Analysis, Scaling, Effect Size, Reading Tests, Mathematics Tests, Achievement Gains, Scores, Comparative Analysis, Regression (Statistics), Grade 3, Grade 4, Grade 5, Grade 6, Grade 7, Grade 8, Item Response Theory, Elementary School Students, Middle School Students
Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Elementary Secondary Education; Grade 3; Grade 4; Grade 5; Grade 6; Grade 7; Grade 8; Junior High Schools; Middle Schools
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Arizona; Colorado; Delaware; Florida; Idaho; Illinois; Indiana; Missouri; New Mexico; North Carolina; North Dakota; Oregon; South Dakota; West Virginia; Wisconsin; Wyoming
Grant or Contract Numbers: N/A