ERIC Number: EJ1108500
Record Type: Journal
Publication Date: 2016-Sep
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1098-2140
EISSN: N/A
Finding Efficiency in the Design of Large Multisite Evaluations: Estimating Variances for Science Achievement Studies
Westine, Carl D.
American Journal of Evaluation, v37 n3 p311-325 Sep 2016
Little is known empirically about intraclass correlations (ICCs) for multisite cluster randomized trial (MSCRT) designs, particularly in science education. In this study, ICCs suitable for science achievement studies using a three-level (students in schools in districts) MSCRT design that block on district are estimated and examined. Estimates of ICCs, by district, are computed for unconditional two-level (students in schools) hierarchical linear models using student-level science achievement raw scores as measured by the Texas Assessment of Knowledge and Skills in 2010-2011 for Grades 5, 8, 10, and 11. The average within-district ICCs for MSCRTs of science achievement range from 0.0781 to 0.0982 across grades. For Grade 5, a significant difference is found in the ICC estimate suitable for MSCRTs with many districts versus only a few districts. Consequently, evaluators of science education interventions should exhibit care when selecting ICC estimates for three-level MSCRT designs that block on district.
Descriptors: Efficiency, Evaluation Methods, Science Achievement, Correlation, Multivariate Analysis, Randomized Controlled Trials, Science Education, School Districts, Computation, Hierarchical Linear Modeling, Scores, Achievement Tests, Grade 5, Grade 8, Grade 10, Grade 11, Research Design
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://bibliotheek.ehb.be:2814
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 5; Intermediate Grades; Middle Schools; Elementary Education; Grade 8; Junior High Schools; Secondary Education; Grade 10; High Schools; Grade 11
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Identifiers - Location: Texas
Grant or Contract Numbers: DRL1118555