ERIC Number: EJ1115251
Record Type: Journal
Publication Date: 2016
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1934-5747
EISSN: N/A
The Implications of Contamination for Educational Experiments with Two Levels of Nesting
Rhoads, Christopher
Journal of Research on Educational Effectiveness, v9 n4 p531-555 2016
Experimental evaluations that involve the educational system usually involve a hierarchical structure (students are nested within classrooms that are nested within schools, etc.). Concerns about contamination, where research subjects receive certain features of an intervention intended for subjects in a different experimental group, have often led researchers to randomize units at a higher level of the educational hierarchy. Existing work on two-level designs suggests that situations where contamination should lead to randomization at a higher level are likely to be rare. This article extends these results to the case of three-level designs. In order to understand the implications of mathematical results, existing information about the size of intracluster correlation coefficients (ICCs) in educational studies with three levels and about the extent of treatment effect heterogeneity across schools is discussed. Better empirical estimates of ICCs, treatment effect heterogeneity, and plausible contamination values are necessary to make full use of the results in this article. However, it seems likely that situations where contamination should lead to randomization at a higher level in three-level designs are rare.
Descriptors: Educational Experiments, Error of Measurement, Research Design, Statistical Analysis, Hierarchical Linear Modeling, Cluster Grouping, Randomized Controlled Trials, Experimental Groups, Control Groups, Correlation, Power Structure, Educational Research, Comparative Analysis, Effect Size, Evaluation Criteria, Equations (Mathematics), Accuracy
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A