ERIC Number: EJ879636
Record Type: Journal
Publication Date: 2009
Pages: 27
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1076-9986
EISSN: N/A
Adjusting a Significance Test for Clustering in Designs with Two Levels of Nesting
Hedges, Larry V.
Journal of Educational and Behavioral Statistics, v34 n4 p464-490 2009
A common mistake in analysis of cluster randomized experiments is to ignore the effect of clustering and analyze the data as if each treatment group were a simple random sample. This typically leads to an overstatement of the precision of results and anticonservative conclusions about precision and statistical significance of treatment effects. This article gives a simple adjustment to the "t" statistic that would be computed if clustering were (incorrectly) ignored in an experiment with two levels of nesting (e.g., classrooms and schools) where treatment assignment is made at the highest (e.g., school) level. The adjustment is a multiplicative factor depending on the number of clusters and subclusters, the cluster and subcluster sample sizes, and the cluster and subcluster intraclass correlations rho[subscript S] and rho[subscript C]. The adjusted "t" statistic has Student's "t" distribution with reduced degrees of freedom. The adjusted statistic reduces to the "t" statistic computed by ignoring clustering when rho[subscript S] = rho[subscript C] = 0. It reduces to the "t" statistic computed using cluster means when rho[subscript S] = 1. rho[subscript S] and rho[subscript C] are between 0 and 1, the adjusted "t" statistic lies between these two and the degrees of freedom are in between those corresponding to these two extremes. (Contains 4 tables.)
Descriptors: Data Analysis, Statistical Significance, Statistics, Experiments, Educational Research, Research Design, Correlation, Sample Size, Hypothesis Testing, Statistical Analysis
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://bibliotheek.ehb.be:2814
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A