ERIC Number: EJ1034858
Record Type: Journal
Publication Date: 2013-Dec
Pages: 35
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0193-841X
EISSN: N/A
Strategies for Improving Power in School-Randomized Studies of Professional Development
Kelcey, Ben; Phelps, Geoffrey
Evaluation Review, v37 n6 p520-554 Dec 2013
Objectives: Group-randomized designs are well suited for studies of professional development because they can accommodate programs that are delivered to intact groups (e.g., schools), the collaborative nature of professional development, and extant teacher/school assignments. Though group designs may be theoretically favorable, prior evidence has suggested that they may be challenging to conduct in professional development studies because well-powered designs will typically require large sample sizes or expect large effect sizes. Using teacher knowledge outcomes in mathematics, we investigated when and the extent to which there is evidence that covariance adjustment on a pretest, teacher certification, or demographic covariates can reduce the sample size necessary to achieve reasonable power. Method: Our analyses drew on multilevel models and outcomes in five different content areas for over 4,000 teachers and 2,000 schools. Using these estimates, we assessed the minimum detectable effect sizes for several school-randomized designs with and without covariance adjustment. Results: The analyses suggested that teachers' knowledge is substantially clustered within schools in each of the five content areas and that covariance adjustment for a pretest or, to a lesser extent, teacher certification, has the potential to transform designs that are unreasonably large for professional development studies into viable studies.
Descriptors: Statistical Analysis, Research Design, Faculty Development, Sample Size, Hierarchical Linear Modeling, Teachers, Teacher Characteristics, Mathematics, Pretests Posttests, Effect Size, Teacher Certification, Elementary School Mathematics, Number Concepts, Algebra, Geometry, Middle Schools, Grade 4, Grade 5, Grade 6, Grade 7, Grade 8
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://bibliotheek.ehb.be:2814
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Middle Schools; Secondary Education; Junior High Schools; Grade 4; Intermediate Grades; Grade 5; Grade 6; Grade 7; Grade 8
Audience: N/A
Language: English
Sponsor: National Science Foundation
Authoring Institution: N/A
Grant or Contract Numbers: 1405601; 1228490; 0927725