ERIC Number: EJ1268706
Record Type: Journal
Publication Date: 2020
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2332-8584
EISSN: N/A
The Design of Clustered Observational Studies in Education
Page, Lindsay C.; Lenard, Matthew A.; Keele, Luke
AERA Open, v6 n3 Jul-Sep 2020
Clustered observational studies (COSs) are a critical analytic tool for educational effectiveness research. We present a design framework for the development and critique of COSs. The framework is built on the counterfactual model for causal inference and promotes the concept of designing COSs that emulate the targeted randomized trial that would have been conducted were it feasible. We emphasize the key role of understanding the assignment mechanism to study design. We review methods for statistical adjustment and highlight a recently developed form of matching designed specifically for COSs. We review how regression models can be profitably combined with matching and note best practices for estimates of statistical uncertainty. Finally, we review how sensitivity analyses can determine whether conclusions are sensitive to bias from potential unobserved confounders. We demonstrate concepts with an evaluation of a summer school reading intervention in a large U.S. school district.
Descriptors: Educational Research, Observation, Research Design, Statistical Analysis, Regression (Statistics), Best Practices, Statistical Bias, Summer Schools, Reading Instruction, Intervention, Elementary School Students
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://bibliotheek.ehb.be:2814
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: North Carolina
Grant or Contract Numbers: N/A