NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: ED643800
Record Type: Non-Journal
Publication Date: 2023
Pages: 63
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Leveraging Experimental and Observational Evidence to Assess the Generalizability of the Effects of Early Colleges in North Carolina
Sarah Fuller; Douglas Lee Lauen; Fatih Unlu
Grantee Submission
Early college high schools (ECHS) in North Carolina are small public schools of choice on college campuses that seek to promote attaining postsecondary credits in high school, college readiness, and postsecondary enrollment for underrepresented groups. Evidence from randomized control trial (RCT) has shown positive effects of the ECHS model on important high school and postsecondary outcomes but appear to be underpowered to detect moderation effects. Furthermore, RCTs rarely address the key question of primary policy interest: "is the program effective on average across the population?" This leaves us uncertain about whether the early college intervention is (1) a good strategy for helping to close enrollment and attainment gaps between under- and over-represented groups, and (2) whether the expansion of the ECHS model will lead to the positive results that the RCT studies suggest. This study uses administrative data on all ECHS in North Carolina including those ECHS that were part of a lottery study. This allows us to generate RCT estimates for the ECHS in the lottery sample and quasi-experimental (QE) estimates for both the lottery and non-lottery ECHS. We leverage this unique circumstance to generate estimates of the effect of ECHS on post-secondary outcomes that simultaneously maximize both internal and external validity. Specifically, because generalization depends on both moderation and sample selection, we (1) investigate sample selection, (2) conduct a moderation analysis to determine whether the effects of the intervention vary by key factors that also predict sample selection, and (3) produce a pooled estimate by extending a method called cross-design synthesis to incorporates both RCT evidence and quasi-experimental evidence. We find strong evidence that the positive results of the RCT generalize to the full sample of ECHS which provides stronger evidence of effectiveness. [This paper was published in "Education Finance and Policy" v18 n4 p568-596 2023.]
Related Records: EJ1407186
Publication Type: Reports - Research
Education Level: Secondary Education; High Schools; Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
Identifiers - Location: North Carolina
IES Funded: Yes
Grant or Contract Numbers: R305A150477