NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED628601
Record Type: Non-Journal
Publication Date: 2023
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0049-089X
EISSN: N/A
Quantifying the Robustness of Causal Inferences: Sensitivity Analysis for Pragmatic Social Science
Kenneth A. Frank; Qinyun Lin; Ran Xu; Spiro Maroulis; Anna Mueller
Grantee Submission, Social Science Research v110 Article 102815 2023
Social scientists seeking to inform policy or public action must carefully consider how to identify effects and express inferences because actions based on invalid inferences will not yield the intended results. Recognizing the complexities and uncertainties of social science, we seek to inform inevitable debates about causal inferences by quantifying the conditions necessary to change an inference. Specifically, we review existing sensitivity analyses within the omitted variables and potential outcomes frameworks. We then present the Impact Threshold for a Confounding Variable (ITCV) based on omitted variables in the linear model and the Robustness of Inference to Replacement (RIR) based on the potential outcomes framework. We extend each approach to include benchmarks and to fully account for sampling variability represented by standard errors as well as bias. We exhort social scientists wishing to inform policy and practice to quantify the robustness of their inferences after utilizing the best available data and methods to draw an initial causal inference.
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Early Childhood Education; Elementary Education; Kindergarten; Primary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305D220022