ERIC Number: EJ1443101
Record Type: Journal
Publication Date: 2024
Pages: 12
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0218-8791
EISSN: EISSN-1742-6855
Aligning Evaluation Approaches with Context: Reductionism, System Thinking, and Pragmatic Synthesis
Huey T. Chen; Liliana Morosanu; Victor H. Chen
Asia Pacific Journal of Education, v44 n3 p540-551 2024
The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design for outcome evaluation, and with its strategy to maximize internal validity at the expense of external validity. The debates over these issues have been ongoing and intensive. This paper proposes a fresh idea for approaches to address this controversy, by bringing problem-solving philosophies into discussions. Three problem-solving philosophies have been used to develop intervention programs: reductionism, systems thinking, and pragmatic synthesis. This paper argues the validity typology is appropriate for evaluating reductionism-based programs only, but not systems thinking- or pragmatic synthesis-based programs. Mismatched applications of research designs in evaluation are sources of confusion and controversies. This insight indicates a pressing need for developing evaluation theories and approaches for systems thinking and pragmatic synthesis. Because the majority of community programs are pragmatic synthesis-based programs, this paper devotes to developing such solutions.
Descriptors: Evaluation Methods, Systems Approach, Intervention, Evidence Based Practice, Randomized Controlled Trials, Validity, Classification, Problem Solving, Program Development, Program Evaluation, Research Design
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A