NotesFAQContact Us
Collection
Advanced
Search Tips
Showing all 6 results Save | Export
The Alternative Factors Leading to Replication Crisis: Prediction and Evaluation
Peer reviewed Peer reviewed
Direct linkDirect link
Gregory Chernov – Evaluation Review, 2025
Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…
Descriptors: Replication (Evaluation), Prediction, Scientific Research, Failure
Measuring Stakeholder Participation in Evaluation: An Empirical Validation of the Participatory Evaluation Measurement Instrument (PEMI)
Peer reviewed Peer reviewed
Direct linkDirect link
Daigneault, Pierre-Marc; Jacob, Steve; Tremblay, Joel – Evaluation Review, 2012
Background: Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. Objectives: This study consists of a first empirical validation of a measurement instrument that…
Descriptors: Stakeholders, Participation, Program Evaluation, Measurement Techniques
Assessing School Effectiveness
Peer reviewed Peer reviewed
Direct linkDirect link
Klein, Stephen; Freedman, David; Shavelson, Richard; Bolus, Roger – Evaluation Review, 2008
The Collegiate Learning Assessment (CLA) program measures value added in colleges and universities, by testing the ability of freshmen and seniors to think logically and write clearly. The program is popular enough that it has attracted critics. In this paper, we outline the methods used by the CLA to determine value added. We summarize the…
Descriptors: School Effectiveness, Logical Thinking, College Freshmen, College Seniors
Old Wine in New Skins: The Sensitivity of Established Findings to New Methods
Peer reviewed Peer reviewed
Direct linkDirect link
Foster, E. Michael; Wiley-Exley, Elizabeth; Bickman, Leonard – Evaluation Review, 2009
Findings from an evaluation of a model system for delivering mental health services to youth were reassessed to determine the robustness of key findings to the use of methodologies unavailable to the original analysts. These analyses address a key concern about earlier findings--that the quasi-experimental design involved the comparison of two…
Descriptors: Mental Health Programs, Health Services, Youth, Delivery Systems
Evaluation of the Effects of the Aban Aya Youth Project in Reducing Violence among African American Adolescent Males Using Latent Class Growth Mixture Modeling Techniques
Peer reviewed Peer reviewed
Direct linkDirect link
Segawa, Eisuke; Ngwe, Job E.; Li, Yanhong; Flay, Brian R. – Evaluation Review, 2005
This study employs growth mixture modeling techniques to evaluate the preventive effects of the Aban Aya Youth Project in reducing the rate of growth of violence among African American adolescent males (N = 552). Results suggest three distinct classes of participants: high risk (34%), medium risk (54%), and low risk (12%) based on both the…
Descriptors: Males, Adolescents, Violence, African Americans
The Collegiate Learning Assessment: Facts and Fantasies
Peer reviewed Peer reviewed
Direct linkDirect link
Klein, Stephen; Benjamin, Roger; Shavelson, Richard; Bolus, Roger – Evaluation Review, 2007
The Collegiate Learning Assessment (CLA) is a computer administered, open-ended (as opposed to multiple-choice) test of analytic reasoning, critical thinking, problem solving, and written communication skills. Because the CLA has been endorsed by several national higher education commissions, it has come under intense scrutiny by faculty members,…
Descriptors: Higher Education, Educational Assessment, Performance Tests, Logical Thinking