ERIC Number: EJ1203928
Record Type: Journal
Publication Date: 2018
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0485
EISSN: N/A
Adjusting for Guessing and Applying a Statistical Test to the Disaggregation of Value-Added Learning Scores
Smith, Ben O.; Wagner, Jamie
Journal of Economic Education, v49 n4 p307-323 2018
In 2016, Walstad and Wagner developed a procedure to split pre-test and post-test responses into four learning types: positive, negative, retained, and zero learning. This disaggregation is not only useful in academic studies; but also provides valuable insight to the practitioner: an instructor would take different mitigating actions in response to zero versus negative learning. However, the original disaggregation is sensitive to student guessing. This article extends the original work by accounting for guessing and provides adjusted estimators using the existing disaggregated values. Further, Monte Carlo simulations of the adjusted learning type estimates are provided. Under certain assumptions, an instructor can determine if a difference in positive (or negative) learning is the result of a true change in learning or "white noise."
Descriptors: Pretests Posttests, Value Added Models, Guessing (Tests), Monte Carlo Methods, Cognitive Style, Scores, Multiple Choice Tests, Simulation, Microeconomics, Teaching Methods, Undergraduate Students, Economics Education
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A