ERIC Number: ED507085
Record Type: Non-Journal
Publication Date: 2009-Feb
Pages: 32
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Validity from the Perspective of Model-Based Reasoning. CRESST Report 752
Mislevy, Robert J.
National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
From a contemporary perspective on cognition, the between-persons variables in trait-based arguments in educational assessment are absurd over-simplifications. Yet, for a wide range of applications, they work. Rather than seeing such variables as independently-existing characteristics of people, we can view them as summaries of patterns in situated behaviors that could be understood at the finer grainsize of sociocognitive analyses. When done well, inference through coarser educational and psychological measurement models suits decisions and actions routinely encountered in school and work, yet is consistent with what we are learning about how people learn, act, and interact. An essential element of test validity is whether, in a given application, using a given model provides a sound basis for organizing observations and guiding actions in the situations for which it is intended. This presentation discusses the use of educational measurement models such as those of item response theory and cognitive diagnosis from the perspective of model-based reasoning, with a focus on validity. (Contains 5 figures, 1 table and 2 footnotes.) [This work was partially supported by the Educational Research and Development Centers Program, PR/Award Number R305A050004.]
Descriptors: Test Validity, Educational Assessment, Item Response Theory, Logical Thinking, Models, Cognitive Science, Individual Characteristics, Figurative Language, Measurement, Probability, Psychometrics
National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 300 Charles E Young Drive N, GSE&IS Building 3rd Floor, Mailbox 951522, Los Angeles, CA 90095-1522. Tel: 310-206-1532; Fax: 310-825-3883; Web site: http://www.cresst.org
Publication Type: Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Spencer Foundation; Department of Education (ED)
Authoring Institution: National Center for Research on Evaluation, Standards, and Student Testing
Grant or Contract Numbers: N/A