ERIC Number: EJ1301702
Record Type: Journal
Publication Date: 2021
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1530-5058
EISSN: N/A
Available Date: N/A
Exploring Task Features That Predict Psychometric Quality of Test Items: The Case for the Dutch Driving Theory Exam
Roelofs, Erik C.; Emons, Wilco H. M.; Verschoor, Angela J.
International Journal of Testing, v21 n2 p80-104 2021
This study reports on an Evidence Centered Design (ECD) project in the Netherlands, involving the theory exam for prospective car drivers. In particular, we illustrate how cognitive load theory, task-analysis, response process models, and explanatory item-response theory can be used to systematically develop and refine task models. Based on a cognitive model for driving, 353 existing items involving rules of priority at intersections, were coded on intrinsic task features and task presentation features. Hierarchical regression analyses were carried out to determine the contribution of task features to item difficulty and item discrimination. A substantial proportion of variance in both item difficulty and item discrimination parameters could be explained by intrinsic task-features, including rules and signs (25%, 18.6%), task-intersection features (13.4%, 14.1%), and a smaller small proportion to item presentation features (3.5%, 7.1%) of the total variance. It is concluded that the systematic approach of discerning task features and determining the impact on item parameters has added value as an ECD-tool for evaluating existing assessments that are planned to be innovated. The paper concludes with a discussion of practical implications.
Descriptors: Foreign Countries, Psychometrics, Test Items, Evidence Based Practice, Instructional Design, Cognitive Processes, Difficulty Level, Item Response Theory, Driver Education, Task Analysis
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Netherlands
Grant or Contract Numbers: N/A
Author Affiliations: N/A