ERIC Number: EJ945879
Record Type: Journal
Publication Date: 2007-Jul
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0021-9010
EISSN: N/A
Situational Judgment Tests in High-Stakes Settings: Issues and Strategies with Generating Alternate Forms
Lievens, Filip; Sackett, Paul R.
Journal of Applied Psychology, v92 n4 p1043-1055 Jul 2007
This study used principles underlying item generation theory to posit competing perspectives about which features of situational judgment tests might enhance or impede consistent measurement across repeat test administrations. This led to 3 alternate-form development approaches (random assignment, incident isomorphism, and item isomorphism). The effects of these approaches on alternate-form consistency, mean score changes, and criterion-related validity were examined in a high-stakes context (N = 3,361). Generally, results revealed that even small changes in the context of the situations presented resulted in significantly lower alternate-form consistency. Conversely, placing more constraints on the alternate-form development process proved beneficial. The contributions, implications, and limitations of these results for the development of situational judgment tests and high-stakes testing are discussed. (Contains 5 tables and 1 figure.)
Descriptors: Validity, High Stakes Tests, Test Construction, Testing, Predictive Validity, Scores, Pretests Posttests, Difficulty Level, Test Items, Intervals, Cognitive Ability, Correlation, Models, Foreign Countries, Medical Schools, Physicians, Patients, Medical Education, Hypothesis Testing, Grade Point Average, Psychology
American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002-4242. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: order@apa.org; Web site: http://www.apa.org/publications
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Belgium
Grant or Contract Numbers: N/A