ERIC Number: ED542023
Record Type: Non-Journal
Publication Date: 2012-Oct
Pages: 56
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Relationships of Examinee Pair Characteristics and Item Response Similarity. ACT Research Report Series, 2012 (8)
Allen, Jeff
ACT, Inc.
Detecting unusual similarity in the item responses of a pair of examinees usually conditions on the pair's overall test performance (e.g., raw scores). Doing this, however, often requires assumptions about the invariance of other examinee pair characteristics. In this study, we examined the appropriateness of such assumptions about selected examinee pair characteristics using item response data from the ACT Assessment[R]. We found that the number of identical incorrect responses on multiple choice tests were slightly higher for same high school, female, and twin pairs. Pairs who took the same mathematics courses and received the same grades had slightly higher levels of identical incorrect responses on the ACT Mathematics test. Across the four ACT tests, twin pairs were about twice as likely to have a similarity level described as a one-in-a-thousand event, all other shared characteristics held constant. The results for twin pairs can be used to set an upper bound for the level of similarity in identical incorrect responses that is due to examinee's shared environment and academic experiences. Tables are appended. (Contains 16 tables, 2 figures, and 3 footnotes.)
Descriptors: College Entrance Examinations, Language Tests, English, Mathematics Tests, Reading Tests, Science Tests, Multiple Choice Tests, Item Response Theory, Raw Scores, Statistical Significance, Twins, Sampling, Response Style (Tests)
ACT, Inc. 500 ACT Drive, P.O. Box 168, Iowa City, IA 52243-0168. Tel: 319-337-1270; Web site: http://www.act.org
Publication Type: Reports - Research
Education Level: Higher Education; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: ACT, Inc.
Identifiers - Assessments and Surveys: ACT Assessment
Grant or Contract Numbers: N/A