ERIC Number: EJ876710
Record Type: Journal
Publication Date: 2010
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0655
EISSN: N/A
Available Date: N/A
Comparisons among Designs for Equating Mixed-Format Tests in Large-Scale Assessments
Kim, Sooyeon; Walker, Michael E.; McHale, Frederick
Journal of Educational Measurement, v47 n1 p36-53 Spr 2010
In this study we examined variations of the nonequivalent groups equating design for tests containing both multiple-choice (MC) and constructed-response (CR) items to determine which design was most effective in producing equivalent scores across the two tests to be equated. Using data from a large-scale exam, this study investigated the use of anchor CR item rescoring (known as trend scoring) in the context of classical equating methods. Four linking designs were examined: an anchor with only MC items, a mixed-format anchor test containing both MC and CR items; a mixed-format anchor test incorporating common CR item rescoring; and an equivalent groups (EG) design with CR item rescoring, thereby avoiding the need for an anchor test. Designs using either MC items alone or a mixed anchor without CR item rescoring resulted in much larger bias than the other two designs. The EG design with trend scoring resulted in the smallest bias, leading to the smallest root mean squared error value.
Descriptors: Measures (Individuals), Scoring, Equated Scores, Test Bias, Item Analysis, Test Items, Test Construction, Test Format, Comparative Testing, Questioning Techniques, Group Testing, Multiple Choice Tests, Responses, Educational Testing
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://bibliotheek.ehb.be:2429/WileyCDA/
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A