ERIC Number: EJ1239650
Record Type: Journal
Publication Date: 2019
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2469-9896
EISSN: N/A
Linking and Comparing Short and Full-Length Concept Inventories of Electricity and Magnetism Using Item Response Theory
Xiao, Yang; Fritchman, Joseph C.; Bao, Jacqueline Y.; Nie, Ying; Han, Jing; Xiong, Jianwen; Xiao, Hua; Bao, Lei
Physical Review Physics Education Research, v15 n2 Article 020149 Jul-Dec 2019
In physics education research (PER), concept inventories (CIs) have become standard instruments for assessing students' learning throughout instruction. To promote widespread use of concept inventories, previous studies have developed an approach to split a full length CI into short versions of CIs. This research extends the existing method to fully utilize the item response theory framework in equating and linking between the short CIs and the full length CIs. Three quantitative studies have been conducted: First, the extended algorithm is applied to divide the Brief Electricity and Magnetism Assessment (BEMA) into two half-length BEMAs (HBEMAs). Through a series of test-equating and validation analysis, the HBEMAs are confirmed to measure the same latent constructs of student understanding of electricity and magnetism to that of the original BEMA at a similar level of reliability. The second study establishes equivalent score conversions among the three versions of BEMA using the Stocking-Lord method, which has the best performance on equating error reduction among several methods explored. It is also confirmed that the equivalent statistical characteristics of the three versions of BEMA are equity and population invariant. In the third study, the extended algorithm is applied to link and compare the BEMA and the Conceptual Survey of Electricity and Magnetism (CSEM). After linking the BEMA and CSEM assessment scales, it becomes possible to directly convert and compare students' performances on the two CIs. It is found that the scales of BEMA and CSEM are almost identical after scale transformation. Based on these studies, it can be suggested that all short and long versions of BEMA and CSEM can be used interchangeably after scale transformation.
Descriptors: Physics, Science Instruction, Energy, Magnets, Item Response Theory, Student Evaluation, Scientific Concepts, Evaluation Methods, Scores, Test Validity, Test Construction, College Students, High School Students, Foreign Countries, Test Reliability
American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: http://prst-per.aps.org
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education; High Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Identifiers - Location: United States; China
Grant or Contract Numbers: DUE1712238