ERIC Number: EJ1399788
Record Type: Journal
Publication Date: 2023
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1362-1688
EISSN: EISSN-1477-0954
Adapting Multiple-Choice Comprehension Question Formats in a Test of Second Language Listening Comprehension
Language Teaching Research, v27 n6 p1431-1455 2023
The current study explores the impact of varying multiple-choice question preview and presentation formats in a test of second language listening proficiency targeting different levels of text comprehension. In a between-participant design, participants completed a 30-item test of listening comprehension featuring implicit and explicit information comprehension questions under one of four multiple-choice question preview and presentation conditions. Interactions between preview, presentation and comprehension in the participants' test scores were analysed using many facet Rasch analysis. The results suggest that the measurement of participants' listening ability was directly influenced by the presentation of multiple-choice questions. Test scores were highest when participants were able to preview the multiple-choice question stems before the sound file and listened to the options after the text had completed. However, interactions between preview and presentation conditions and comprehension level were only statistically significant in an analysis of the low scoring students' item responses, which were more frequently correct when preview of item stems was available for questions targeting comprehension of implicit information. The research underscores the importance of accounting for test design when making inferences about language learners' listening ability and will be of interest to teachers, practitioners and researchers developing listening assessment tasks.
Descriptors: Language Tests, Multiple Choice Tests, Scores, Second Language Learning, Second Language Instruction, Language Proficiency, Listening Comprehension Tests, Listening Comprehension, Test Preparation, Test Items, Correlation, Test Format, Test Construction, Inferences, English (Second Language), Undergraduate Students, College Preparation, Foreign Countries
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://bibliotheek.ehb.be:2993
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Turkey
Grant or Contract Numbers: N/A