ERIC Number: EJ1374960
Record Type: Journal
Publication Date: 2023-May
Pages: 24
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0008-4506
EISSN: EISSN-1710-1131
Evaluating the Explanation Inference of a High-Stakes French Listening Test: An Argument-Based Perspective
Arias, Angel; Blais, Jean-Guy
Canadian Modern Language Review, v79 n2 p77-100 May 2023
This article draws on argument-based validation to gather and evaluate construct-related evidence (i.e., the explanation inference) of a high-stakes test. The data stemmed from the listening component of a French test used for immigration to Canada through the province of Quebec. An expert panel with varied backgrounds in applied linguistics reviewed and associated the items of two operational test forms to four listening comprehension sub-skills identified in selected sources of second language listening theory. Based on the expert panel recommendations, two confirmatory factor models were fit to examinees' response data. The models fit the data well, providing backing for the explanation inference but suggesting construct under-representation for one of the test forms examined. The argument-based approach to validation yielded principled guidelines to evaluate construct coverage of the test across forms, providing insightful guidance on how to organize construct evidence from an argumentation perspective. Implications are discussed as they relate to the operationalization of argument-based validation in high-stakes settings.
Descriptors: French, Listening Comprehension Tests, Second Language Learning, High Stakes Tests, Construct Validity, Immigration, Immigrants, Applied Linguistics, Specialists, Linguistic Theory, Factor Analysis, Goodness of Fit, Test Format, Test Validity, Foreign Countries, Evidence
University of Toronto Press. 5201 Dufferin Street, Toronto, ON M3H 5T8, Canada. Tel: 416-667-7810; Fax: 800-221-9985; Fax: 416-667-7881; e-mail: journals@utpress.utoronco.ca; Web site: http://www.utpjournals.press/loi/cmlr
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Canada
Grant or Contract Numbers: N/A