ERIC Number: EJ1383462
Record Type: Journal
Publication Date: 2023
Pages: 22
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1750-399X
EISSN: EISSN-1757-0417
Interrogating the Predictive Validity of Aptitude Testing for Interpreting: A Systematic Methodological Review
Interpreter and Translator Trainer, v17 n1 p7-28 2023
Aptitude testing is used to select candidates with the greatest potential for professional interpreter training. Implicit in this practice is the expectation that aptitude test scores predict future performance. As such, the predictive validity of score-based inferences and decisions constitutes an important rationale for aptitude testing. Although researchers have provided predictive validity evidence for different aptitudinal variables, very little research has examined the substantive meaning and robustness of such evidence. We therefore conducted this systematic review to investigate or interrogate the methodological rigour of quantitatively-based prospective cohort studies of aptitude for interpreting, focusing on the substantive meaning, psychometric soundness, and statistical analytic rigour underpinning their predictive validity evidence. Our meta-evaluation of 18 eligible studies, identified through a rigorous search and screening process, shows a diverse array of practices in the operationalisation, analysis, and reporting of aptitude tests, interpreting performance assessments, and related validity evidence. Main patterns include the collection of mostly single-site data (i.e., from a single institution), use of self-designed instruments for testing aptitude, and under-reporting of key information on measurement and statistical procedures. These findings could help researchers better interpret existing validity evidence and design future research on aptitude testing.
Descriptors: Predictive Validity, Aptitude Tests, Cohort Analysis, Research Reports, Translation, Second Languages, Language Processing, Psychometrics, Research Methodology, Validity, Language Aptitude
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Information Analyses; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A