ERIC Number: EJ1438070
Record Type: Journal
Publication Date: 2024
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2981-9954
An Exploratory Criterion Validation of Three Meaning-Recall Vocabulary Test Item Formats
Vocabulary Learning and Instruction, v13 n1 2024
In an upcoming coverage-comprehension study, we plan to assess learners' meaning-recall knowledge of words as they occur in the study's reading passage. As several meaning-recall test formats exist, the purpose of this small-scale study (N = 10) was to determine which of three formats was most similar to a criterion interview regarding mean score and the consistency of correct/incorrect classifications (match rate, k = 30). In Test 1, the prompt consisted of only the target item, and a written translation of its meaning was elicited. In Test 2, the prompt was a short sentence in which a target item was highlighted, and a written translation of only that target item was requested. In Test 3, the prompt was the same sentence as in Test 2, but the target item was unhighlighted, and participants were requested to translate the entire sentence. Finally, in the criterion interview, participants were asked to demonstrate their understanding of the target items in the same prompt sentences as in Tests 2-3. The results indicated that Test 3 produced a mean score and match rate most similar to the interview, followed by Test 2, with Test 1 being the least similar. The paper discusses several factors explaining differences in test performance that were explored during the interview.
Descriptors: Vocabulary Development, Language Tests, Second Language Learning, Classification, Translation, Cues, Test Items, Language Processing, Recall (Psychology), Test Format, Scores, Item Analysis, Phrase Structure, Japanese, Foreign Countries, Linguistic Borrowing, Interviews, Videoconferencing, Undergraduate Students, English (Second Language), Definitions
Castledown Publishers. Ground Level, 470 St Kilda Road, Melbourne, 3004, Australia. Tel: +61-3-7003-8355; e-mail: contact@castledown.com; Web site: https://www.castledown.com/journals/vli
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Japan (Tokyo)
Grant or Contract Numbers: N/A