In order to address the needs of the continually growing number of Chinese language learners, the present study developed and presented initial validation of a 100-item Chinese vocabulary proficiency test (CVPT) for learners of Chinese as a second/foreign language (CS/FL) using Item Response Theory among 170 CS/FL learners from Indonesia and 354…

"Tests of Aptitude for Language Learning" (TALL) is an openly accessible internet-based battery to measure the multifaceted construct of foreign language aptitude, using language domain-specific instruments and L1-sensitive instructions and stimuli. This brief report introduces the components of this theory-informed battery and…

The focus of this article is on the design and administration of an online computerized dynamic assessment of an important area of pragmatics: implicature comprehension (i.e., indirect meaning). The assessment centered on indirect acceptances, refusals, and opinions. Drawing on Vygotskian psychology, this assessment had a dual aim: (a) to evaluate…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

This dissertation study explored the feasibility of using authenticated spoken texts to test L2 Chinese listening comprehension. The spoken texts used in the study were created using an "authenticating" technique, in which scripted spoken Chinese texts were infused with characteristics of real-world, unscripted spoken Chinese. In the…

A teacher's assessment literacy refers to her or his demonstrated understanding of the principles behind selecting and designing tasks, judging student work, and interpreting and using assessment data to support student learning. This study examines the development of the task design aspect of assessment literacy in 12 Chinese language teachers as…

This article presents evidence for a validity argument on the ACTFL Assessment of Performance Toward Proficiency in Languages (AAPPL) tests (Interpersonal Listening/Speaking, Presentational Writing, Interpretive Listening, and Interpretive Reading) by summarizing an analysis of the 2014 test data from examinations administered in three languages…

The validation of ability scales describing multidimensional skills is always challenging, but not impossible. This study applies a multistage, criterion-referenced approach that uses a framework of aligned texts and reading tasks to explore the validity of the ACTFL and related reading proficiency guidelines. Rasch measurement and statistical…

Essay marking is a subjective intellectual exercise in which the score reliability can be influenced by many factors such as the test design, the marker's interpretation of the marking criteria, the procedure, and the method used in the marking process. After conducting a literature review this study investigated the reliability of essay marking…

Discusses the development and use of a computer-adaptive test (CAT) for learners of Chinese. Each time the examinee answers a question, the CAT program registers the answer and, based on the examinee's response, decides whether the next question should be harder or easier. (23 references) (MDM)

A test to be used for placement of students at the University of Texas (UT), Austin, in lower-level courses in Chinese and to award credit-by-examination in some courses was developed, and its validity was tested. Faculty members from the Department of Oriental and African Studies and the Measurement and Evaluation Center of the UT constructed a…

This report describes the development, construction, and validation of the Preliminary Chinese Proficiency Test (Pre-CPT), a standardized, nationally-normed test of listening and reading comprehension for beginning-level native English-speaking learners of Chinese as a second language. The Pre-CPT was designed as a lower-level version of the…

Problems in the testing of Chinese as a foreign language (CFL) are examined, focusing on proficiency testing needs and test standardization. Particular attention is paid to listening and reading assessment. The first part of the discussion looks at specific problems with five existing proficiency tests, including such aspects as inadequacy of the…

A project to develop and validate a tape-based alternative to the interview-based speaking proficiency test is described. The objective was to produce an economically more viable test for less commonly taught languages, closely modeled on and readily interpretable in terms of the American Council on the Teaching of Foreign Languages/Interagency…

This handbook resulted from a project to develop a tape-based alternative test of language proficiency in less commonly taught languages. The objective was to produce a test that is modeled on and readily interpretable by the American Council on the Teaching of Foreign Languages/Interagency Language Roundtable (ACTFL/ILR) proficiency guidelines…