The same L2 speaking performance may be analysed and evaluated in very different ways by different teachers or raters. We present a new, technology-assisted research design which opens up to investigation the trajectories of convergence and divergence between raters. We tracked and recorded what different raters noticed when, whilst grading a…

Multilingual children represent a rapidly growing population of students in U.S. schools. However, identification of language and learning disabilities for students from different linguistic backgrounds is complex, leading to frequent misidentification of multilingual learners for special education. This article provides guidance on how special…

Purpose: Spoken language sample analysis (LSA) is widely considered to be a critical component of assessment for child language disorders. It is our best window into a preschool child's everyday expressive communicative skills. However, historically, the process can be cumbersome, and reference values against which LSA findings can be…

Background: Children in India are among the lowest performing students on international reading comprehension and writing assessments. Oral language instruction may improve these literacy outcomes. Aim: This pilot study investigated whether a multi-tiered system of language support (MTSLS) improved oral narrative language comprehension, reading…

The extensive use of automated speech scoring in large-scale speaking assessment can be revolutionary not only to test design and rating, but also to the learning and instruction of speaking based on how students and teachers perceive and react to this technology. However, its washback remained underexplored. This mixed-method study aimed to…

The rating of proficiency tests that use the Inter-agency Roundtable (ILR) and American Council on the Teaching of Foreign Languages (ACTFL) guidelines claims that each major level is based on hierarchal linguistic functions that require mastery of multidimensional traits in such a way that each level subsumes the levels beneath it. These…

This study compared holistic and analytic marking methods for their effects on parameter estimation (of examinees, raters, and items) and rater cognition in assessing speech act production in L2 Chinese. Seventy American learners of Chinese completed an oral Discourse Completion Test assessing requests and refusals. Four first-language (L1)…

Despite an emphasis on oral communication in most foreign language classrooms, the resource-intensive nature (i.e. time and manpower) of speaking tests hinder regular oral assessments. A possible solution is the development of a (semi-) automated scoring system. When it is used in conjunction with human raters, the consistency of computers can…

Consideration of the influence of English language skills during testing is an understandable requirement for fair and valid cognitive test interpretation. Several professional standards and expert recommendations exist to guide psychologists as they attempt to engage in best practices when assessing English learners (ELs). Nonetheless, relatively…

As a branch of artificial intelligence, automated speech recognition (ASR) technology is increasingly used to detect speech, process it to text, and derive the meaning of natural language for various learning and assessment purposes. ASR inaccuracy may pose serious threats to valid score interpretations and fair score use for all when it is…

We advocate the in-depth integration of information technology and education in the digital age, and we also encourage teachers of all disciplines to actively carry out online and offline blended learning. This study attempts to use an empirical research to apply the Blended Learning to the oral English teaching in the first year of senior high…

This project aimed to describe oral narrative retells of Spanish-English speaking dual language learners (DLLs) and examine relationships with standardized vocabulary assessments. Investigators described oral narrative retells of 145 DLLs in kindergarten and first grade by number of different words (NDW), words per minute (WPM), and…

The "Clinical Evaluation of Language Fundamentals-Fifth Edition" (CELF-5; Wiig, Semel, & Secord, 2013) is a recently updated battery of tests designed to assess, diagnose, and measure changes in language and communication in individuals 5 to 21 years of age. Designed to identify language strengths and weaknesses, determine service…

We addressed Deville and Chalhoub-Deville's (2006), Schoonen's (2012), and Xi and Mollaun's (2006) call for research into the contextual features that are considered related to person-by-task interactions in the framework of generalizability theory in two ways. First, we quantitatively synthesized the generalizability studies to determine the…

Business, like many other fields in higher education, continues to rely largely on conventional testing methods for assessing student learning. In the current article, another evaluation approach--the oral exam--is examined as a means for building and evaluating the professional communication and oral dialogue skills needed and utilized by…