Clearinghouses set standards of scientific quality to vet existing research to determine how "evidence-based" an intervention is. This paper examines 12 educational clearinghouses to describe their effectiveness criteria, to estimate how consistently[underlined] they rate the same program, and to probe why their judgments differ. All the…

Automated Essay Scoring (AES) tools aim to improve the efficiency and consistency of essay scoring by using machine learning algorithms. In the existing research work on this topic, most researchers agree that human-automated score agreement remains the benchmark for assessing the accuracy of machine-generated scores. To measure the performance of…

Rating scale development in the field of language assessment is often considered in dichotomous ways: It is assumed to be guided either by expert intuition or by drawing on performance data. Even though quite a few authors have argued that rating scale development is rarely so easily classifiable, this dyadic view has dominated language testing…

Argument-based validation requires test developers and researchers to specify what is entailed in test interpretation and use. Doing so has been shown to yield advantages (Chapelle, Enright, & Jamieson, 2010), but it also requires an analysis of how the concerns of language testers can be conceptualized in the terms used to construct a…

The aim of this article was to independently test the factor structure of the Early Childhood Environment Rating Scale, 3rd Edition (ECERS-3). Using a sample of 148 independent observations, Standard and Satorra--Bentler confirmatory factor analysis were used to determine if the ECERS-3 conformed to the structure published in its manual using a…

In this response to "Measuring Students' Writing Ability on a Computer Analytic Developmental Scale: An Exploratory Validity Study," the authors agree that assessments should seek parsimony in both theory and application wherever possible. Doing so allows maximal dissemination and implementation while minimizing costs. The Writing…

The Gilliam Autism Rating Scale-Third Edition (GARS-3) is a norm-referenced tool designed to screen for autism spectrum disorders (ASD) in individuals between the ages of 3 and 22 (Gilliam, 2014). The GARS-3 test kit consists of three different components and includes an "Examiner's Manual," summary/response forms (50), and the…

The American Council on the Teaching of Foreign Languages (ACTFL) oral proficiency interview -- computer (OPIc) testing system represents an ambitious effort in language assessment: Assessing oral proficiency in over a dozen languages, on the same scale, from virtually anywhere at any time. Especially for users in contexts where multiple foreign…

This article reviews a selected sample of 70 empirical studies in journal articles and doctoral dissertations on language assessment in China between 2011 and 2018. Following a brief introduction to the history and current state of language assessment in China, the article presents a critical review of language assessment research on six themes…

This article provides a description and review of the "Comprehensive Executive Function Inventory" (CEFI; Naglieri & Goldstein, 2013), published by Multi-Health Systems Inc. (MHS). It is a rating scale developed to measure a wide array of Executive Function (EF) abilities in individuals aged 5 through 18 years. Completed by a parent,…

The "Attention-Deficit/Hyperactivity Disorder Test-Second Edition" (ADHDT-2) is published through Pro-Ed in Austin, Texas. It was formally published in 2014, following critical revisions of the ADHDT, the reportedly popular initial version of this test that was published in 1995. The ADHDT-2 purports to act as a screener for individuals…

Children and youth with deficits in social competence present substantial challenges for schools, teachers, parents and peers. These challenges cut across disciplinary, instructional and interpersonal domains and they frequently create chaotic home, school and classroom environments. Schools are charged with teaching an increasingly diverse…

The Children's Psychological Processing Scale (CPPS), authored by Milton J. Dehn and published by Schoolhouse Educational Services in 2012, is a third-party rating scale that can be administered to teachers who are familiar with children ages 5 to 12. The measure is designed to identify psychological processing deficits in children who are…

This paper reviews a selected sample of 24 doctoral dissertations in language assessment (broadly defined), completed between 2006 and 2011 in Canadian universities. These dissertations fall into five thematic categories: 1) reliability, validity and factors affecting test performance; 2) washback (impact) and ethics; 3) raters, rating and rating…

In the Swedish educational system, teachers have the dual responsibility of assigning final grades and marking their own students' national tests. The Government has mandated the Swedish Schools Inspectorate to remark samples of the national tests to see if teacher marking can be trusted. Reports from this project have concluded that intermarker…