Functional Behavior Assessment (FBA) and behavior interventions have been effective in the management of challenging behavior among children with developmental disabilities including autism spectrum disorders. Research suggests the need for valid measurement instruments for verifying, calibrating and scoring competence in FBA and behavior…

This article explores the efficacy of specifications grading in undergraduate political science classes. Specifications grading organizes instruction around a set of learning objectives and evaluates student success based on the achievement of carefully articulated specifications for each assessment. Assessments are considered satisfactory or…

Data collected from surveys can result in hundreds of variables and thousands of respondents. This implies that time and energy must be devoted to (a) carefully entering the data into a database, (b) running preliminary analyses to identify any problems (e.g., missing data, potential outliers), (c) checking the reliability and validity of the…

Ultimately, measures in research, testing, assessment and evaluation are used, or have implications, for ranking, intervention, feedback, decision-making or policy purposes. Explicit recognition of this fact brings the often-ignored and sometimes maligned concept of consequences to the fore. Given that measures have personal and social…

This brief paper introduces a new approach to assessing the trustworthiness of research comparisons when expressed numerically. The 'number needed to disturb' a research finding would be the number of counterfactual values that can be added to the smallest arm of any comparison before the difference or 'effect' size disappears, minus the number of…

For decades, academia has been hampered by what appears to be preference for opacity and obfuscation. In an article published in this magazine three years ago, "The Vocabularies of Higher Education" (Gaston, 2014), the author lamented the welter of terms and acronyms that has accumulated over many decades, particularly within the current…

Test security is not an end in itself; it is important because we want to be able to make valid interpretations from test scores. In this article, I propose a framework for comprehensive test security systems: prevention, detection, investigation, and resolution. The article discusses threats to test security, roles and responsibilities, rigorous…

This article covers the origins, growth, rationale, calibration, and inspiration of an international pool of certified Quality Matters™ (QM) Peer Reviewers. From the beginning in 2003, as a U.S. Department of Education, Fund for the Improvement of Postsecondary Education funded project, QM was developed as a faculty-centered, peer-based approach…

Programmatic assessment is both a philosophy and a method for assessment. It has been developed in medical education as a response to the limitation of the dominant testing or measurement approaches and to better align with changes in how medical competence was conceptualised. It is based on continual collection of assessment and feedback…

N signifies the number of data samples in a study. Traditional research values numerous data samples as this reduces the variability created by extremes. Alternatively, arts-based research privileges the outlier, the N of 1. Oftentimes, what is unique and outside the norm is the focus. There are three approaches to the N of 1 in arts-based…

In Gargani and Strong (2014), we describe The Rapid Assessment of Teacher Effectiveness (RATE), a new teacher evaluation instrument. Our account of the validation research associated with RATE inspired a review by Good and Lavigne (2015). Here, we reply to the main points of their review. We elaborate on the validity, reliability, theoretical…

Background: School attainment tests and Cognitive Abilities Tests are used in the United Kingdom to set targets for educational outcome. Whilst these are good predictors, they depend not only on basic ability but also on learnt knowledge and skills, such as reading. Method and Aims: VESPARCH is an online group test of verbal and spatial reasoning,…

Over the last five years, the U.S. Department of Education (USED) is requiring states to provide more and better evidence supporting the quality and validity of their assessment and accountability systems. Notably, states are asked to explain more fully how the proposed design of their systems will provide accurate and reliable information that…

In Winter 2021-2022, the Nebraska Student-Centered Assessment System (NSCAS) assessments are administered in ELA and mathematics in Grades 3-8. In Spring 2021-2022, the NSCAS assessments are administered in English language arts (ELA) and mathematics in Grades 3-8 and in science in Grades 5 and 8. The purposes of the NSCAS assessments are to…

This brief identifies the similarities and differences in the quality of education management information systems across the Federated States of Micronesia, which includes the four states of Chuuk, Kosrae, Pohnpei, and Yap. During focus group sessions that explored the methods and processes used to collect, analyze, report on, and disseminate…