Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses.…

In this study, we assessed the invariance in the factor structure underlying English-language proficiency for two groups of adolescent learners in Japan: students in middle school (ages 13-15 years) and students in high school (ages 16-18 years). Language proficiency was measured using the "TOEFL Junior"® Comprehensive test, an…

This study examined the utility of response time-based analyses in understanding the behavior of unmotivated test takers. For the data from an adaptive achievement test, patterns of observed rapid-guessing behavior and item response accuracy were compared to the behavior expected under several types of models that have been proposed to represent…

Diagnostic classification models (DCMs) classify examinees based on the skills they have mastered given their test performance. This classification enables targeted feedback that can inform remedial instruction. Unfortunately, applications of DCMs have been criticized (e.g., no validity support). Generally, these evaluations have been brief and…

This article reports on two presentations from the TCCRISLS 2014 which address a newly emerging area of inquiry--the interface between (LOA) and large-scale summative assessments. The surveyed papers propose that LOA should be introduced into summative testing to help test-takers to demonstrate their best performance. This article also makes links…

As the number, date and form of the written tests are structured and teacher-oriented, it is considered that it creates fear and anxiety among the students. It has been found necessary and important to form a testing model which will keep the students away from the test anxiety and allows them to learn only about the lesson. For this study,…

Background: A potential problem of low-stakes large-scale assessments such as the Programme for the International Assessment of Adult Competencies (PIAAC) is low test-taking engagement. The present study pursued two goals in order to better understand conditioning factors of test-taking disengagement: First, a model-based approach was used to…

Sometimes, test-takers may not be able to attempt all items to the best of their ability (with full effort) due to personal factors (e.g., low motivation) or testing conditions (e.g., time limit), resulting in poor performances on certain items, especially those located toward the end of a test. Standard item response theory (IRT) models fail to…

This study examined the empirical differences between the tendency to omit items and reading ability by applying tree-based item response (IRTree) models to the Japanese data of the Programme for International Student Assessment (PISA) held in 2009. For this purpose, existing IRTree models were expanded to contain predictors and to handle…

The first step in teaching-to-understand economics is not teaching "the rules," but working with fundamental economic models from the outset. Many of the concepts in economics are illustrated through models. Students must: (1) be able to draw these models; (2) understand the assumptions of the models; and (3) use the models for analysis.…

Comprehension of geologic time does not come easily, especially for students who are studying the earth sciences for the first time. This project investigated the potential success of two teaching interventions that were designed to help non-science majors enrolled in an introductory geology class gain a richer conceptual understanding of the…

Developing countries such as Malaysia and Oman have recently established occupational standards based on core work processes (functional clusters of work objects, activities and performance requirements), to which competencies (performance determinants) can be linked. While the development of work-process-based occupational standards is supposed…

Test equating under the NEAT design is, at best, a necessary evil. At bottom, the procedure aims to reach a conclusion on what a tested person would have done, if he or she were administered a set of items that were in fact never administered. It is not possible to infer such a conclusion from the data, because one simply has not made the required…

This article presents a model of collaboration between a state child welfare licensing division and a public university to develop and administer online examinations for persons seeking licensure as administrators of residential child care facilities or child placing agencies. The exams assess knowledge of state standards and various practice…

The strengths and weaknesses of Neuro-Linguistic Programming (NLP) are described with reference to its origins, previous research and comments from critics and supporters. A case is made for this allegedly theoretical approach to provide the kind of outcomes focused intervention that psychology and psychologists can offer to schools. In…