This document describes the following two new student engagement metrics now included on NWEA™ MAP® Growth™ reports, and provides guidance on how to interpret and use these metrics: (1) Percent of Disengaged Responses; and (2) Estimated Impact of Disengagement on RIT. These metrics will inform educators about what percentage of items from a…

As computer-based tests become more common, there is a growing wealth of metadata related to examinees' response processes, which include solution strategies, concentration, and operating speed. One common type of metadata is item response time. While response times have been used extensively to improve estimates of achievement, little work…

Previewing answer-choice options before finishing reading the text is a widely employed test-taking behavior. In the present study we examined whether previewing is related to item response accuracy and response time, using data from Chinese learners of varying English proficiency levels and English native speakers. We examined eye movement…

Many standardized tests are now administered via computer rather than paper-and-pencil format. In a computer-based testing environment, it is possible to record not only the test taker's response to each question (item) but also the amount of time spent by the test taker in considering and answering each item. Response times (RTs) provide…

Purpose: The purpose of this study was to investigate whether previously reported parental questionnaire-based differences in inhibitory control (IC; Eggers, De Nil, & Van den Bergh, 2010) would be supported by direct measurement of IC using a computer task. Method: Participants were 30 children who stutter (CWS; mean age = 7;05 years) and 30…

In this study, we investigated how empirical indicators of test-taking engagement can be defined, empirically validated, and used to describe group differences in the context of the Programme of International Assessment of Adult Competences (PIAAC). The approach was to distinguish between disengaged and engaged response behavior by means of…

Test accommodations for English learners (ELs) are intended to reduce the language barrier and level the playing field, allowing ELs to better demonstrate their true proficiencies. Computer-based accommodations for ELs show promising results for leveling that field while also providing us with additional data to more closely investigate the…

Background: Large-scale survey assessments have been used for decades to monitor what students know and can do. Such assessments aim at providing group-level scores for various populations, with little or no consequence to individual students for their test performance. Students' test-taking behaviors in survey assessments, particularly the level…

Previous studies have suggested that younger preschoolers exhibit a yes bias due to underdeveloped cognitive abilities, whereas older preschoolers exhibit a response bias due to other factors. To test this hypothesis, we investigated the response latency to yes-no questions pertaining to familiar and unfamiliar objects in 3- to 6-year-olds. The…

We propose and evaluate a memory-based model of Hick's law, the approximately linear increase in choice reaction time with the logarithm of set size (the number of stimulus-response alternatives). According to the model, Hick's law reflects a combination of associative interference during retrieval from declarative memory and occasional savings…

An examinee faced with a test item will engage in solution behavior or rapid-guessing behavior. These qualitatively different test-taking behaviors bias parameter estimates for item response models that do not control for such behavior. A mixture Rasch model with item response time components was proposed and evaluated through application to real…

To understand how task switching affects human performance, there is a need to investigate how it influences the performance of tasks other than those involving bivalent stimulus categorization. The purpose of this study, therefore, was to investigate the effects of task switching on anticipation timing performance, which typically requires…

To study action monitoring in anorexia nervosa, behavioral and EEG measures were obtained in underweight anorexia nervosa patients (n=17) and matched healthy controls (n=19) while performing a speeded choice-reaction task. Our main measures of interest were questionnaire outcomes, reaction times, error rates, and the error-related negativity ERP…

A series of 8 tests was administered to university students over 4 weeks for program assessment purposes. The stakes of these tests were low for students; they received course points based on test completion, not test performance. Tests were administered in a counterbalanced order across 2 administrations. Response time effort, a measure of the…

In this study four methods were compared for setting a response time threshold that differentiates rapid-guessing behavior from solution behavior when examinees are obliged to complete a low-stakes test. The four methods examined were: (1) a fixed threshold for all test items; (2) thresholds based on item surface features such as the amount of…