Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses.…

In high-stakes, large-scale, standardized tests with certain time limits, examinees are likely to engage in either one of the three types of behavior (e.g., van der Linden & Guo, 2008; Wang & Xu, 2015): solution behavior, rapid guessing behavior, and cheating behavior. Oftentimes examinees do not always solve all items due to various…

In this study, we assessed the invariance in the factor structure underlying English-language proficiency for two groups of adolescent learners in Japan: students in middle school (ages 13-15 years) and students in high school (ages 16-18 years). Language proficiency was measured using the "TOEFL Junior"® Comprehensive test, an…

Diagnostic classification models (DCMs) classify examinees based on the skills they have mastered given their test performance. This classification enables targeted feedback that can inform remedial instruction. Unfortunately, applications of DCMs have been criticized (e.g., no validity support). Generally, these evaluations have been brief and…

As the number, date and form of the written tests are structured and teacher-oriented, it is considered that it creates fear and anxiety among the students. It has been found necessary and important to form a testing model which will keep the students away from the test anxiety and allows them to learn only about the lesson. For this study,…

Background: A potential problem of low-stakes large-scale assessments such as the Programme for the International Assessment of Adult Competencies (PIAAC) is low test-taking engagement. The present study pursued two goals in order to better understand conditioning factors of test-taking disengagement: First, a model-based approach was used to…

Sometimes, test-takers may not be able to attempt all items to the best of their ability (with full effort) due to personal factors (e.g., low motivation) or testing conditions (e.g., time limit), resulting in poor performances on certain items, especially those located toward the end of a test. Standard item response theory (IRT) models fail to…

This study examined the empirical differences between the tendency to omit items and reading ability by applying tree-based item response (IRTree) models to the Japanese data of the Programme for International Student Assessment (PISA) held in 2009. For this purpose, existing IRTree models were expanded to contain predictors and to handle…

Comprehension of geologic time does not come easily, especially for students who are studying the earth sciences for the first time. This project investigated the potential success of two teaching interventions that were designed to help non-science majors enrolled in an introductory geology class gain a richer conceptual understanding of the…

The document is from a presentation at the Texas Region VII 2014 Curriculum Conference. The study examined the effects of a three-tiered high school program designed to increase student achievement and Texas end-of-course (EOC) TAKS and STAAR chemistry scores. The student sample (n = 625) consisted 75% high school sophomores and 25% high school…

According to theories of students' test preparation, students may optimize their test performance by paying special attention to important information and processing this information in ways that are appropriate to the type of questions included in the forthcoming test. However, research is unclear about the conditions under which students adapt…

According to the recent Nation's Report Card, 12th-graders failed to produce gains on the 2005 National Assessment of Educational Progress (NAEP) despite earning better grades on average. One possible explanation is that 12th-graders were not motivated taking the NAEP, which is a low-stakes test. We develop three Bayesian IRT mixture models to…

Thirty-six test-wise and 41 test-naive high school seniors completed a 14-item test designed to assess their abilities to apply selected test-wiseness principles. Results indicate that, before students can profitably apply test-wise skills, they must first possess knowledge about the content of the stem or options. (Author/KS)

This study examined the effectiveness of PLAE (Preplan List, Activate, and Evaluate) in training students to have executive control over their learning strategies. Subjects, 56 at-risk students enrolled in four separate sections of an upper-level study strategies course at a major southern university, received intensive, direct instruction in…

Discusses career development needs of gifted and talented in three areas: psycho-social, skill development (study skills, decision-making skills, and test-taking skills), and life career planning. Also examines a comprehensive model of career education for the gifted. (CT)