In order to ensure content validity by covering a broad range of content domains, the testing times of some educational large-scale assessments last up to a total of two hours or more. Performance decline over the course of taking the test has been extensively documented in the literature. It can occur due to increases in the numbers of: (a)…

How is it possible to create and continuously improve a quality learning environment for our students? We present our one-year course on engineering thermodynamics as a case study in which we investigate the learning environment based on a competency model from the students' perspective. Based on the analysis of our course structure and exam…

Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses.…

Panel attrition is a major problem in long-term panel studies. While the design of the German National Educational Panel Study adult survey--combining biannual competency tests with regular face-to-face interviews--is highly innovative, such a design could raise respondent burden and thus potentially increase panel attrition and nonresponse bias.…

Testwiseness may introduce construct-irrelevant variance to multiple-choice test scores. Presenting response options sequentially has been proposed as a potential solution to this problem. In an experimental validation, we determined the psychometric properties of a test based on the sequential presentation of response options. We created a strong…