In order to ensure content validity by covering a broad range of content domains, the testing times of some educational large-scale assessments last up to a total of two hours or more. Performance decline over the course of taking the test has been extensively documented in the literature. It can occur due to increases in the numbers of: (a)…

How is it possible to create and continuously improve a quality learning environment for our students? We present our one-year course on engineering thermodynamics as a case study in which we investigate the learning environment based on a competency model from the students' perspective. Based on the analysis of our course structure and exam…

Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses.…

Panel attrition is a major problem in long-term panel studies. While the design of the German National Educational Panel Study adult survey--combining biannual competency tests with regular face-to-face interviews--is highly innovative, such a design could raise respondent burden and thus potentially increase panel attrition and nonresponse bias.…

Low stakes assessment without grading the performance of students in educational systems has received increasing attention in recent years. It is used in formative assessments to guide the learning process as well as in large-scales assessments to monitor educational programs. Yet, such assessments suffer from high variation in students'…

Testwiseness may introduce construct-irrelevant variance to multiple-choice test scores. Presenting response options sequentially has been proposed as a potential solution to this problem. In an experimental validation, we determined the psychometric properties of a test based on the sequential presentation of response options. We created a strong…

In 2015, the "Programme for International Student Assessment" (PISA) introduced multiple changes in its study design, the most extensive being the transition from paper- to computer-based assessment. We investigated the differences between German students' text responses to eight reading items from the paper-based study in 2012 to text…

Since the turn of the century, an increasing number of low-stakes assessments (i.e., assessments without direct consequences for the test-takers) are being used to evaluate the quality of educational systems. Internationally, research has shown that low-stakes test results can be biased due to students' low test-taking motivation and that…

We investigated processes underlying performance decrements of highly test-anxious persons. Three experiments contrasted conditions that differed in the degree of activation of concepts related to failure. Participants memorized a list of words either containing words related to failure or containing no words related to failure in Experiment 1. In…

If children fail to understand test instructions, measurements of their competence may be unfair and invalid. This is especially relevant for students with special educational needs (SEN) because they face greater challenges in comprehending instructions. Two interventions were designed to facilitate the comprehension of test requirements by…

The use of computer-based assessments makes the collection of detailed data that capture examinees' progress in the tests and time spent on individual actions possible. This article presents a study using process and timing data to aid understanding of an international language assessment and the examinees. Issues regarding test-taking strategies,…

Language testing means taking decisions: about the test taker's results, but also about the test construct and the measures taken in order to ensure quality. This article takes the German test "telc Deutsch C1 Hochschule" as an example to illustrate this decision-making process in an academic context. The test is used for university…

During oral exams at the German distance learning university, we noticed that students fear that they will be faced with questions that they have not anticipated. In our opinion, this is mainly because students have no chance to train and thereby gather positive experiences with exam situations as they are distributed all over Germany and thus it…