Multiple-choice questions (MCQs) are widely used in digital learning systems, as they allow for automating the assessment process. However, owing to the increased digital literacy of students and the advent of social media platforms, MCQ tests are widely shared online, and teachers are continuously challenged to create new questions, which is an…

The testing effect refers to the gains in learning and retention that result from taking practice tests before the final test. Understanding the conditions under which practice tests improve learning is crucial, so four experiments were conducted with a total of 438 undergraduate students in Turkey. In the first study, students who took graded…

A common feature of many assessment plans is the use of multiple-choice questions. Although there are criticisms of multiple-choice questions, this assessment format is here to stay--multiple-choice questions are effective means of evaluation in large classes, central to many licensing and entry exams, used in most adaptive learning platforms, and…

The current study examined whether the learning benefits of pretesting--like those produced by posttesting--generalize to classroom settings, and whether such benefits transfer to non-pretested related information. Before some lectures but not others, undergraduate students enrolled in a large research methods class were given a brief competitive…

Two-stage testing (TST) involves individual testing followed by taking the same test in teams. Previously, Vogler and Robinson ("The Journal of Experimental Education," 84(4), 787-803, 2016) found that TST facilitated individual performance. The present study addressed methodological limitations in the Vogler and Robinson study in two…

Teachers often encourage students to use test-taking strategies during reading comprehension assessments, but these strategies are not always evidence-based. One common strategy involves teaching students to read the questions before reading an associated passage. Research findings comparing the passage-first (PF) and questions-first (QF)…

It is imperative to collect validity evidence prior to interpreting and using test scores. During the process of collecting validity evidence, test developers should consider whether test scores are contaminated by sources of extraneous information. This is referred to as construct irrelevant variance, or the "degree to which test scores are…

? frequently used indicator to reflect student performance is that of a test score. However, although tests are designed to assess students' knowledge or skills, other factors can also affect test results such as test-taking strategies. Therefore, the purpose of this study was to model the interrelationships among test-taking strategy instruction…

Preservice elementary teachers (PSTs) prepare for various standardized assessments, such as the Praxis® licensure assessment. However, there is little research on test-taking behavior and test-taking strategies for this examinee population. A common belief and instruction given in some test preparation materials is that examinees should stick to…

Cognitive psychologists have found that taking practice tests improves students' learning, and some claim that tests that require recall are more effective than those that require recognition. This study examined whether recognition (i.e., multiple-choice) quizzes were as effective as cued-recall (i.e., fill-in-the-blank) quizzes for improving…

Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses.…

A conceptualization of multiple-choice exams in terms of signal detection theory (SDT) leads to simple measures of item difficulty and item discrimination that are closely related to, but also distinct from, those used in classical item analysis (CIA). The theory defines a "true split," depending on whether or not examinees know an item,…

Reading comprehension tests involve not only reading passages and answering questions but also making choices such as the test-taking strategy to use, whether to search passages for answers, and where to begin searching. We examined the associations between student characteristics, passage type, test-taking strategies, and students' time searching…

Regulatory focus is a strong predictor for a person's behaviour in signal detection tasks. While a promotion focus is related to a risky response strategy (hits, false alarms), a prevention focus is associated with a conservative strategy (correct rejections, misses). The present research is based on the assumption that multiple-choice (MC)…

In second language listening assessment and pedagogy, practitioners hold different views on whether to repeat a listening text in contexts where inferences about listening ability are to be drawn from task performance. To address this issue, we investigated the effects of repeating the listening text (double play) on listener performance,…