In this paper, we analyse a large, opportunistic dataset of responses (N = 219,826) to online, diagnostic multiple-choice mathematics questions, provided by 6-16-year-old UK school mathematics students (N = 7302). For each response, students were invited to indicate on a 5-point Likert-type scale how confident they were that their response was…

The purpose of this investigation was to explore the importance of different meta-comprehension aspects in students with intellectual disabilities, and to determine which one of them can best explain their performance on reading comprehension. For this purpose, metacognitive measurement instruments, an inconsistency detection tasks, and confidence…

Multiple-choice-questions are common in medical examinations, but guessing biases assessment results. Confidence-based-testing (CBT) integrates indicated confidence levels. It has been suggested that correctness of and confidence in an answer together indicate knowledge levels thus determining the quality of a resulting decision. We used a CBT…

Traditional knowledge assessments rely on multiple-choice type questions that only report a right or wrong answer. The reliance within the education system on this technique infers that a student who provides a correct answer purely through guesswork possesses knowledge equivalent to a student who actually knows the correct answer. A more complete…

A single experiment is reported in which introductory psychology students were administered a multiple-choice test on psychology with either 4 (n = 78) or 5 alternatives (n = 92) prior to any lectures being delivered. Two answers were generated for each question: a small answer consisting of their favorite alternative, and a large answer…

The purpose of this study was to explore Pre-service Elementary Science Teachers' (PSTs) conceptual understanding of Particulate Nature of Matter (PNM) through a three-tier diagnostic test. Participants were 215 PSTs from Turkey. Data consisted of participants' responses to the Particulate Nature of Matter Test (PNMT). The PNMT consists of…

This study explored undergraduate students' understanding of the chemistry topic of thermodynamics using a 4-tier diagnostic instrument, comprising 30 questions, and follow-up interviews. An additional objective of the study was to assess the utility of the 4-tier instrument for use in studies on alternative conceptions (ACs) as there has been no…

We report results of two studies on metacognitive accuracy with undergraduate education students. Participating students were asked to judge their personal performance in a multiple-choice exam as well as to state their confidence in their performance judgement (second-order judgement [SOJ]). In each study, we compared four conditions that…

A total of 271 early childhood professionals completed pre- and post training knowledge assessments in True-False only (TF) or True-False with "unsure" option formats (TFU). In Study 1, only TFU format was used. In Study 2, participants were randomly assigned to TF or TFU formats. Responses which were initially "unsure" were…

This proposal presents the results of a case study involving five 8th grade Taiwanese classes, two mathematics and three science classes. These classes used a new method of testing called confidence wagering. This paper advocates the position that confidence wagering can predict the accuracy of a student's test answer selection during…

The misconceptions that students bring with them, or that arise during instruction, are a critical barrier to learning. Implicit-confidence tests, a simple modification of the multiple-choice test, can be used as a strategy for recognizing student misconceptions. An important issue, however, is whether such tests are gender-neutral. We analyzed…

On a multiple-choice test in which each item has k alternative responses, the test taker is permitted to choose any subset which he believes contains the one correct answer. A scoring system is devised. (Author/CTM)

Testing procedures which involve testees assigning probabilities of correctness to all multiple choice alternatives is examined. Two basic assumptions in these procedures are reviewed. Empirical examinee response data are examined and it is suggested that these assumptions should not be taken lightly in empirical studies of personal probability…

Undergraduate business students completed two multiple-choice tests: one in which they indicated their answer and one of three levels of confidence, and one in which they circled the item only when they possessed high confidence in the answer. The three-level test took longer to take and grade; students preferred the second format. Both types…

Compared a standard multiple choice exam format with two modified formats which provide instructors with information on students' risk preferences (students answer questions twice) and confidence in their answers (students assign a point value to questions). Found that while the alternatives offer increased choice to students and low-cost…