This work investigates how people make judgments about the content of their visual working memory (VWM). Some studies on long-term memory suggest that people base those metacognitive judgments on the outcome of a retrieval attempt. In contrast, Son and Metcalfe (2005) observed that people identify poorly remembered items immediately, presumably by…

This study adopted a quasi-experimental design with follow-up interview to develop a computer-based two-tier assessment (CBA) regarding the science topic of electric circuits and to evaluate the diagnostic power of the assessment. Three assessment formats (i.e., paper-and-pencil, static computer-based, and dynamic computer-based tests) using…

Traditional knowledge assessments rely on multiple-choice type questions that only report a right or wrong answer. The reliance within the education system on this technique infers that a student who provides a correct answer purely through guesswork possesses knowledge equivalent to a student who actually knows the correct answer. A more complete…

Although calibration has been widely studied, questions remain about how best to capture confidence ratings, how to calculate continuous variable calibration indices, and on what exactly students base their reported confidence ratings. Undergraduates in a research methods class completed a prior knowledge assessment, two sets of readings and…

A total of 271 early childhood professionals completed pre- and post training knowledge assessments in True-False only (TF) or True-False with "unsure" option formats (TFU). In Study 1, only TFU format was used. In Study 2, participants were randomly assigned to TF or TFU formats. Responses which were initially "unsure" were…

This proposal presents the results of a case study involving five 8th grade Taiwanese classes, two mathematics and three science classes. These classes used a new method of testing called confidence wagering. This paper advocates the position that confidence wagering can predict the accuracy of a student's test answer selection during…

The purpose of this study was to examine whether the efficiency, precision, and validity of computerized adaptive testing (CAT) could be improved by assessing confidence differences in knowledge that examinees possessed. We proposed a novel polytomous CAT model called the confidence-weighting computerized adaptive testing (CWCAT), which combined a…

Testing procedures which involve testees assigning probabilities of correctness to all multiple choice alternatives is examined. Two basic assumptions in these procedures are reviewed. Empirical examinee response data are examined and it is suggested that these assumptions should not be taken lightly in empirical studies of personal probability…

The purpose of this article is to discuss some recent developments in the scoring of multiple-choice items from two angles. The first consists of the recent developments in the test instructions of the conventional scoring procedures, and the second consists of a discussion of new scoring methods and formulas. (Author)

In an experiment using single-word items, subjects are run under three different speed-accuracy trade-off conditions. A competition model would predict that when subjects are forced to respond quickly, there will be an increase in errors, and these will be from recent past items. The prediction was confirmed. (CHK)

Investigates the circumstances under which answer changing is beneficial or detrimental to test performance. Analyzes the success of answer changing in relation to the reasons offered for changing. Concludes that students who reported guessing as their reason for changing answers were not nearly as likely to benefit from changing as were students…

Study was designed to provide some indication as to whether the gain in test reliability from confidence scoring results from relevant or irrelevant sources. If the increase in reliability is the result of a gambling response style, it is conceivable that validity could actually decrease even though reliability is increased. (Authors/CB)

This paper presents the development of scoring functions for use in conjunction with standard multiple-choice items. In addition to the usual indication of the correct alternative, the examinee is to indicate his personal probability of the correctness of his response. Both linear and quadratic polynomial scoring functions are examined for…

One formulation of confidence scoring requires the examinee to indicate as a number his personal probability of the correctness of each alternative in a multiple-choice test. For this formulation a linear transformation of the logarithm of the correct response is maximized if the examinee accurately reports his personal probability. To equate…