Effects of logically weighting incorrect item options in conventional tests and different scoring functions with confidence tests on reliability and validity were examined. Ninth graders took conventionally administered Verbal and Mathematical Reasoning tests, scored conventionally and by a procedure assigning degree-of-correctness weights to…

A comparison of reliability and validity was made for three testing procedures: 1) responding conventionally to Verbal Ability and Mathematical Reasoning tests; 2) using a confidence weighting response procedure with the same tests; and 3) using the elimination response method. The experimental testing procedures were not psychometrically superior…

On the basis of past research efforts to improve multiple-choice test information through differential weighting of responses to wrong answers (distractors), two statistical indices are developed. Each describes the properties of response distributions across the options of an item. Jaspen's polyserial generalization of the biserial correlation…

Undergraduate students took a multiple choice, computer assisted test and received feedback (items with the correct answers identified) either: (1) immediately, item-by-item; (2) following the entire test; (3) 24 hours later; or (4) no feedback. Retention one to three weeks later was significantly better for delayed feedback, and confidence…

This study of individual differences in performance of a geometric analogies task included four-alternative test items and studied eye movements and confidence judgments as well as latency and error. Results were interpreted using two hypothesized performance strategies: constructive matching and response elimination. (Author/BW)

Medical and dental students were administered two short confidence-scored tests on cellular and molecular biology. Increases in test reliability and predictive validity were found when test scores were adjusted for realism, but were not statistically significant. (Author/MH)

Presents a discussion of trying to best account for the variation resulting from guessing on a multiple-choice exam. A mathematical process is given to determine the amount of variance that could be added or subtracted from a student's score to account for guessing. Examples are provided. (MVL)

This experiment was designed to test the effect of immediate and delayed feedback on retention of learning in an educational situation. Four groups of college undergraduates took a multiple-choice computer-managed test. Three of these groups received informative feedback (the entire item with the correct answer identified) either: (1) immediately…

Confidence testing has been used in varying forms over the past 40 years as a method for increasing the amount of information available from objective test items. This paper traces the development of the procedure from Hevner's beginning method up to the various methods in use today and describes both the testing procedures and scoring methods…

Various aspects of Confidence Weighting are examined. Variant of Confidence Weighting, its effect on test reliability, and the validity of Confidence Weighting are discussed. (DG)

This study investigates whether the practice of answer changing on multiple-choice questions (MCQs) is beneficial to Gulf Arab students' overall test performance. The proficiency exam used in this study is the Michigan English Language Institute College English Test - Grammar, Cloze, Vocabulary, Reading (MELICET-GCVR), which was developed using…

Individual and group assessments of quiz accuracy and students' discrimination of what they know and what they do not know regarding course material were examined using confidence ratings from 22 graduate students, 47 undergraduates, and their 23 heterogeneous learning groups over 6 quizzes. Students first took each multiple choice quiz as…

In this study, the authors investigated the role of overconfidence on students' performance on multiple-choice examinations. The authors examined the difference between students' self-assessed probability of selecting each correct answer and the proportion of correct answers that they actually selected. Results show that high-performing students…

This brief review explains some alternate scoring procedures to the classical method of summing correct responses. The novel procedures attempt in some way to retrieve and use even the information in the wrong responses. (Author)

A student's choice of an answer to a test question is a coarse measure of his knowledge about the subject matter of the question. Much finer measurement might be achieved if the student were asked to estimate, for each possible answer, the probability that it is the correct one. Such a procedure could yield two classes of benefits: (a) students…