Traditional knowledge assessments rely on multiple-choice type questions that only report a right or wrong answer. The reliance within the education system on this technique infers that a student who provides a correct answer purely through guesswork possesses knowledge equivalent to a student who actually knows the correct answer. A more complete…

On a multiple-choice test in which each item has k alternative responses, the test taker is permitted to choose any subset which he believes contains the one correct answer. A scoring system is devised. (Author/CTM)

Undergraduate business students completed two multiple-choice tests: one in which they indicated their answer and one of three levels of confidence, and one in which they circled the item only when they possessed high confidence in the answer. The three-level test took longer to take and grade; students preferred the second format. Both types…

Describes confidence testing methods (confidence weighting, probabilistic marking, multiple alternative selection) as alternative to computer-based, multiple choice tests and explains potential benefits (increased reliability, improved examinee evaluation of alternatives, extended diagnostic information and remediation prescriptions, happier…

Confidence scored tests allow subjects to respond to the options on a multiple choice test by assigning probabilities to each of the item options. This paper describes an interactive FORTRAN computer program used for administering, scoring, and interpreting the results of confidence scored tests. (Author/JKS)

One formulation of confidence scoring requires the examinee to indicate as a number his personal probability of the correctness of each alternative in a multiple-choice test. For this formulation a linear transformation of the logarithm of the correct response is maximized if the examinee accurately reports his personal probability. To equate…

Binary, probability, and ordinal scoring procedures for multiple-choice items were examined. In two situations, it was found that both the probability and ordinal scoring systems were more reliable than the binary scoring method. (Author/CTM)

The present study was an attempt to alleviate some of the difficulties inherent in multiple-choice items by having examinees respond to multiple-choice items in a probabilistic manner. Using this format, examinees are able to respond to each alternative and to provide indications of any partial knowledge they may possess concerning the item. The…

The effects of incentive conditions on the results of a confidence test were investigated. Two hundred thirty high school subjects were administered a very difficult confidence scored test under two conditions: 1) that the test would count heavily on their grades (incentive condition) and 2) that the test was for research purposes and would not be…

Multiple-choice testing (MCT) has several advantages which are becoming more relevant in the current financial climate. In particular, they can be machine marked. As an objective testing method it is particularly relevant to engineering and other factual courses, but MCTs are not widely used in engineering because students can benefit from…

Probabilistic testing involves having the examinee assign probabilities to each of the options of a multiple-choice item. These probabilities reflect the student's perception of the correctness of each option. What is presented in the paper is a rationale for probability testing, the current theoretical and empirical findings, and some suggested…

Discussion of how computer technology can be integrated into elementary school instruction focuses on evaluating student learning through test scoring. Highlights include descriptions of a computer-based instructional delivery system, modified confidence weighted admissible probability measurement (MCW-APM), and computer-managed instructional…

This handbook presents instructions for implementing a confidence testing program in technical training situations, identification of possible areas of application, techniques for evaluating confidence information, advantages and disadvantages of confidence testing, time considerations, and problem areas. Complete instructions for "Pick-One" and…

This study examined multiple choice testing for formative and summative evaluation among sixth-grade inner-city students (N=568) who were assessed simultaneously, with forced choice and information based (confidence weighted) test scoring formats. Results are discussed, with emphasis on implications for teacher evaluation of low-achieving…