Binary, probability, and ordinal scoring procedures for multiple-choice items were examined. In two situations, it was found that both the probability and ordinal scoring systems were more reliable than the binary scoring method. (Author/CTM)

The relationship between metamemorial accuracy and student test performance was assessed in a graduate educational psychology class. Metamemory is defined as information about the content of one's own memory. Adult students in two courses (N=67) were asked to select multiple choice answers in two midterms and a final examination and to rate their…

The present study was an attempt to alleviate some of the difficulties inherent in multiple-choice items by having examinees respond to multiple-choice items in a probabilistic manner. Using this format, examinees are able to respond to each alternative and to provide indications of any partial knowledge they may possess concerning the item. The…

A potentially valuable measure of overconfidence on probabilistic multiple-choice tests was evaluated. The measure of overconfidence was based on probabilistic responses to nonsense items embedded in a vocabulary test. The test was administered under both confidence response and conventional choice response directions to 208 undergraduate…

An examinee is required to express his confidence in the correctness of each choice of a multiple-choice item in a probabilistic test. For the responses to be valid indicators the confidence expressed in each choice should be determined by an examinees' knowledge. This study assessed the relationship of the certainty of examinees' responses to…

Multiple-choice testing (MCT) has several advantages which are becoming more relevant in the current financial climate. In particular, they can be machine marked. As an objective testing method it is particularly relevant to engineering and other factual courses, but MCTs are not widely used in engineering because students can benefit from…

Probabilistic testing involves having the examinee assign probabilities to each of the options of a multiple-choice item. These probabilities reflect the student's perception of the correctness of each option. What is presented in the paper is a rationale for probability testing, the current theoretical and empirical findings, and some suggested…

The problems stated at the outset were: to discover whether information provided by confidence testing would result in a more accurate assessment of student knowledge so more personal individualized instruction could be presented, and whether sufficient precise data could be attained to be of significant aid in curriculum planning. Analysis has…

One formulation of confidence scoring requires the examinee to indicate as a number his personal probability of the correctness of each alternative in a multiple-choice test. For this formulation, a linear transformation of the logarithm of the correct response is maximized if the examinee reports accurately his personal probability. To equate…

Instructions are provided on how to create and take computer aided admissible probability measurement (CAAPM) tests using programs available on PLATO IV. Admissible probability measurement is a testing procedure that permits a user to express a degree of uncertainty as to the correctness of alternative answers. Section II describes PLATO IV, an…

Two sets of mathematical reasoning and two sets of verbal comprehension items were cast into each of three formats--constructed response, standard multiple-choice, and Coombs multiple-choice--in order to assess whether tests with identical content but different formats measure the same attribute. (Author/CTM)

A specially designed answer format was used for three tests in a college level agriculture class of 19 students to record responses to three things about each item: (1) the student's choice of the best answer; (2) the degree of certainty with which the answer was chosen; and (3) all the answer choices which the student was certain were incorrect.…

This handbook presents instructions for implementing a confidence testing program in technical training situations, identification of possible areas of application, techniques for evaluating confidence information, advantages and disadvantages of confidence testing, time considerations, and problem areas. Complete instructions for "Pick-One" and…

This paper examines confidence testing, and reasons for using confidence tests. Different scoring systems are studied in order to clarify the meaning of significance of the weights which subjects assign to confidence scored tests. (DLG)