Item banks offer a different approach to test development than that of the more traditional item specification method. This study was designed as an initial comparative investigation in the Area. Fourth grade math and reading tests were developed using both items written from item specifications and items drawn from an existing item bank. Four…

Sixteen item statistics recommended for use in the development of criterion-referenced tests were evaluated. There were two major criteria: (1) practicability in terms of ease of computation and interpretation and (2) meaningfulness in the context of the development process. Most of the statistics were based on a comparison of performance changes…

Undergraduates responded to an objective test in electronics and classified each item by domain (one of 14 topics covered in their text), and by type of knowledge (definition, fact, principle, or interpretation). These judgments were compared to their instructor's "standard" judgments. From these data, an index of item-domain divergence…

Describes development of a test using slides and corresponding multiple-choice questions for second-year occupational therapy students in child studies course. Reasons for choosing the test format are discussed and an outline of test construction procedures is given. An evaluation of the test indicates problems encountered and benefits gained.…

PLANA is a training program for subject matter analysis and construction of instructional objectives. This investigation tries to find out whether education students in the PLANA program differ from other students on planning instruction processes. (BW)

This paper describes major concepts related to item analysis for criterion-referenced tests including validity, reliability, item difficulty, and item discrimination, particularly in relation to criterion-referenced tests. The paper discussed how these concepts can be used to revise and improve items and listed suggestions regarding general…

Discusses problems in using multiple-choice items on criterion-referenced tests, offering alternative methods to determine if objectives have been met. These include batteries of true-false items, structural communication grids, concept linkages, and a scoring system which takes partial knowledge into consideration. (JN)

Cohen and Hyman's response contains several misunderstandings of the original article by Mehrens and Kaminski. One frequently wishes to make inferences to a domain from a test, but teaching a specific performance and testing for that performance does not allow for a domain inference. (SLD)

The SCOPE Mathematics Achievement Test booklet for grade 4 presents 11 mathematical concepts with instructions for students to take the test with little or no teacher direction. Testing items are: writing number words to 100; giving the place value of any digit and using this to write in expanded form; finding a numeral between two given numerals…

An earlier study was extended and replicated to examine the feasibility of generating multiple-choice test questions by transforming sentences from prose instructional material. In the first study, a computer-based algorithm was used to analyze prose subject matter and to identify high-information words. Sentences containing selected words were…

Presents guidelines for constructing tests which accurately measure a student's cognitive skills and performance in a particular course. The advantages and disadvantages of two types of test items are listed (selected response and constructed response items). Both poor and good examples are given and general rules for test item writing are…

A new standard setting approach is introduced, called the cognitive components approach. Like the Angoff method, the cognitive components method generates minimum pass levels (MPLs) for each item. In both approaches, the item MPLs are summed for each judge, then averaged across judges to yield the standard. In the cognitive components approach,…

A model is presented using examinee judgements in detecting ambiguous/misinterpreted items on teacher-made criterion-referenced tests. A computational example and guidelines for constructing domain categories and interpreting the indices are presented. (Author/PN)

A question and answer dialogue is presented that addresses some of the common barriers encountered by writers of criterion-referenced tests. The guidelines deal with performance objectives, intended outcomes, test items for higher levels of learning, compiling test items, managing item construction, and limitations of the criterion test. (JMD)

This report describes how an advisory committee of health occupations education instructors from Missouri schools where tests were given statistically analyzed test items for health services assistant for reliability and validity and then revised the test items. Seventy-five sets of test item booklets were printed. Four test booklets and a…