Compares the effect of content ordering and scrambled ordering on examinations in courses, such as economics, that require quantitative skills. Empirical results suggest that students do no better if they are given a content-ordered rather than a scrambled examination as student performance is not adversely affected by scrambled ordered…

Describes how multiple-choice items can be designed and used as an effective diagnostic tool by avoiding their pitfalls and by taking advantage of their potential benefits. The following issues are discussed: correct' versus best answers; construction of diagnostic multiple-choice items; the problem of guessing; the use of justifications of…

This handbook has been written for college teachers regardless of their prior training in pedagogy, assessment, or education. It is a practical handbook, designed for easy reference. Part 1 can provide either an introduction to Classroom Assessment or a comprehensive review, depending on the reader's prior experience. The first chapter explains…

Appropriate evaluation can greatly enhance the teaching process, and this resource packet is designed to help make testing more efficient. Tests and test items are featured in these listings, and information on test construction is provided. The various sources which are highlighted include: (1) professional organizations; (2) journals and…

The DX SYSTEM of Diagnostic Testing is an easy-to-use computerized system for developing and administering diagnostic tests. A diagnostic test measures a student's mastery of a specific domain (skill or content area). It examines the necessary subskills hierarchically from the most to the least complex. The DX SYSTEM features tailored testing with…

This paper reviews 18 microcomputer software item banks on an individual basis. Software Programs reviewed are AIMS (Academic Instructional Measurement System); CREATE-A-TEST; Exam Builder; Exams and Examiner; MicroCAT; Multiple Choice Files; P.D.Q. Builder; Quiz Rite; Teacher Create Series (5 programs); TAP (Testing Authoring Program); TestBank…

Investigates the effects on multiple choice test performance of altering the order and placement of questions and responses. Shows that changing the response pattern appears to alter significantly the apparent degree of difficulty. Response patterns become more dissimilar under certain types of response alterations. (LS)

Traditional tests fall into two categories, both of which have several advantages and disadvantages that need to be considered when determining the type of test to use. Constructed-response tests, such as essay tests, ask students to construct their own responses. Thus, students are required not only to recall but to organize and often apply…

This module contains resource materials to help vocational education teachers construct effective written tests. (The materials supplement the videotape on "Written Test Construction.") Materials in the packet include guidelines for developing written tests in general and specific guidelines for the five major types of test items, brief…

This article presents the perspective that the quality of teacher-made, small classroom tests has not improved, and may have declined in recent years. This decline may be due to the fact that teachers have come to believe that the kinds of objective items used in national standardized tests are the only item types appropriate for classroom use.…

This resource paper is a guide for planning and developing instructionally relevant tests of student learning at the classroom, building, or district level. It is based on a model of instruction and testing which systematically uses assessment information to support and facilitate instructional improvement. Course goals and objectives are first…

This paper reports a multi-method approach for examining the cognitive level of multiple-choice items used in a medical pathology course at a large midwestern medical school. Analysis of the standard item analysis data and think-out-loud reports of a sample of students completing a 66 item examination were used to test assumptions related to the…

This handbook provides guidelines for instructors to follow in developing test items for occupational task lists. It begins with directions for task analysis: identifying major performance steps of a task, identifying supporting knowledge for each performance step, identifying supporting performance skills for each performance step, identifying…

Information on the uses, advantages, and limitations of different types of test items is presented for college faculty, along with guidelines for developing test items. Included is advice on: choosing between objective and subjective test items, when essay tests or objective tests are appropriate, and when either essay or objective tests can be…

This guide is organized into five chapters; (1) an approach to testing--decisions made from test results, types of achievement tests, types and levels of objectives, and test validity, reliability, and practicality; (2) classroom test construction--planning, item banks, item writing, assembly, administration, and scoring; (3) test analysis-item…