Traditional tests fall into two categories, both of which have several advantages and disadvantages that need to be considered when determining the type of test to use. Constructed-response tests, such as essay tests, ask students to construct their own responses. Thus, students are required not only to recall but to organize and often apply…

Field tests of test items are useful in developing cutting scores for important tests, such as teacher certification examinations and high school graduation tests, because they indicate test item quality and estimate future examinee performance. However, field test data may provide a faulty indication of examinee performance on the real test.…

The effects of different choice formats on the reliability of teacher-made tests were examined for high and low achievers. The first study examined the effect of 3 and 5 choice items on the reliability of dichotomously scored teacher-made tests. The second study examined the effect of 3 and 4 choice items on the reliability of similarly designed…

Five questionnaire forms containing 61 items specifying potential inservice topics for public school teachers were sent to a stratified random sample of Indiana public school administrators and curriculum supervisors. The five forms differed in that, for two forms, the items were ungrouped and appeared in different orders; and, for three forms,…

After reviewing the research design, objectives, and basic conceptual model for the National Longitudinal Study of the High School Class of 1972 (NLS), this document describes the survey plan and issues for the third followup survey. Data analyses--both those that are in progress or planned--are summarized. These activities include composite score…

Two types of sensitivity indices were developed in this paper, one internal to the total test and the second external. To evaluate the success of these statistics the three criteria suggested for a satisfactory index of item quality were considered. The Internal Sensitivity Index appears to meet these demands. Certainly it is easily computed. In…

The development of a series of parallel single-topic tests for testing attainment of 14 objectives concerned with inquiry skill in biology is discussed. The series of eight two-part tests are called "Explorations in Biology" (EIB). (CK)

Over the past decade, developers of the National Assessment of Educational Progress (NAEP) have changed substantially the mix of item types on the NAEP assessments by decreasing the numbers of multiple-choice questions and increasing the numbers of questions requiring short- or extended-constructed responses. These changes have been motivated…

Presents the results of an investigation to determine if the position of a distractor in a multiple choice question influences the degree of difficulty of an item. The data support the hypothesis that the placement of the distractor immediately before the key alters the difficulty of the item significantly. (Authors/SA)

In 1983, four screening tests for assigning students to the appropriate levels of the Stanford Achievement Test, Seventh Edition, were developed with a national sample of hearing impaired students. While students are normally assigned to one of six test level booklets according to grade, this is inappropriate for certain students. This paper…

Monte Carlo simulation procedures were used to study the psychometric characteristics of two two-stage adaptive tests and a conventional "peaked" ability test. Results showed that scores yielded by both two-stage tests better reflected the normal distribution of underlying ability. Ability estimates yielded by one of the two stage tests…

The model developed by the Computer Based Project for the Evaluation of Media for the Handicapped in Syracuse, New York to evaluate the use of captioned films for the deaf with mentally handicapped and emotionally disturbed children is briefly described, followed by a review of recent research conducted by the project staff. Among the areas which…

To determine whether placement of items on a teacher rating scale affects the factor structure underlying the scale and to determine whether changing the item format alters the ratings given, a 12-item, high-inference student rating scale was developed containing two global items pertaining to overall teacher effectiveness and 10 evaluative items…

The proportionality model assumes that total testing time is proportional to the number of test items and the number of options per multiple choice test item. This assumption was examined, using test items having from two to five options. The model was not supported. (Author/GDC)

The Maryland School Performance Assessment Program (MSPAP) is a relatively new, statewide performance assessment of students in grades 3, 5, and 8. When first administered in May of 1991, the MSPAP included a battery of performance assessment tasks designed to generate written or drawn responses to reading texts. This study evaluated selected…