This three-paper dissertation explores item cluster-based assessments, first in general as it relates to modeling, and then, specific issues surrounding a particular item cluster-based assessment designed. There should be a reasonable analogy between the structure of a psychometric model and the cognitive theory that the assessment is based upon.…

Writing multiple-choice test items to measure student learning in higher education is a challenge. Based on extensive scholarly research and experience, the author describes various item formats, offers guidelines for creating these items, and provides many examples of both good and bad test items. He also suggests some shortcuts for developing…

Oral language exams at university often consist of an individual or group conversation with the examiner about topics dealt with during the semester. A question-and-answer format is applied and vocabulary and structures tested. As a consequence, the oral exam does not reflect action-oriented approaches that often form part of classroom activities…

Describes the development and testing of a structured ethical integrity interview that can be used in the selection of applicants. Examines directions for future testing and study. (SR)

Describes the institutional practices related to qualifying examinations in U.S. sociology graduate departments (n=178). Indicates that there are differences between the Ph.D.-granting and M.A.-granting programs in relation to the structure of examinations; while the structures in the departments are consistent. Includes references. (CMK)

The basis of students' confidence in their answers to test items was studied with 95 undergraduates. Results support the domain-general hypothesis that predicts that confidence judgments will be related to performance on a particular test and also to confidence judgments and performance on unrelated tests. (SLD)

Discusses the content and cognitive specification of the third edition of the Test of Understanding in College Economics. Presents examples of the construction and sampling criteria employed in the latest and previous versions of the test. Explains that the test emphasizes recognition and understanding of basic terms, concepts, and principles with…

Provides an overview of the Graduate Record Examination (GRE) Psychology test focusing on the scoring system for the GRE Psychology test, who prepares the test and how the test is prepared, and the usefulness of the GRE Psychology test. Explores some future directions for the test. (CMK)

Explanations for an observed change in Rasch item parameters ("b" values) from consecutive administrations of a professional licensing examination were investigated. Analysis of covariance indicated that the change was not related to item position or type. It is hypothesized that the change is attributable to shifts in curriculum…

Data from the College Board Validity Study Service show that the average multiple correlation of the Scholastic Aptitude Test (SAT) with college grades peaked in 1974 and then tended to decline. Data from other sources also estimate a small average decline from 1974 to 1985. This study documented changes in the SAT and related these changes to…

Test data from 200 examinees from the Spanish Teacher Certification Examination and 75 examinees from the French Teacher Certification Examination were used in a study of scale drift in sequentially equated test forms. Using sampling with replacement, 1,000 samples of 100 examinees each for Spanish and 1,000 samples of 50 each for French were…

Effects of passage and item-scrambling on equipercentile and item-response theory equating were investigated using 2 scrambled versions of the American College Testing Program Assessment for approximately 25,000 examinees. Results indicate that using a base-form conversion table with a scrambled form affects the individual examinee level. (SLD)

Argues for an approach to undergraduate instruction that incorporates recent research concerning schema theory (the continual cognitive restructuring and processing of information). Recommends beginning with fundamental skills and building on these to include more complex concepts and processes. Includes an illustrative example beginning with…

Beginning in 1972, the average Scholastic Aptitude Test Verbal (SAT-V) score for men has been higher than that for women. This study created a detailed history of the content of SAT-V sections over the last two and a half decades and examined the changes of test content and trends over time in the balance of references to and representations of…

Three political scientists, three historians, three social studies professors (higher education), and seven secondary school teachers of social studies or history were interviewed. Focus was on assessing key concepts in the subjects' disciplines and what concepts should be taught and tested for at the high school level, with a view toward…