Several Bayesian approaches to the simultaneous estimation of the means of k binomial populations are discussed. This has particular applicability to criterion-referenced or mastery testing. (Author/JKS)

The relationship between instruction and a test is defined as a parallel content-valid relation. This article describes the PLANA procedure, which approaches the problem of content validity by applying constructional rules for producing or judging the content validity relationship between the instructional objective and the items. (BW)

The rationale for use of instructional sensitivity in the empirical review of test items is examined, and the results of a study that distinguishes instructional sensitivity from other item concepts are presented. Research is reviewed which indicates the existence of instructional sensitivity as a unique criterion-referenced test item concept. (RL)

The author began his education career committed to curriculum, not measurement. After years of using teacher-made and standardized tests as instructional afterthoughts, he recognized the superiority of criterion-referenced testing and the influence of high-stakes testing on instruction. He then became involved with developing such tests on a…

Criterion-referenced tests (CRTs) are constructed to permit the interpretation of examinee tests performance in relation to a set of well-defined competencies. CRTs are currently used extensively in schools, industry, and the armed services because they provide valuable and different information from norm-referenced tests. Test publishers, school…

Attention is drawn to the dynamics of criterion-referenced test (CRT) construction in this report. How CRT's are developed at the Instructional Objectives Exchange is described through a series of three steps. The procedures pertain to the construction of "off the shelf" as well as "customized" tests. Step one, isolating the…

A filmstrip with associated audio track has been developed to cover the major planning steps in the development of a measurement instrument such as a test or questionnaire. The filmstrip addresses the following six questions: Why am I testing? What should I test? Whom am I testing? What kinds of questions should I use? How long should my test be?…

The item (difficulty and discrimination) and test (reliability and validity) statistics in classical test theory are highly dependent upon the calibration sample of individuals used. The estimates of item and test parameters in classical test theory is valid within a range of interest along the characteristic measured. Generally, this range of…

For individualized or computer assisted instruction, norm referenced testing is inadequate to determine each individual's mastery on specific kinds of tasks. Hively's item forms and Ferguson's stratified item forms, both based on observable characteristics of the problems, and Scandura's algorithmic technology, positing that persons use rules to…

Differences in design between norm referenced measures (NRM) and criterion referenced measures (CRM) are reviewed, and some of the procedures proposed on designing and evaluating CRM are examined. Differences in design of NRM and CRM are said to arise from the different purposes that underlie each measure. In addition, there are differences among…

A unique system is described for creating tests by computer. It is unique because, instead of storing items in the computer, item algorithms similar to Hively's notion of item forms are banked. Every item, and thus every test, represents a sample from domains consisting of thousands of items. The paper contains a discussion of the special…

This study compared a domain referenced approach with a traditional psychometric approach in the construction of a test. Results of the December, 1975 Quarterly Profile Exam (QPE) administered to 400 examinees at a university were the source of data. The 400 item QPE is a five alternative multiple choice test of information a "safe"…

"Content validity" has been widely but unwisely hailed as a solution to many problems in employee selection. The author argues that sampling from content domains cannot logically be substituted for criterion related validity. He suggests that evaluations of scores be based on the principle of construct validation. (Editor/RK)

The construction of test items, the purposes of testing and criterion-referenced testing are topics debated by two researchers. (CP)