In tertiary institutions in Australia, and no doubt elsewhere, there is increasing pressure for accountability. No longer are academics assumed "a priori" to be responsible and capable of self management in teaching and assessing the subjects they run. Procedures are being dictated more from the "top down". Although academics…

Various item selection techniques are compared on criterion-referenced reliability and validity. Techniques compared include three nominal criterion-referenced methods, a traditional point biserial selection, teacher selection, and random selection. (Author)

Classical test construction and analysis procedures are applicable and appropriate for use with criterion referenced tests when samples of both mastery and nonmastery examinees are employed. (Author/BB)

The basis for selection of the calibration sample determines the kind of scale which will be developed. A random sample from a population of individuals leads to a norm-referenced scale, and a sample representative of abilities of a range of characteristics leads to a criterion-referenced scale. (Author/BB)

The Coping Inventory, a criterion referenced scaled observation instrument used to assess adaptive coping behavior in handicapped children, is described. The adaptive behavior summaries of two children, a 5 year old in a special education class and a 15 year old handicapped high school student, are used to show how the Coping Inventory results are…

The relationship between instruction and a test is defined as a parallel content-valid relation. This article describes the PLANA procedure, which approaches the problem of content validity by applying constructional rules for producing or judging the content validity relationship between the instructional objective and the items. (BW)

Rebuffs Leslie Maclean and Harvey Goldstein's claims that the National Assessment of Educational Progress (NAEP) Reading Proficiency Scale is unidimensional. Critics' confusion may stem from failing to separate what a test measures from a score's usefulness. The Lexile Reading Scale should be integrated with the NAEP scale. Includes eight…

Although the primary use of the speaking section of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT Speaking test) is to inform admissions decisions at English medium universities, it may also be useful as an initial screening measure for international teaching assistants (ITAs). This study provides criterion-related…

Attention is drawn to the dynamics of criterion-referenced test (CRT) construction in this report. How CRT's are developed at the Instructional Objectives Exchange is described through a series of three steps. The procedures pertain to the construction of "off the shelf" as well as "customized" tests. Step one, isolating the…

Applied Performance Tests (APT) are defined as instruments designed to measure performance in an actual or simulated setting. They require at least a close approximation of the setting (if not the actual setting) to which the performance is expected to be transferred. This paper outlines measurement problems and issues that are unique to APT. It…

The item (difficulty and discrimination) and test (reliability and validity) statistics in classical test theory are highly dependent upon the calibration sample of individuals used. The estimates of item and test parameters in classical test theory is valid within a range of interest along the characteristic measured. Generally, this range of…

Differences in design between norm referenced measures (NRM) and criterion referenced measures (CRM) are reviewed, and some of the procedures proposed on designing and evaluating CRM are examined. Differences in design of NRM and CRM are said to arise from the different purposes that underlie each measure. In addition, there are differences among…

"Content validity" has been widely but unwisely hailed as a solution to many problems in employee selection. The author argues that sampling from content domains cannot logically be substituted for criterion related validity. He suggests that evaluations of scores be based on the principle of construct validation. (Editor/RK)

Offers practical tips on how teachers can determine whether classroom tests are actually measuring what they are designed to measure. Discusses criterion-related validity, construct validity, and content validity. Demonstrates how to determine the degree of content validity a particular test may have for a particular course or unit. (Author/DH)

The paper discusses the key criteria of good language tests: practicality, validity, and reliability.