A unified framework for validating criterion-referenced test (CRT) interpretation is proposed. Using functional literacy as an illustration, the instructional outcomes assessed are called achievement constructs, and described in psychological and behavioral terms. The proposed construct validation methods can yield tests more closely linked to…

This study examined the test-retest reliability and criterion validity of basal mastery tests of three commercial reading series. Results indicated that reliability and validity of the test varied among and within instruments. Implications for developing and using basal mastery tests are discussed. (Author/MT)

Cautions that criterion referenced tests are no more effective at diagnosing comprehension subskills than are traditional instruments, and they may lend false credibility to the subskill approach to comprehension. (AEA)

The potential of Holland's theory for use in the vocational guidance of adult women depends in part on more validity data with regard to the conceptual meaningfulness of the constructs. This study reports the findings of a correlative analysis between scores on Holland's Vocational Preference Inventory (VPI), which measures the six styles,'' and…

Using criterion-referenced test item data collected in an empirical study, differences in item selection between Cox and Vargas' pretest-posttest validity index and a latent trait approach (evaluation of the item information function for the mastery score) are analyzed. (Author/GK)

A criterion-referenced language growth measure to diagnose and index growth in English writing skills in hearing impaired students was evaluated utilizing six criteria for adequate language assessment and interrater reliability and validity indices. (Author)

Attempts to select empirically the optimal cutting score or criterion level for a test based on response data from validation samples of instructed and uninstructed students. This score maximizes the probability of correct mastery-nonmastery decisions (or minimizes the probability of incorrect decisions). (Author/RK)

Explores the criterion-related validity of the Swedish version of the Communicative Development Inventories--Words & Sentences (SECDI-W&S). In two follow-up procedures, SECDI-W&S was used to assess vocabulary and grammar skills in 32 children. Overall results confirm that the criterion-related validity of the SECDI is sound. (Author/VWL)

Examines criterion-related validity of curriculum-based measures in written expression for secondary students. Finds a combination of measures was better than any single measure for predicting students' general performance in written expression; and 3 measures added to the prediction of students' general writing proficiency (number of characters…

Criterion-referenced evaluation (CRE) describes achievement in performance terms, whereas norm-referenced evaluation (NRE) compares the performance of one individual to that of others with respect to a given evaluation instrument. Vocational educators who base their programs on behaviorism commonly evaluate student performance from a CRE…

The validity and dependability of functional competency tests for adults are examined as they relate to the information needs of instructional decision makers. Test data from the Adult Performance Level (APL) Program (funded by the U.S. Office of Education at the University of Texas at Austin) is used to illustrate key points. In the discussion of…

It is usually assumed that the procedures followed in developing criterion-referenced (CR) educational achievement tests ensure their content validity. This assumption is reasonable for the class of "domain-specified" CR tests, in which the item domain is completely specified by item generation rules. However, most CR tests are of the…

This paper presents the interim results of a set of studies undertaken to develop a much needed methodology for establishing content validity in domain-referenced achievement tests. The study results are presented in the context of the larger issue of the improvement of test design. School teachers, administrators and graduate students were…

Formal measuring devices used to ascertain the training success and promotion potential of maintenance personnel have been deficient in the area of job realism. In part, this may be due to reliance on paper and pencil testing rather than the use of effective job performance measurements. Data concerning job performance measurements applicable to…

Data required for evaluating a Criterion Referenced Measurement (CRM) is described with a matrix. The information within the matrix consists of the "pass-fail" decisions of two CRMs. By differentially defining these two CRMs, different concepts of reliability and validity can be examined. Indices suggested for analyzing the matrix are listed with…