Presents data from validation study of American Council on Teaching of Foreign Languages (ACTFL) Oral Proficiency (OPI). Distinctness of OPI ratings from scores generated by Test of English as a Foreign Language and one other examination is assessed on basis of comparisons among 70 sets of scores from students of English as Second Language who…

This investigation seeks to confirm a computer-based approach that can be used to score concept maps (Poindexter & Clariana, 2004) and then describes the concurrent criterion-related validity of these scores. Participants enrolled in two graduate courses (n=24) were asked to read about and research online the structure and function of the heart…

The Des Moines (Iowa) Public Schools continually evaluate the process of teaching for learning in order to provide quality programming for its diverse student body. Different methods of student outcome assessment are used to identify areas for study and analysis. This report provides information about the achievement of district students on: (1)…

Research evidence relating to the utility of the RMC evaluation models of compensatory education employing non-normed tests is examined. The history and evolution of five early models into the current norm-referenced model utilizing a non-normed test (Model A2), non-normed versions of a comparison model (Model B2), and the regression model (Model…

Because testing, in many different forms, currently plays such an important role in education, Elementary Secondary Education Act, Title I, the Division of Federal Assistance in the Vermont State Department of Education, prepared this brochure to present a general introduction to terms and phrases commonly used in testing and to highlight some of…

The Wisconsin Pupil Assessment Program is a testing service which provides the State of Wisconsin with: (1) a measure of student performance in selected academic areas by developing objective-referenced tests in reading, mathematics, economic understanding, and writing; (2) a comparison of Wisconsin public school students to the rest of the nation…

The nature and purpose of criterion-referenced testing is discussed in light of test design procedures. It is seen that the uses to which test results are put are the chief determiners of the appropriate measurement model. A distinction is made between cut-off scores, criterion scores, and mastery scores. The value of certain test construction…

Thirty-eight methods are presented for either setting standards or adjusting them based on an analysis of classification error rates. A trilevel classification scheme is used to categorize the methods, and 10 criteria of technical adequacy and practicability are proposed to evaluate them. (Author/LMO)

A model is presented using examinee judgements in detecting ambiguous/misinterpreted items on teacher-made criterion-referenced tests. A computational example and guidelines for constructing domain categories and interpreting the indices are presented. (Author/PN)

This guide explains the benefits of and procedures for constructing and administering criterion-referenced performance tests in vocational education programs. Addressed in the individual sections are the following topics: the rationale for using task performance measures in vocational education; the predictive validity and physical fidelity of…

A latent trait model, the Rasch, was fitted to a criterion-referenced test. Approximately 90 percent of the items fit the model. Those items which fit the model were then calibrated. Based on the item calibration, individual ability estimates and the standard errors of those estimates were calculated. Using the ability estimates, it was possible,…

Confusion has arisen because tests are described as criterion-referenced or norm-referenced. Generally, these terms should apply to scores and not to tests since either type of score may be obtained for any test. Various terms such as absolute scores, fixed-standard scores and mastery-test scores may be more appropriate substitutes for…

The feasibility of using criterion referenced tests (CRTs) in a large-scale evaluation conducted in an effectiveness evaluation context was investigated. The study began by examining the theory that structures the development and validation of CRTs to discover whether, on theoretical grounds alone, CRTs are suitable or not suitable for large-scale…

Summarizing work which is part of an Army research program on Methodological Issues in the Construction of Criterion Referenced Tests, the focus of this paper is on a Bayesian model, which gives the probability of correctly classifying an examiner as a master or as a nonmaster while taking into consideration the test length and the mastery cut-off…

The study analyzes the achievement trends of all third grade students in the state of Illinois who scored in the Exceeds category in reading and mathematics on the Illinois Standards Achievement Test (ISAT) in the year 2000. ISAT performance of this cohort group of students was followed through the eighth grade. Descriptive analyses were utilized…