A distinction is made between reliability of measurement and reliability of classification; the "criterion-referenced reliability coefficient" describes the former. Application of this coefficient to the probability distribution of possible scores for a single student yields a meaningful way to describe the reliability of a single score. (Author)

In this paper Cognitive Abilities Test scores are compared directly with moderated GCSE scores awarded to the same group of pupils. For ease of interpretation the comparisons are presented in a graphical form. Whilst some provisional and tentative conclusions are drawn about the reliability of GCSE art, questions are raised about the general…

Two types of test scores are often used for determining eligibility for early intervention services: standard scores and developmental-age scores. Because they are derived using different methods, these two types of scores do not provide equivalent information. Characteristics of norm-referenced and criterion-referenced tests and the scores…

The purpose of this report is to provide descriptive data regarding the test scores of Milwaukee Parental Choice Program (MPCP) students in grades 4, 8 and 10 in reading, math and science, as reported to the School Choice Demonstration Project 2007-2008. The tables, graphs, and histograms presented in this report provide a snapshot of these…

A computer simulation was undertaken to determine the effects of using Huynh's single-administration estimates of the decision consistency indices for agreement and coefficient kappa, under conditions that violated the beta-binomial assumption. Included in the investigation were two unimodal score distributions that fit the model and two bimodal…

This paper evaluates the magnitude of the total error in estimates of the difference between an examinee's domain score and the cutoff score. An observed score based on a random sample of items from the domain, and an estimated cutoff score derived from a judgmental standard setting procedure are assumed. The work of Brennan and Lockwood (1980) is…

A study was conducted to determine the technical agriculture knowledge level attained by Vocational Agriculture II students on a criterion-referenced test developed from Louisiana's Vocational Agriculture II basic curriculum; and determine if students' scores on the test differed according to selected variables: Future Farmers of America…

The purpose of this study was to investigate the effect of integrating Microsoft Excel into a high school algebra class. The results indicate a slight increase in student achievement when Excel was used. A teacher-created final exam and two Criterion Referenced Tests measured success. One of the Criterion Referenced Tests indicated that the…

This document addresses the CLAST results for Miami-Dade Community College (M-DCC) in June 2002. The results can be useful in developing strategies to enhance the CLAST pass rates of M-DCC students. Specifically, the document addresses the following three areas: first time pass rate increases in essay, reading, and mathematics, education majors…

This document addresses the CLAST results for Miami-Dade Community College (M-DCC) in 2001. The results can be useful in developing strategies to enhance the CLAST pass rates of M-DCC students. Specifically, the document addresses the following three areas: first time and retake pass rates, performance of first time examinees by skill area,…

This document addresses the CLAST results for Miami Dade Community College (M-DCC) in 2002. The results can be useful in developing strategies to enhance the CLAST pass rates of M-DCC students. Specifically, the document addresses the following three areas: first time and retake pass rates, performance of first time examinees by skill area,…

This document addresses the retention of second language students at Miami-Dade Community College in October 2002. Overall, retention of second language students has improved since the previous year. It should be noted that despite the increase in retention, fewer students are passing all of their lower level EAP courses. The report contains…

The present study showed that Rasch-based adaptive tests--when item domains were finite and specifiable--had greater precision in domain score estimation than test forms created by random sampling of items. Results were replicated across four data sources representing a variety of criterion-referenced, domain-based tests varying in length.…

This chapter discusses units of measurement, relates types of scales and norms to the purpose for testing, looks at types of test data typically reported, identifies the primary users of test information, looks at limitations of scales and norms, and looks at the interaction between user and data. (Author/RL)

The instructional impact of criterion-referenced testing during the past three decades is reviewed, and a method of devising criterion-referenced tests is suggested that departs from the usual model. Adding verification along the lines of panel review that newly constructed test items do elicit appropriate information is suggested. (SLD)