Differences among test item writers and among different rules for writing multiple choice items were investigated. Items testing comprehension of a prose passage were varied according to five factors: (1) information density of the passage; (2) item writer; (3) deletion of nouns, as opposed to adjectives, from the sentence in order to construct…

The document presents the final report of a project to develop and validate a three-phase system of individualized criterion-referenced assessment instruments to provide professional decision makers with reliable information regarding a mentally handicapped person's skill level at different stages of normalization training. An overview of…

Latent trait models may offer considerable potential for the improvement of educational measurement practices, but until recently, they have received only limited attention from measurement specialists. This paper provides a brief introduction to latent trait models, and provides test practitioners with a non-technical introduction to the…

The Mastery-Learning test model is extended. Methods for estimating prior probabilities are described. The use of an adjustment matrix to transform a probability of mastery measure and empirical methods for estimating adjustment matrix parameters are derived. Adjustment matrices are interpreted as indicators of instructional effectiveness and as…

Objective-based assessment, known as criterion referenced testing, relies on the development of test items related directly to instructional objectives and incorporated into instruments for which predetermined criterion standards have been set. This bibliography attempts to provide in a somewhat systematic fashion, selected references concerning…

Research procedures used in the development and validation of R/EAL (Reading/Everyday Activities in Life), a new test to overcome problems in assessing functional literacy among adolescents and adults, are described. Specific objectives of the study were to: (1) provide information about the design and development of R/EAL, including determination…

Reviewing psychometric and statistical developments in criterion- referenced testing, this paper presents six sections: uses of criterion- referenced test scores, reliability of criterion-referenced test scores, determination of test length, determination of cut-off scores, test development and validation, and summary and suggestions for further…

The psychometric properties of the testing tools of the Michigan Educational Assessment Program (MEAP), the state standardized testing program, are examined. Reliability studies have indicated that the scores from the MEAP, ranging from 0.654 to 0.949, are generally acceptable. The State Department of Education offered supporting evidence for the…

This digest is designed to provide information to Texas testing coordinators, other educators, and interested citizens about the development procedures and technical attributes of the state-mandated criterion-referenced assessment program. The chapters are: (1) "Background"; (2) "Test Development"; (3) "Test…

Reliability, validity, and standards-setting procedure for a criterion-referenced test (Test of Metric Skills) were examined for use in science curricula. Results indicate a number of factors influencing test reliability/validity and that science teachers need to be aware of these factors to enhance accuracy of their judgments. (Author/JN)

The Carleton Academic English Language (CAEL) Assessment is a criterion-referenced test developed at Carleton University (Canada). It combines logic of performance testing with ethics of gradual admission, i.e., that limited-English-speaking students should be allowed to begin limited academic study in English, based on language proficiency and…

Viewing the reliability for criterion-referenced tests as that of mastery classification decisions, three models for determining reliability were examined using two test administrations so that two estimates could be compared to a standard. A major purpose of the research was to determine how several reliability coefficients (coefficient kappa, an…

A three-part correlational study examined the explanatory power of the Lexile theory of reading comprehension, which was based on the semantic and syntactic components of prose. Correlations were performed between the item difficulties of nine nationally normed reading comprehension tests and computer generated difficulties which were reported in…

A project was conducted to develop and test three criterion-referenced achievement tests for use in Oklahoma's Dietetic Support Personnel training program. The training program is a competency-based course of instruction that is designed to prepare food service and production workers for employment in Oklahoma's health care industry. Initial…

The proposed standard for judging proficiency test score reliability requires that the proportion of items passed for each objective assessed be a dependable estimate of the universe score for the domain strata established by the objective. Domain breadth is the focusing issue. Data from a field trial of the Tennessee Proficiency Test are analyzed…