Use of item response theory (IRT), the delta plot method, and Mantel-Haenszel techniques to assess differential item functioning (DIF) across racial and gender groups associated with the Maryland Test of Citizenship Skills (MTCS) is described. The objective of this research was to determine the: effect of sample size on results from these three…

The 63 items on skills in acquiring and using information from written documents contained in the Survey of Young Adult Literacy in the 1985 National Assessment of Educational Progress are analyzed. The analyses are based on a qualitative cognitive model and an item-response theory model. (TJH)

Addresses the central issue of test biases in college entrance examinations. Utilizes differential item functioning analysis (DIF) to compare types of questions, fields of knowledge, and male and female responses in Turkish entrance examinations. Reveals intermittent biases and suggests the tests be used more for assessment than selection. (MJP)

Lifelong learning has become an important goal of education over the last decade. According to the United States Department of Education (2001), nearly 3 million students over age 17 (excluding those institutionalized) enrolled in adult basic education, adult secondary education, or English as a second language classes in the United States.…

The Scholastic Aptitude Test (SAT) has been designed to test developed verbal and mathematics reasoning abilities of college-bound students, primarily high school juniors and seniors. For almost a decade there has been a research and development process to evaluate and change the entire SAT program. These changes were implemented in the SAT I:…

This document is a compilation of background readings for the user of Computerized Placement Tests (CPTs) developed by the College Board for student placement purposes. CPTs are computerized adaptive tests that test the individual abilities and backgrounds of examinees. CPTs are part of the ACCUPLACER student information management system. The…

Research efforts have established that the Mantel-Haenszel procedure (MHP) is an effective method for detecting the presence of test items exhibiting differential item functioning (DIF). While the MHP has been advocated for situations where item response theory based methods may not be usable, recent findings have suggested that the performance of…

Probabilistic models with more than one latent variable are designed to report profiles of skills or cognitive attributes. Testing programs want to offer additional information beyond what a single test score can provide using these skill profiles. Many recent approaches to skill profile models are limited to dichotomous data and have made use of…

Detecting differential item functioning (DIF) on test items constructed to favor 1 group over another was investigated on parameter estimates from 2 item response theory-based computer programs--BILOG and LOGIST--using data for 1,000 White and 1,000 Black college students. Use of prior distributions and marginal-maximum a posteriori estimation is…

Item response theoretic methods are applied to the measurement of achievement of students from various instructional backgrounds. This extended item response theory (IRT) approach serves as a tool for studying instructional bias, or instructional sensitivity. The model maintains the form of an IRT model, but has parameters that quantify the extent…

The assessment instruments of the Maine Educational Assessment emphasize extended constructed-response questions. The results from these assessments are reported in terms of percentages of students at four performance levels. The Student-Based Constructed-Response Method was used to establish performance standards for these levels on the…

The Lollipop Test (La Prueba Lollipop) is a bilingual preschool readiness test (in both English and Spanish) that has been the subject of a number of studies to assess validity and detect cultural bias. Such studies have not dealt with item analysis as a way to measure cultural fairness. The Rasch model was used in a study of the Lollipop test…

As a result of the dual roles of the National Assessment of Educational Progress (NAEP) to measure trends in academic achievement over time and to measure what students know and can do, a scale anchoring procedure was developed. Although the NAEP provides norm-referenced information about student proficiency, the scale anchoring procedure gives…

Internal structure and external validity of 39 multiple-choice visual arts achievement test items were examined. These items were developed to assess grade 3 visual arts achievement for a statewide model of a fine arts curriculum. Item responses were evaluated in terms of: (1) fit to the one-parameter Rasch measurement model; (2) item-total…

The goals, principles, and methods of an individualized educational assessment are described as implemented in a 12th-grade science assessment instrument undergoing field trials in Ohio. Pilot tests were planned for December 1990 and March and April 1991. The assessment design incorporates the duplex design of R. D. Bock and R. J. Mislevy (1988)…