A method for analyzing test-item responses is proposed to examine differential item functioning (DIF) in multiple-choice items within the latent class framework. Different models for detection of DIF are formulated, defining the subgroup as a latent variable. An efficient estimation method is described and illustrated. (SLD)

Effects of passage and item-scrambling on equipercentile and item-response theory equating were investigated using 2 scrambled versions of the American College Testing Program Assessment for approximately 25,000 examinees. Results indicate that using a base-form conversion table with a scrambled form affects the individual examinee level. (SLD)

Calculating the reliability of a testlet-based test is demonstrated using data from 1,812 males and 2,216 females taking the Scholastic Aptitude Test verbal section and 3,866 examinees taking another reading test. Traditional reliabilities calculated on reading comprehension tests constructed of four testlets provided substantial overestimates.…

Item parameter estimates derived through item response theory methods have been considered relatively robust to changes in item position and context, but the anomaly in reading scores from the 1986 National Assessment of Educational Progress (NAEP) illustrates problems with common population equating procedures when there are test form changes.…

The conventional method of measuring ability--based on items with assumed true parameter values obtained from a pretest--is compared to a Bayesian method that deals with the uncertainties of such items. Data from a 1987 American College Testing Program mathematics test indicate that maximum likelihood/Bayesian techniques underestimate uncertainty.…

Describes the source instrument, the database, and the experimental methodology that have been used in developing the World Health Organization Quality of Life (WHOQOL) profiles to allow the comparison of quality of life findings from a variety of cultural settings. Illustrates the precautions necessary in interpreting scores from different…

A series of analyses based on a longitudinal study of reading achievement in Chicago (Illinois) illustrate that the conclusions drawn about academic growth and the decisions about types of interventions needed may be very sensitive to the metric that is used (i.e., grade equivalents or item response theory metrics). (SLD)

SIETTE is a web-based adaptive testing system. It implements Computerized Adaptive Tests. These tests are tailor-made, theory-based tests, where questions shown to students, finalization of the test, and student knowledge estimation is accomplished adaptively. To construct these tests, SIETTE has an authoring environment comprising a suite of…

This study extends validity evidence for the Coaching Efficacy Scale (CES; Feltz, Chase, Moritz, & Sullivan, 1999) by providing an evaluation of the psychometric properties of the instrument from previously collected data on high school and college coaches from United States. Data were fitted to a multidimensional item response theory model.…

This study examines the predictive relationships among 309 Asian American and 9471 European American parents' beliefs, expectations, and involvement, and their children's math and reading achievement trajectories during children's transition to school. Data came from the Early Childhood Longitudinal Study-Kindergarten Cohort (ECLS-K), an ongoing…

In an effort to standardize academic application procedures, the Standardized Letter of Recommendation (SLR) was developed to capture important cognitive and noncognitive qualities of graduate school candidates. The SLR consists of seven scales ("knowledge," "analytical skills," "communication skills,"…

The subject of this dissertation is the examination of differential item functioning (DIF) through the use of loglinear Rasch models with latent classes. DIF refers to the probability that a correct response among equally able test takers is different for various racial, ethnic, and gender groups. Because usual methods of detecting DIF give little…

How teachers' judgments about student literacy behavior were analyzed under the Rasch model is described. The analysis was done to assist staff of the Western Australian Department of Education to revise aspects of a literacy program called "First Steps" for the early years of school. First Steps uses a developmental continuum of small…

This study explores the test-retest consistency of computer adaptive tests of varying lengths. The testing model used was designed as a mastery model to determine whether an examinee's estimated ability level is above or below a pre-established criterion expressed in the metric (logits) of the calibrated item pool scale. The Rasch model was used…

This study examined irregularities in reading comprehension (RC) test results at both the individual and aggregate levels, focusing on the effect of test speededness on test scores. Data were taken from results of the Stanford Achievement Test--Seventh Edition (SAT/7), administered during April of 1983 to about 50,000 Palm Beach County (Florida)…