Extreme response style (ERS), the tendency of participants to select extreme item categories regardless of the item content, has frequently been found to decrease the validity of Likert-type questionnaire results. For this reason, various item response theory (IRT) models have been proposed to model ERS and correct for it. Comparisons of these…

Individual response style behaviors, unrelated to the latent trait of interest, may influence responses to ordinal survey items. Response style can introduce bias in the total score with respect to the trait of interest, threatening valid interpretation of scores. Despite claims of response style stability across scales, there has been little…

A conceptual framework of measurement bias in cross-cultural comparisons, distinguishing between construct, method, and item bias (differential item functioning), is used to describe a methodological framework addressing assessment of noncognitive variables in international large-scale studies. It is argued that the treatment of bias, coming from…

There has long been the suspicion amongst staff in Art & Design that the ratings given to their subject disciplines in the UK's National Student Survey are adversely affected by a combination of circumstances--a "perfect storm". The "perfect storm" proposition is tested by comparing ratings for Art & Design with those…

Evidence of biases in the correct answers in multiple-choice test item files were found to include "all of the above" bias in which that answer was correct more than 25 percent of the time, and a bias that the longest answer was correct too frequently. Seven bias types were studied. (Author/CM)

The tendency of some respondents to omit items more often when they feel they have a less positive evaluation to make and less frequently when the evaluation is more positive is discussed. Five examples illustrate this form of nonresponse bias. Recommendations to overcome nonresponse bias are offered. (SLD)

Responses to various fixed test-response formats were examined for "reliability" due to systematic error; Cronbach's alphas up to .67 were obtained. Of formats tested, four-point Likert Scales were least affected while forms of lines and faces were most problematic. Possible modification in alpha to account for systematic bias is…

Statistical procedures for measuring heterogeneity of test item distractor distributions, or cultural variation, are presented. These procedures are based on the notion that examinees' responses to the incorrect options of a multiple-choice test provide more information concerning cultural bias than their correct responses. (Author/PN)

The Mantel-Haenszel procedure (MH) is a practical, inexpensive, and powerful way to detect test items that function differently in two groups of examinees. MH is a natural outgrowth of previously suggested chi square methods, and it is also related to methods based on item response theory. The study of items that function differently for two…

Intended for parents, this guide discusses the effects of standardized tests on children, using test items from recent standardized reading tests which have been administered to children aged 7 to 13 and children's responses to these items. For each item, comments are made about the ambiguity of the item; the various interpretations that can be…

Indices of appropriateness of a test for an individual are discussed, and two data sets are evaluated. With the first data set, three indices of test appropriateness are obtained for response patterns on achievement tests from an experimental study of the effects of test anxiety and time pressure with 173 3rd and 4th grade students. Relationships…

The feasibility of measuring responding desirably with attitude-opinion items is discussed, and an index based on 16 such items is presented. Estimates of reliability and validity for this index, and examples of its use as a covariate (control) in attitude research are presented. Similarities and differences from related scales are discussed.…

In a replication of an earlier study, a questionnaire with items lacking content and merely containing answer possibilities was administered to a sample of Dutch freshmen psychology students. Subjects showed a preference for positive options over negative options. (Author/JKS)

Literature on the development of classroom achievement tests for high school and college level hearing impaired students is reviewed, with emphasis on achievement tests designed to ascertain whether a particular unit of instruction has been understood as it was presented. The paper reviews: the syntactical structure and vocabulary of test items;…

Relationships between item bias, item difficulty invariance, Rasch tests of item fit, and item position in a speeded 72-item Michigan State University Vocabulary Placement Test were investigated using 143 black males, 289 black females, 2,953 white males and 3,271 white females. Measures of item bias and item difficulty invariance were determined…