This Digest presents a discussion of the assumptions of multiple regression that is tailored to the practicing researcher. The focus is on the assumptions of multiple regression that are not robust to violation, and that researchers can deal with if violated. Assumptions of normality, linearity, reliability of measurement, and homoscedasticity are…

This Digest, intended as an instructional aid for beginning research students and a refresher for researchers in the field, identifies key factors that play a critical role in determining the credibility that should be given to a specific research study. The needs for empirical research, randomization and control, and significance testing are…

Matrix sampling of test items, the division of a set of items into different versions of a test form, is used by several large-scale testing programs. This Digest discusses nine categories of costs associated with matrix sampling. These categories are: (1) development costs; (2) materials costs; (3) administration costs; (4) educational costs; (5)…

This topical bibliography and commentary addresses methods of alternative, or informal, assessment that have proven effective, and how these methods have been, or can be, established as reliable alternatives to standardized testing. It discusses authentic assessment, forms of alternative assessment (unstructured written activities, unstructured…

Test validity refers to the degree to which the inferences based on test scores are meaningful, useful, and appropriate. Thus, test validity is a characteristic of a test when it is administered to a particular population. This article introduces the modern concepts of validity advanced by S. Messick (1989, 1996, 1996). Traditionally, the means of…

This digest discusses sources of error in testing, several approaches to estimating reliability, and several ways to increase test reliability. Reliability has been defined in different ways by different authors, but the best way to look at reliability may be the extent to which measurements resulting from a test are characteristics of those being…

This Critical Issue Bibliography (CRIB) Sheet presents resources on college rankings publications, criticisms of rankings methodology, effects of the rankings on the public, and alternatives to the major rankings guides. The annotated bibliography lists 5 Internet resources and 17 other resources, all of which are in the ERIC database. (SLD)

Efforts to expand the generic language proficiency guidelines of the American Council on the Teaching of Foreign Languages (ACTFL) to the less commonly taught languages (LCTLs) began when developers realized that the ACTFL guidelines were too Eurocentric; the guidelines included grammatical categories specific to Western European languages and…

Research on student evaluation of college teachers' performance is briefly summarized. Lawrence M. Aleamoni offers four arguments in favor of student ratings: (1) students are the main source of information about the educational environment; (2) students are the most logical evaluators of student satisfaction and effectiveness of course elements;…

This digest offers principles of performance assessment as an alternative to norm-referenced tests. The definition of performance assessment developed by the U.S. Congress's Office of Technology and Assessment is given, common features are listed, and the terms "performance" and "authentic" are defined. Suggested guidelines for…

The oral interview (OI) is a testing procedure that measures a wide range of speaking abilities in a foreign language. Although somewhat different versions are used in different testing situations, the OI always consists of a structured, face-to-face conversation on a variety of topics between a student and one or two testers. The resulting speech…

This annotated bibliography of materials in the ERIC database contains 30 annotations (dating from 1974 to 1989) on informal reading inventories (IRIs). The citations were selected to help professionals understand the history of, the uses of, and the issues surrounding IRIs. The major sections of the bibliography are: Overview, General Uses,…

Intended for administrators and policymakers as well as teachers, this digest explores approaches to, problems with, and trends in large scale writing assessment. The digest first compares direct and indirect assessment approaches, then examines three approaches to scoring: holistic, primary trait, and analytic. It then discusses issues and…

Examines the arguments against the indiscriminate use of readability formulas. (FL)

The constructs used to evaluate research quality--valid, objective, reliable, generalizable, randomized, accurate, authentic--are not value-free. They all require human judgment, which is affected inevitably by cultural norms and values. In the case of research involving American Indians and Alaska Natives, assessments of research quality must be…