The "Standards for Educational and Psychological Testing" of the American Educational Research Association, the American Psychological Association, and the National Council on Measurement in Education are intended to provide a comprehensive basis for evaluating tests. This digest identifies key standards applicable to most test…

The research literature provides important guidance to counselors working to keep abreast of the latest thinking regarding best practices and recently developed counseling tools. The purpose of this digest is to highlight a few errors that seem to recur within the literature, and to provide some helpful references that further explore these…

This document examines the concepts of validity, reliability, and appropriateness from a language testing perspective as they apply to the following four assessment issues raised by the National Reporting System (NRS): (1) What type of language assessment seems to be required by the NRS: proficiency or achievement?; (2) Knowing that the NRS…

In educational research and evaluation, a sample of subjects usually received some type of programmatic treatment. Outcome scores for these students are then compared with outcome scores of a control or comparison group. M. Lewis and H. McGurk (1972) have pointed out that there are some implicit assumptions when this approach is applied to…

This ERIC Digest was adapted from the Association for Childhood Education International's (ACEI) 1991 position paper on standardized testing. Since the publication of "A Nation at Risk" in 1983, standardized testing programs have expanded greatly. Tests may be of pencil-and-paper or performance-oriented varieties. The purposes of tests…

Biographical inventory is a selection device used as an alternative or supplement to cognitive testing because this measurement method predicts aspects of job performance that are not predicted by cognitive measures. Some of the issues and concerns about using biographical inventories are discussed. The use of biographical inventories (biodata) is…

Intended for administrators and policymakers as well as teachers, this digest explores methods of listening and speaking skills assessment. The digest first provides a rationale for teaching and assessing listening and speaking skills. It then examines definitions of oral communication and listening, noting (1) the trend toward defining oral…

A reading program's effectiveness can be assessed by investigating skills improvement together with attitude improvement. Frequently, teachers make questionable assumptions about student reading attitudes. To provide educators with a more accurate picture of students' expressed feelings, students' attitudes toward reading should be measured with…

Portfolio assessment is an alternative form of assessment that is particularly attractive to adult, career, and vocational educators because it includes the assessment of active learning and performance rather than the mere recall of memorized facts. Portfolio assessment serves the interests of business and industry by forging a connection between…

Second language (L2) computer-adaptive testing (CAT) is a technologically advanced method of assessment in which the computer selects and presents test items to examinees according to the estimated level of the examinee's language ability. The basic notion of an adaptive test is to mimic automatically what a wise examiner would normally do.…

Several common sources of error in assessment that depends on the use of judges are identified, and ways to reduce the impact of rating errors are examined. Numerous threats to the validity of scores based on ratings exist. These threats include: (1) the halo effect; (2) stereotyping; (3) perception differences; (4) leniency/stringency error; and…

Recent research (1978-1982) on student evaluations of teaching is reviewed, including: influence of background variables pertaining to the student, the teacher, and the learning environment; the dimensions of the teaching being evaluated; the validity of students' evaluations; the "Doctor Fox" effect and its implications for validity; the…

This document consists of papers published in the electronic journal "Practical Assessment, Research & Evaluation" during 2000-2001: (1) "Advantages of Hierarchical Linear Modeling" (Jason W. Osborne); (2) "Prediction in Multiple Regression" (Jason W. Osborne); (3) Scoring Rubrics: What, When, and How?"…

Despite a history of conflicting research on its reliability and validity, student evaluation of faculty (SEF) has typically not been viewed as an infringement on academic freedom; it has generally been taken for granted that SEF is appropriate and necessary. However, informal and reasoned analyses of the issue indicate that because SEF is used…

Multicultural perspectives on assessment challenge traditional perspectives by advancing an additional source of variation in test responses that is presumed to escape test developers and test users. Increasing and convergent evidence from multiple sources indicates the following types of ethnocentric errors in test development, administration,…