I address two issues that were inspired by my work on the Dutch Committee on Tests and Testing (COTAN). The first issue is the understanding of problems test constructors and researchers using tests have of psychometric knowledge. I argue that this understanding is important for a field, like psychometrics, for which the dissemination of…

One promising application of diagnostic classification models (DCM) is in the area of cognitive diagnostic assessment in education. However, the successful application of DCM in educational testing will likely come with a price--and this price may be in the form of new test development procedures and practices required to yield data that satisfy…

This essay describes Louisiana State University's search for an alternative to available placement protocols. Under the leadership of Les Perelman at MIT, LSU collaborated with four universities to develop iMOAT, a program for administering online assessments of student writing. This essay focuses on LSU's On-line Challenge, which developed from…

In response to Lissitz and Samuelsen (2007), the author reconstructs the historical arguments for the more comprehensive unitary concept of validity and the principles of scientific inquiry underlying it. Her response is organized in terms of four questions: (a) How did validity in educational measurement come to be conceptualized as unitary, and…

The state of teacher evaluation is a significantly and frequently neglected problem in public education, an enterprise that spends $400 billion annually on salaries and benefits. Because teacher evaluation is at the center of the quality of teaching in the nation's classrooms, it has the potential to be a powerful lever of teacher and school…

Recommendations are made for the appropriate use and identification of traditional Kuder-Richardson formulas for the estimation of reliability. "Alpha" should be used for reliabilities estimated for tests or scales composed of items yielding scores distributed on more than two points. (SLD)

The critical importance of understanding, selecting, and developing global management talent--management operating within internationally diverse interpersonal and situational contexts--has emerged from the increasing globalization of business and the concomitant high rates of immigration, emigration, and expatriation. With an awareness of this…

The reliability and validity of chance-level scores should be investigated. Only a careful examination of such scores can suggest whether they are likely to reflect random responding or to represent a reasonable estimate of an examinee's ability. (Author/RL)

Recognizes the attraction of Goal Attainment Scaling (GAS), a technique that uses a scale to measure client's achievement, but suggests that there are concerns about the calculation of its standard scores. Examples show how GAS may be used in service development, whether or not numerical values are attached. (Author/CR)

The authors argue that the failure of 60 years of total reliance on assessment via standardized tests to help reduce achievement score gaps must compel us to rethink the role of assessment in this endeavor. They advocate rebalancing assessment priorities to bring classroom assessment into the equation. Evidence gathered over decades from around…

It is argued that consequential validity is a concept worth considering. The solution to defining "validity" is not to narrow the concept, but to allow for the differential prediction provided by tests in different circumstances. Consequences of the uses and interpretations of test scores are central to their evaluation. (SLD)

This article discusses the Peabody Picture Vocabulary Test-III (PPVT-III) and data that indicate children from 4 to 10 years of age are scoring, on average, 10 standard score points higher on the PPVT-III than on the PPVT-Revised. Clinical implications, including the identification of fewer children with the PPVT-III, are explored. (Contains…

Testing deviance must begin with the adoption of new views on the significance of testing. If language is viewed as a means of communicating, then instruction should focus on teaching students to use language for communication, and language tests should be designed so students can demonstrate their abilities in the language coupled with new…

Presents the American Educational Research Association's position on high-stakes educational testing, which stresses conditions essential to sound implementation of such testing, including: protection against high-stakes decisions based on single tests; adequate resources and opportunity to learn; validation for each intended use; alignment…

Operating from multiple literature bases in cognitive psychology, mathematics education, and theoretical and applied psychometrics, Schilling, Hill and their colleagues provide a systemic approach to studying the validity of scores of mathematical knowledge for teaching. This system encompasses an array of task formats and methodologies. The…