This response to the comments contains three main sections, each addressing a subset of the comments. In the first section, I will respond to the comments by Brennan, Haertel, and Moss. All of these comments suggest ways in which my presentation could be extended or improved; I generally agree with their suggestions, so my response to their…

Studies of data use illuminate ways in which education professionals have used test scores and other evidence relevant to students' learning--in action in their own contexts of work--to make decisions about their practice. These studies raise instructive challenges for a validity theory that focuses on intended interpretations and uses of test…

In the paper, "Rhetoric or Reality? Do Accounting Education and Experience Increase Weighting on Environmental Performance in a Balanced Scorecard?" (Wynder, Wellner, and Reinhard 2013), researchers test whether business education and (controller) experience influence decision-makers to consider a longer-term perspective and,…

I address two issues that were inspired by my work on the Dutch Committee on Tests and Testing (COTAN). The first issue is the understanding of problems test constructors and researchers using tests have of psychometric knowledge. I argue that this understanding is important for a field, like psychometrics, for which the dissemination of…

People can use a variety of different strategies to perform tasks and these strategies all have two characteristics in common. First, they can be evaluated in comparison with either an absolute or a relative standard. Second, they can be used at varying levels of consistency. In the present article, the authors develop a general theory of task…

Possible interpretive arguments for licensure and certification test scores are examined, and evidence to support each type of argument is analyzed. Particular attention is given to a competency-based argument that involves a sequence of inferences from test scores to statements about competence and then to conclusions about expected performance.…

The nature and common uses of standardized achievement tests are described and placed in context in order to evaluate claims and criticisms that are commonly made. Tests are described as samples of behavior and hence subject to sampling errors. Much of the debate is dominated by emotion and prejudices. There is very little empirical evidence about…

Despite the many limitations of standardized tests, schools use them to determine if children are ready for school, to group students for instruction, to diagnose learning disabilities and other handicaps, and to guide and control the curriculum and teaching methods. No test is good enough to serve as the sole or primary basis for important…

A program which emphasizes "moving toward excellence" is described here, as developed and practiced at the L. D. Bell High School in Hurst, Texas. The program is based on the perception that the measure of an effective principal as the instructional leader of the school can be found in the perception and implementation of curriculum…

It is argued that achievement test means, based on group scores, or other district-wide summary scores do not provide valid measures for diagnosing curriculum weaknesses nor for initiating curriculum changes. Group scores are probably valid for some purposes, but should not be used as criterion variables for evaluating the effectiveness of…

There are both strengths and weaknesses of using standardized test scores as a criterion for admission to institutions of higher education. The relative importance of scores is dependent on the institution's degree of selectivity. In general, decision processes and admissions criteria are not well defined. Advantages of test scores include: use of…

Two veteran high school counselors answer college bound students' common questions about selecting and applying to colleges. Topics discussed include where to begin research, criteria for selecting schools, number of applications to submit, parent role, getting counselors' help, relative importance of admission criteria, applying to parents' alma…