Lissitz and Samuelsen (2007) have proposed an operational definition of "validity" that shifts many of the questions traditionally considered under validity to a separate category associated with the utility of test use. Operational definitions support inferences about how well people perform some kind of task or how they respond to some kind of…

A model is presented in which a test score is influenced by three factors: (1) the test itself, including the nature of the item tryout samples, the nature of the standardization group, the item scaling model and methods, the manner of item subset generation, logical strategies in test building, the format of questions, the test appearance, item…

The clinical inference process in test interpretation is described so that people can more easily communicate about it, teach it, and learn it. Chapter 1 compares different levels (concrete, mechanical, and individualized) of interpretation of the same test. Chapter 2 offers examples of an often-neglected kind of data necessary for individualized…

University-level mathematics placement examinations might yield summary measures that are differentially accurate due to individual differences in the recall of previously-learned material. In particular, test scores in algebra and trigonometry may be subject to sporadic recall of solution procedures, resulting in aberrant response patterns. The…

This was an experiment to test the extended discretion laboratory approach versus a guided-inquiry approach for teaching biology in a university setting. Among three criterion variables (examination, reports, and quizzes), only the laboratory report scores showed differences between groups and group-by-instructor interaction. (Author/YP)

This study employed a multiple regression to predict examinees' differential performance when tested by familiar and unfamiliar examiners. Subjects were 32 preschool and school-age handicapped children, each of whom had been tested on the Clinical Evaluation of Language Functions, once by a familiar and once by an unfamiliar tester, within a…

Upon learning that a form of the Sequential Tests of Educational Progress was incorrectly distributed to an unidentified number of high school students along with an answer sheet pregridded with an alternate test form, the Austin Independent School District performed the following research analyses: (1) scored the tests using the key for each…

The validity of a comparison of mean test scores for two groups and of a longitudinal comparison of means within each group is assessed. Using LISREL, factor analyses are used to test the hypotheses of similar factor patterns, equal units of measurement, and equal measurement accuracy between groups and across time. (Author/DWH)

This study was designed to examine student achievement in mathematics by means of curriculum-based tests. The results of the 1979 New York State Regents examination in Eleventh Grade Mathematics were obtained from a representative sample of schools throughout the state. The expectations were that there would be substantial differences in…

This book examines educational improvement in Great Britain in recent years. It addresses three concerns: (1) develop better estimates of the extent to which schools have changed in their effectiveness over time; (2) understand the factors and strategies associated with changes in performance across schools; and (3) explore the school-improvement…

Presented is a study designed to determine the effects of the order of test administration on attitude scores. The findings indicate that attitude scores may be significantly altered by the order of test administration. (CW)

Data on some aspects of the deductive logical competence of nongraduate teachers in the English-speaking Caribbean, primarily Jamaica, are reported in this document. The teachers sampled were those who sat for entrance examinations for the University of the West Indies (Mona) Faculty of Education Bachelor of Education and Certificate of Education…

The Maryland State Department of Education issued a request for proposals to develop a score reporting system for the Maryland Functional Testing Program. RMC Research Corporation conducted a literature review of extant literature and developed a national survey of non-norm-referenced test score reporting practices. This comprehensive analysis of…

In the Connecticut School Effectiveness Project, data are collected on seven characteristics of effective schooling: safe and orderly environment, clear school mission, instructional leadership, high expectations, opportunity to learn and time on task, frequent monitoring of student progress, and home-school relations. These data are collected…

Four different systematic methods for selecting passing scores which differ primarily in the types of judgment they require were compared. The borderline group method and the contrasting groups method were each compared with the Nedelsky method at four schools and the Angoff method at another four schools. The Basic Skills Assessment Tests in…