This study examines the effect of supplemental educational services (SES) on student test score gains and whether particular subgroups of students benefit more from No Child Left Behind (NCLB) tutoring services. The sample used includes information on students enrolled in 3rd through 8th grades nested in 121 elementary and middle schools over a…

Scores were compared for two experimental assessment instruments constructed as examples of the techniques used by the Sentence Verification Technique (SVT) of J. M. Royer and others (1979) and the Michigan Educational Assessment Program (MEAP) of the Michigan Department of Education (1987, 1988) to measure reading comprehension as an interactive…

Many testing programs include a section of optional questions in addition to mandatory parts of a test. These optional parts of a test are not often truly parallel to one another, and groups of examinees selecting each optional test section are not equivalent to one another. This paper provides a general method based on missing-data methods for…

Standard errors and bias of unidimensional and multidimensional ability estimates were compared in a factorial, simulation design with two item response theory (IRT) approaches, two levels of test correlation (0.42 and 0.63), two sample sizes (500 and 1,000), and a hierarchical test content structure. Bias and standard errors of subtest scores…

A part-form methodology was used to study the effect of varying degrees of multidimensionality on the consistency of pass/fail classification decisions obtained from simulated unidimensional item response theory (IRT) based licensure examinations. A control on the degree of form multidimensionality permitted an assessment throughout the range of…

This study examined the relationship between the Collegiate Assessment of Academic Proficiency Critical Thinking test (CAAP-CT) and the College Outcome Measures Program objective test battery (COMP). Focus was on determining: (1) the relationship between the CAAP-CT and the COMP process-oriented subscores and the freshman to sophomore gains in…

To investigate the psychometric feasibility of replacing a paper-and-pencil licensing examination with a computer-administered test, a validity study was conducted. The computer-administered test (Cadm) was a common set of items for all test takers, distinct from computerized adaptive testing, in which test takers receive items appropriate to…

Little research exists on the psychological impacts of computerized adaptive testing (CAT) and how it may affect test performance. Three CAT procedures were examined, in which items were selected to match students' achievement levels, from the item pool at random, or according to student choice of item difficulty levels. Twenty-four graduate…

As part of an effort to develop strategies for measuring institutional effectiveness, a study was conducted at West Virginia University at Parkersburg (WVU-P), a two-year institution with an enrollment of nearly 4,000 students, to determine the most appropriate instrument for measuring gains in general education between incoming freshman (i.e.,…

The Kaufman Assessment Battery for Children (K-ABC) and the Stanford-Binet: Fourth Edition (S-B:FE) were administered in counterbalanced order to a sample of 20 middle-class preschool children (11 males and 9 females) attending the Early Childhood Preschool Center located in a suburban area of a large midwestern city. Subjects' mean age was 4…

The comparative effects of various sequences of test items were examined for over 900 graduate students enrolled in an educational research course at The University of Alabama, Tuscaloosa. experiment, which was conducted a total of four times using four separate tests, presented three different arrangements of 50 multiple-choice items: (1)…

The instructional validity of computer administered tests was studied with a focus on whether differences in test scores and item behavior are a function of instructional mode (computer versus non-computer). In the first of 3 studies, performance test scores for approximately 400 high school students in 1990-91 for tasks accomplished with the…

Student achievement test scores were compared and equated, using three different testing methods: paper-administered, computer-administered, and computerized adaptive testing. The tests were developed from third and sixth grade mathematics item banks of the California Assessment Program. The paper and the computer-administered tests were identical…

Current testing standards call for test developers to provide evidence that testing procedures and test scores, and the inferences made based on the test scores, show evidence of validity and are comparable across subpopulations (American Educational Research Association [AERA], American Psychological Association [APA], & National Council on…

The evolution of the West African Examinations Council (WAEC) Senior School Certificate Examination (SSCE) and certification process is traced. The challenges posed by combining, for certification purposes, the scores from internal and external assessments of school candidates are discussed in the face of the low reliability of teachers'…