Examined the effectiveness of the Sympson-Hetter technique and rotated content balancing relative to no exposure control and no content rotation conditions in a computerized adaptive testing system based on the partial credit model. Simulation results show the Sympson-Hetter technique can be used with minimal impact on measurement precision,…

The value of assessment activities should be judged by their contribution to what happens, directly or indirectly, between teachers and students. No one assessment can serve all ends. Alternative forms of assessment measure outcomes beyond the purview of traditional measures and are more authentic efforts to represent behavior or accomplishments…

Reviews general approaches to job analysis and considers methodological issues related to sampling and the development of rating scales used to measure and describe a profession or occupation. Evaluates the usefulness of different types of test plans and describes judgmental and empirical methods for using practice analysis data to help develop…

The aim of this study was to investigate the effect of instructions of curriculum-based measurement (CBM) of reading on (a) the number of words read correctly and incorrectly per minute and (b) the relationship between CBM reading and reading achievement. Results indicated that the specific instructions used have a significant impact on CBM…

The psychometric literature is replete with comprehensive discussions of test validity, test validation, and the characteristics of quality assessment programs. The most authoritative source for guidance regarding sound test development and evaluation practices is the Standards for Educational and Psychological Testing. However, the Standards are…

The Common European Framework of Reference (CEFR) is intended as a reference document for language education including assessment. This article describes a project that investigated whether the CEFR can help test developers construct reading and listening tests based on CEFR levels. If the CEFR scales together with the detailed description of…

This manual presents information on the Minnesota Multiphasic Personality Inventory (MMPI), primarily directed to counselors and clinicians who work with university counseling center clients, private practice clients, and mental health clinic clients who are not usually psychotic or neurotic but are having difficulties in one or two areas. This…

This Digest describes matrix sampling of test items as an approach to achieving broad coverage while minimizing testing time per student. Matrix sampling involves developing a complete set of items judged to cover the curriculum, then dividing the items into subsets and administering one subset to each student. Matrix sampling, by limiting the…

This document contains a description of the Georgia High School Graduation Test in mathematics. The test item specifications, reflecting the Georgia State Quality Core Curriculum, are used by writers and reviewers who are responsible for the development of test items. Much of the content in the description is based on earlier test versions…

Item selection methods in computerized adaptive testing (CAT) can yield extremely skewed item exposure distribution in which items with high "a" values may be over-exposed while those with low "a" values may never be selected. H. Chang and Z. Ying (1999) proposed the a-stratified design (ASTR) that attempts to equalize item…

Designed to provide an experience as close as possible to the actual assessment, this paper presents the revised model of assessment in reading for the Michigan High School Test (HST). The revisions incorporated into the paper reflect the testing transition from the High School Proficiency Test to the HST. The first part of the paper presents…

Studied three stratification designs for computerized adaptive testing in conjunction with three well-developed content balancing methods. Simulation study results show substantial differences in item overlap rate and pool utilization among different methods. Recommends an optimal combination of stratification design and content balancing method.…

In 1998 and again in 2002, samples of eighth grade students in California were tested in reading as part of the state-level component of the National Assessment of Educational Progress (NAEP). In each of these years, all eighth graders in the state were also required to participate in the state's accountability testing, which included the reading…

End-of-course examinations are only as good as the assumptions used in designing them. What is a course's "essential" content? And what does it mean to master it? The end-of-course examinations developed by ACT are derived from assumptions that offer unique and challenging answers to these questions. This brief explains the process used to develop…

This policy brief is based on a lengthier report, "Measuring What Counts: A Conceptual Guide for Mathematics Assessment." It proposes that mathematical assessment of students be based on crucial research-based connections between assessment and standards for curriculum and teaching and suggests a framework to help those who are…