Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

An assessment framework is like a blueprint, laying out the basic design of the assessment by describing the mathematics content that should be tested and the types of assessment questions that should be included. It also describes how the various design factors should be balanced across the assessment. This is an assessment framework, not a…

In most large-scale assessments of student achievement, several broad content domains are tested. Because more items are needed to cover the content domains than can be presented in the limited testing time to each individual student, multiple test forms or booklets are utilized to distribute the items to the students. The construction of an…

Validation efforts typically focus around what, exactly, is measured by an instrument(s), and whether what is measured corresponds to the theoretical domain(s) originally specified. The authors' goal for this article is to build instruments focused around measuring the mathematical knowledge used in teaching: not only the content that teachers…

This paper traces some ideas produced by adolescent students when deciding among different explanations of a past situation. For this purpose, a sample of 270 Portuguese students ranging from 12 to 20 years old, attending 7th to 11th grades, was analyzed in a qualitative approach. Students' ideas were mapped through five levels of progression, in…

Technology today offers many new opportunities for innovation in educational assessment through rich new assessment tasks and potentially powerful scoring, reporting and real-time feedback mechanisms. One potential limitation for realizing the benefits of computer-based assessment in both instructional assessment and large scale testing comes in…

The idea that validity should be considered a property of inferences, rather than of assessments, has developed slowly over the past century. In early writings about the validity of educational assessments, validity was defined as a property of an assessment. The most common definition was that an assessment was valid to the extent that it…

Survey of 43 British secondary teachers showed that the National Curriculum positively influenced teaching methods, encouraging greater variety in delivery and more active learning. Concern was expressed that these practices may be hindered if national assessment tests are narrow in nature and content. (SK)

This article reports the performance of 15-year-old Hong Kong students in mathematical literacy in an international study called PISA 2000, in which Hong Kong has topped the list of 41 participating countries/regions, with a mean score significantly higher than all other countries except Japan and Korea. With the conceptual framework developed by…

Test specifications need to take a middle road so that they are not so general that instructional targeting is impossible and not so specific that only unitary assessment targets are fostered. Using illustrative sample items provides a good means of communicating the items eligible to be tested. (SLD)

Describes the development of a history assessment test by Northeast Missouri State University (Kirksville) faculty. Discusses content, problems with design and cooperation, and theories of assessment testing. Includes sample questions demonstrating the cube plan, a technique that involves using a single question to measure three learning…

This paper offers a scenario for how educational assessment might change in response to market forces that affect not only the future of large-scale testing but also society in general. The scenario divides into three generations distinguished by the purpose of testing, test format and content, and the extent to which testing capitalizes on new…

Results are presented from a study of portfolio use for large-scale assessment in the Pittsburgh (Pennsylvania) public schools that are more encouraging for the use of this form of assessment than many other studies have been. Requirements for the psychometric integrity of portfolio assessment are discussed. (SLD)

Psychometrically linking a state criterion-referenced test (CRT) and a norm-referenced test (NRT) to yield NRT information through the CRT was studied with samples of 1,500 to 3,000 elementary school students per subject and grade level in Connecticut. A CRT/NRT link can create a focused and coherent assessment system. (SLD)

This handbook has been written for college teachers regardless of their prior training in pedagogy, assessment, or education. It is a practical handbook, designed for easy reference. Part 1 can provide either an introduction to Classroom Assessment or a comprehensive review, depending on the reader's prior experience. The first chapter explains…