To help explain the differences in students' performance on internationally administered science assessments, cross-national, video-based observational studies have been advocated, but none have yet been conducted at the elementary level for science. The USA and Germany are two countries with large formal education systems whose students…

This article investigates several questions regarding the impact of different item formats on measurement characteristics. Constructed response (CR) items and multiple choice (MC) items obviously differ in their formats and in the resources needed to score them. As such, they have been the subject of considerable discussion regarding the impact of…

The article reports on a comparative study of the abilities of aphasic speakers and normal control subjects to comprehend and produce verbs and sentences. The analysis is based on test results obtained as part of the standardization procedure for a test battery originally developed for Dutch and since translated and adapted for English and…

This paper illustrates a method to study rater severity across exam administrations. A multi-facet Rasch model defined the ratings as being dominated by four facets: examinee ability, rater severity, project difficulty, and task difficulty. Ten years of data from administrations of a histotechnology performance assessment were pooled and analyzed…

Scaling is carried out in an effort to increase the comparability of scores obtained on different tests. This study explored the relationships between College Board Achievement Test scores and potential scaling covariates for various subgroups of the test-taking population with the goal of providing several alternatives to traditionally used…

Test data from a large licensure examination were used to investigate the impact of the number of score groups and score group size on the Mantel-Haenszel (MH) alpha statistic. Two kinds of quasi-experimental studies were conducted: (1) baseline MH analyses in which the number of score groups and the ethnicity of each randomly equivalent…

Four different systematic methods for selecting passing scores which differ primarily in the types of judgment they require were compared. The borderline group method and the contrasting groups method were each compared with the Nedelsky method at four schools and the Angoff method at another four schools. The Basic Skills Assessment Tests in…

Examines the effect of test method on the reading performance of two levels of early-stage second-language (L2) readers of French. The study compares two global response modes, the summary and the recall protocol. Results indicate a significant qualitative difference in the performance on the two tasks. The summaries contained significantly more…

This study examines the effects on the National Assessment of Educational Progress (NAEP) achievement levels of using item response theory (IRT) models that have nominal missing-response parameters. It compares cutpoints based on item parameters that were fitted using two different models. The first set of cutpoints were based on parameters for…

To generalize test results beyond the particular test administration, an examinee's ability estimate must be independent of the particular items attempted, and the item difficulty calibrations must be independent of the particular sample of people attempting the items. This stability is a key concept of the Rasch model, a latent trait model of…

Grade-equivalent scores are widely used in the school system in reporting students' performance on standardized achievement tests. This paper explores how grade equivalent scores are calculated and interpreted. In addition, the paper examines the limitations of grade-equivalent scores through the use of small heuristic data sets. A…

This report describes the first of a series of research projects which will attempt to characterize the performance of Hawaii's public school system. The measure of performance was the 1992 National Assessment of Educational Progress (NAEP) mathematics examinations and their linked versions used in the 1991 International Assessment. The NAEP was…

In July 2001, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) agreed to the development of assessment instruments and key performance measures for reporting on student skills, knowledge and understandings in primary science. It directed the newly established Performance Measurement and Reporting Taskforce…

The major goal of this study is to apply the essential unidimensionality statistic of W. Stout and the corresponding computer program (DIMTEST) to a hierarchical level mathematics achievement data set and to determine the extent to which the undimensional assumption can be accurately applied to mathematics achievement data. The study also…

The New Standards Project is a joint effort of the Learning Research and Development Center (LRDC) at the University of Pittsburgh (Pennsylvania) and the National Center on Education and the Economy toward creation of a national examination system based on performance assessments. This study explored the feasibility of comparing performance on…