This paper discusses issues arising in the design of questions to use in an on-line computer-based formative assessment system, focussing on how best to identify the stages of a learning hierarchy for reporting to teachers. Data from several hundred students is used to illustrate how design decisions have been made for a test on interpreting line…

Gender differences of gifted and talented students in mathematics performance were examined using the Louisiana Educational Assessment Program (LEAP) of 1995. The LEAP test is a statewide criterion-referenced test administered to all Louisiana public school children in Grades 3, 5, 7, 10, and 11. In this study, the database was restricted to…

Multiple matrix sampling is a sampling design in which both test items and examinees are randomly sampled from their respective populations. This study was designed to develop and assess a method for computing an estimate of a correlation coefficient when a multiple matrix sampling design is used. The examinee populations included 212 third-grade…

The most popular methods for setting passing scores and other standards on educational tests rely heavily on subjective judgment. This paper presents and evaluates a new procedure for setting and evaluating standards on tests based on cluster analysis of test data. The clustering procedure was applied to a statewide mathematics proficiency test…

The educational television series "Across Cultures" was evaluated to examine the effectiveness of the series and how the programs were structured to attain objectives. Designed to complement sixth- and seventh-grade social studies textbooks, the series on world cultures is composed of thirteen 15-minute programs about three widely…

This document describes in depth a reading and writing project implemented at the sixth, seventh, and eighth grade levels at a public school in Portland, Oregon. The objectives of the Title I project--to improve students' reading and writing skills and to evaluate that improvement--are outlined, and each component of the program is described in…

The influence of day-to-day variation in teacher performance on the reliability and validity of teacher assessment was examined. An attempt was made to identify and quantify sources of score variation attributable to differences in teacher performance, day of observation, observers, and test subscales; and to determine their effects on reliability…

This study was part of a larger study investigating the influence of group collaboration during a group assessment on performance of the group and subsequent widespread performances. This study compared the verbal interactions of students while they completed a science assessment in small collaborative groups with their performance on the same…

Internal structure and external validity of 39 multiple-choice visual arts achievement test items were examined. These items were developed to assess grade 3 visual arts achievement for a statewide model of a fine arts curriculum. Item responses were evaluated in terms of: (1) fit to the one-parameter Rasch measurement model; (2) item-total…

The use of a generative and evaluative computerized prompting framework to improve the teaching of writing skills was studied with 164 children in grades 6, 7, and 8 with high or low writing skills, who were randomly assigned to control or treatment groups. The treatment group received computer prompts, think sheet scaffolds, and expert modeling…

The National Science Foundation is sponsoring 26 Statewide Systemic Initiative Projects to promote innovative curricula for teaching mathematics and science. A plan for evaluating and assessing systemic change has been designed and implemented at one of them in Puerto Rico. The perspective used to guide this paper is based on the principles that…

To help determine how the introduction of alternate assessment can be structured to maximize its acceptance and long-term adoption by teachers, a case study was conducted of the introduction of alternate assessment in a suburban middle school in the spring of 1991. Three seventh-grade life science teachers, three eighth-grade physical science…

This is a record of the proceedings of the 30th annual conference of the Mathematics Education Research Group of Australasia (MERGA). The theme of the conference is "Mathematics: Essential research, essential practice." The theme draws attention to the importance of developing and maintaining links between research and practice and…