In order to obtain concrete information to improve test writing, this study analyzes 13 achievement test drafts written by graduate teaching assistants, lecturers, and adjunct faculty teaching introductory and intermediate college Spanish. The analysis focuses on factors of test method and content likely to create variance in test performance…

This technical report describes a study that was undertaken to compare the content of two recent fourth-and eighth-grade assessments in science: the NAEP 2000 assessment and the Trends in International Mathematics and Science Study (TIMSS) 2003 assessment. Its aim is to provide information that will be useful for interpreting and comparing the…

The use of a variation of linear programing (goal programing) to develop a test blueprint with multiple specification requirements, is the topic of this paper. The computer program STORM was used to develop a table of test specifications for a test that would measure achievement in introductory statistics in the subdomains of frequency…

This review of the Peabody Individual Achievement Test--Revised (often used with learning-disabled students) notes the addition of a Written Expression subtest, replacement of most items to reflect current curricular content, and use of updated norms. The test also measures: general information, reading recognition, reading comprehension,…

Describes the development of a history assessment test by Northeast Missouri State University (Kirksville) faculty. Discusses content, problems with design and cooperation, and theories of assessment testing. Includes sample questions demonstrating the cube plan, a technique that involves using a single question to measure three learning…

Studied whether student scores on standardized tests represent reasonable measures of instructional quality using ratings by 10 parents and 11 educators (school principals) of the degree to which test items from a nationally marketed standardized achievement test represent the content actually taught. On average, raters felt that test items…

An expanded version of the method of content evaluation proposed by S. G. Sireci and K. F. Giesinger (1992) was evaluated with respect to a national licensure examination and a nationally standardized social studies achievement test. Two groups of 15 subject-matter experts rated the similarity and content relevance of the items. (SLD)

A study was conducted to provide empirical evidence to answer the question of whether student scores on standardized achievement tests represent reasonable measures of instructional quality. Using a research protocol designed by W. Popham and the local study directors, individual test items from a nationally marketed standardized achievement test…

Examined 6 widely used grade-8 standardized tests for content, required processes, and level to determine their alignment with the 5-8 NCTM "Curriculum and Evaluation Standards." Concluded that these tests inadequately covered the 5-8 standards. A follow-up study examined items from newly developed and foreign tests to demonstrate the…

Most seasoned test developers recognize the importance of thoughtful decision making when constructing a test. Unfortunately, many classroom achievement tests are created by novice test developed who have not received sufficient instruction in item writing (G. Gulliksen, 1986; R. J. Stiggins, 1991). The result is often a test that is poorly…

For several decades, the Iowa Tests of Basic Skills (ITBS) held the preeminent role in measuring student and school performance in the Chicago Public Schools (CPS), Illinois. In the context of the No Child Left Behind act and new calls for accountability, the CPS has decided to include results from the Illinois Standard Achievement Test (ISAT) in…

Tests can be categorized into two major groups: norm-referenced tests (NRTs) and criterion-referenced tests (CRTs). NRTs are designed to highlight achievement differences between and among students to produce a dependable rank order of students across a continuum of achievement from high achievers to low achievers. With NRTs, a representative…

Norm-referenced tests (NRT) help compare the performance of one student with the performances of a large group of students, while criterion-referenced tests (CRT) focus on "what test takers can do and what they know, not how they compare to others" (Anastasi, 1988). Both types of test can be standardized so that scores can be interpreted the same…

This investigation examined the effects and consequences of using testing accommodations, including reading aloud test content, with a group of eighth-grade students (N = 79) on a standardized reading test. Research questions pertaining to the effects of accommodations on reading test scores and consequences of testing on teacher and student…

This handbook provides guidelines for instructors to follow in developing test items for occupational task lists. It begins with directions for task analysis: identifying major performance steps of a task, identifying supporting knowledge for each performance step, identifying supporting performance skills for each performance step, identifying…