It is argued that publishers of achievement tests, especially those who publish tests intended for use in many parts of the United States, are for the most part not in a position to obtain any decent evidence about the consequences of the uses that are made of their tests. What responsibilities and actions publishers can reasonably be expected to…

Explains achievement test scores, focusing on types, uses, meanings, and relative importance. Describes currently used scales, normal distribution curves, percentile ranks, grade equivalents, and other rating systems. Advises inclusion of more than one kind of standardized test score, since each provides different information. Includes three…

The Comprehensive Tests of Basic Skills, Form U, is scored in two ways: number-correct and pattern. The latter makes use of the information about which particular items are answered correctly, giving more weight to the more discriminating items and making allowances for guessing. Critics have suggested that black students are penalized by pattern…

Discussions of "test curriculum overlap" that focus on the term "mismatch" tend to be based on several untenable premises. This paper addresses the issue of the degree to which standardized tests should reflect the specific content of a given school curriculum with regard to three points: (1) The idea of matching the content of…

Uses of the variety of scores generated by standardized achievement tests are discussed. Desirable characteristics of scales, raw score scales, percent of correct items, percentile ranks, grade equivalents, normal curve equivalents, and scale scores are considered. The various meanings and purposes of each type of score are discussed. It is…

Differential functioning of males and females on achievement test items was studied in a sample of 110,000 students in kindergarten through grade 12. First, item parameters and ability estimates for these parameters were obtained from LOGIST computer program runs for the entire group. Predicted performance for each item for each group was…

Improved communication and cooperation between test publishers and school systems is essential for solving major test problems. Test-curriculum matching, test equating, and inappropriate use of grade equivalent scores are major problem areas. The degree to which a standardized test yields information relevant to what the system is trying to teach…

During the past few years the problem of bias in testing has become an increasingly important issue. In most research, bias refers to the fair use of tests and has thus been defined in terms of an outside criterion measure of the performance being predicted by the test. Recently however, there has been growing interest in assessing bias when such…

The use of item banks and item response theory has resulted in new ways to misinterpret and misuse tests through customized, yet standardized, achievement test batteries. The new test batteries create the possibility of serious misunderstandings based on the idea that any subset of items from the pool with a proper range of difficulties will…

The passage dependence of an item refers to the degree to which it is necessary to read the associated passage in order to be able to answer that item correctly. This paper studies the value of obtaining data about passage dependence in the construction of reading comprehension achievement tests. Passage dependence indices were examined in several…

This paper is concerned with the accusations made by such groups as the Association of Black Psychologists in their call for a moratorium on testing, that standardized tests are biased. A biased test measures one trait in one group of people but a different trait in a second group. Evidence about the amount of bias in tests is thin. Bias must be…

This paper discusses the relationship of the content of nationally standardized and normed achievement tests and that of local school curricula and the effect that relationship has on the meanings and uses of the test scores. The following questions are considered: (1) whether tests have to match what is taught to be useful; (2) whether it is fair…

An assessment of the Philadelphia (Pennsylvania) City-Wide Testing Program is presented to determine the effects of using customized achievement tests to achieve multiple purposes. The tests are derived from, or related to, the tests in a nationally standardized test battery, but include items written specifically to measure the local curriculum.…

Scores on the Prescriptive Reading Inventory, the California Achievement Tests, 1970 Edition, the the Short Form Tests of Academic Aptitude were obtained for black pupils and representative samples of pupils in grades 1-3. These scores were compared in an attempt to asses bias in the Prescriptive Reading Inventory, a criterion-referenced…

To determine if tryout samples typically used for item selection contribute to test bias against minority groups, item analyses were made of the California Achievement Tests using seven sub-groups of the standardization sample: Northern White Suburban, Northern Black Urban, Southern White Suburban, Southern Black Rural, Southern White Rural,…