Defines computer assisted language testing (CALT), discusses the various processes involved, outlines the advantages and disadvantages, and examines psychometric aspects of computer testing. A table of factors distinguishes between test content and the mechanics of test taking. These factors constitute a table for developing a CALT checklist. (24…

This study is the National Board of Medical Examiners exploration of content-based techniques (standard-setting techniques in which pass/fail decisions are based upon the performance of examinees in relation to test content). Two content-based techniques (Angoff and Ebel) and three methods of evaluating examinee performance were studied. (MLW)

Studied the organizational issues that arose in the implementation of portfolio assessment in 11 eighth and ninth grade classrooms in Ontario, Canada during the field trial of a generic content selection framework. Results suggest the formulation of three sets of research hypotheses related to organizational issues in the portfolio implementation…

In order to obtain concrete information to improve test writing, this study analyzes 13 achievement test drafts written by graduate teaching assistants, lecturers, and adjunct faculty teaching introductory and intermediate college Spanish. The analysis focuses on factors of test method and content likely to create variance in test performance…

This article reports the performance of 15-year-old Hong Kong students in mathematical literacy in an international study called PISA 2000, in which Hong Kong has topped the list of 41 participating countries/regions, with a mean score significantly higher than all other countries except Japan and Korea. With the conceptual framework developed by…

This technical report describes a study that was undertaken to compare the content of two recent fourth-and eighth-grade assessments in science: the NAEP 2000 assessment and the Trends in International Mathematics and Science Study (TIMSS) 2003 assessment. Its aim is to provide information that will be useful for interpreting and comparing the…

This study seeks to determine whether item features are related to observed differences in item difficulty (DIF) between computer- and paper-based test delivery media. Examinees responded to 60 quantitative items similar to those found on the GRE general test in either a computer-based or paper-based medium. Thirty-eight percent of the items were…

The development of the student destination survey instrument was a response to an identified need for a tool to measure the effectiveness of Technical and Further Education (TAFE) programs in Australia. The requirement was for a tool that was flexible in accommodating changing course structures and consistent across state and territory boundaries.…

The use of a variation of linear programing (goal programing) to develop a test blueprint with multiple specification requirements, is the topic of this paper. The computer program STORM was used to develop a table of test specifications for a test that would measure achievement in introductory statistics in the subdomains of frequency…

Content integration in performance assessment involves mixing different areas of knowledge in one assessment. In this type of testing situation, assessment tasks are designed to measure the ability of students to solve problems by applying their knowledge and skills in multiple content areas. This study examined the effect of integrated science…

Data from four different school sites nationwide were analyzed to examine whether standardized test results may be confounded by the lack of language proficiency of English language learners. Several analyses comparing the performance of limited English proficient (LEP) students and their non-LEP classmates revealed major differences. A Disparity…

Two studies compared the performance of Puerto Rican and African American Head Start children (total n=134) on familiar (description) and unfamiliar (one word labeling) test tasks. Results indicated children performed better on the familiar test task, which was also more sensitive in differentiating typically developing children from those with…

Twenty-two children with mild mental retardation, 27 children with learning disabilities, and 49 nondisabled peers (ages 4-5) were presented with a battery of eight cognitive tasks being considered for inclusion in a new screening test. Results found the components measured different cognitive tasks and led to accurate individual classification…

Studied whether student scores on standardized tests represent reasonable measures of instructional quality using ratings by 10 parents and 11 educators (school principals) of the degree to which test items from a nationally marketed standardized achievement test represent the content actually taught. On average, raters felt that test items…

This report reviews the historical development of out-of-level testing, from its inception in Title I evaluation work during the 1960s, to the present day when the widespread use of assessments or district and school accountability has been combined with requirements for including all students in assessments. This report examines the historical…