Lissitz and Samuelsen (2007) have proposed an operational definition of "validity" that shifts many of the questions traditionally considered under validity to a separate category associated with the utility of test use. Operational definitions support inferences about how well people perform some kind of task or how they respond to some kind of…

The clinical inference process in test interpretation is described so that people can more easily communicate about it, teach it, and learn it. Chapter 1 compares different levels (concrete, mechanical, and individualized) of interpretation of the same test. Chapter 2 offers examples of an often-neglected kind of data necessary for individualized…

The Maryland State Department of Education issued a request for proposals to develop a score reporting system for the Maryland Functional Testing Program. RMC Research Corporation conducted a literature review of extant literature and developed a national survey of non-norm-referenced test score reporting practices. This comprehensive analysis of…

Information on statistical detection of two different kinds of unethical activity associated with standardized testing is presented. The first is advance presentation of specific test items or excessive coaching using items very similar to those on a test. Cluster analysis is recommended for detection of aberrant vectors of percentages correct on…

In 1977 the Dallas Independent School District devised a 5-year state-mandated improvement plan for increasing student test scores in priority goal areas. This paper describes the planning process as it evolved, the problems faced by large districts, and the 5-year student achievement results. The original plan contained eight priority goal areas,…

Data gathered from large-scale assessments in the Ontario Assessment Instrument Pool (OAIP) are examined. Implications for science instruction are to be found at the item level; the items should not involve more than two or three steps if the responses are to be informative. Items are collected and linked to provincial curriculum guidelines. These…

This annual report combines the November, January, April, June, and August provincial results in diploma examination courses in the Alberta (Canada) schools. The graphs, tables, and text describe student performance for the entire school year. The report is designed to assist school personnel in identifying patterns of students' achievement in the…

This annual report combines the November, January, April, June, and August provincial results in diploma examination courses in Alberta, Canada. The graphs, tables, and text describe student performance for the entire school year. The report is designed to assist school personnel in identifying patterns of student achievement in Alberta and…

The effects of failing to pass a high school exit exam were examined for the Georgia Basic Skills Test (GBST). Data were collected on a random sample of students who were tenth graders in 1983 and in 1984. The following issues were studied: (1) impact of failure on self esteem, as measured by the Piers-Harris Children's Self-Concept Scale (P-H);…

A multi-purpose, multi-user evaluation system was designed to improve the quality of the reporting of information gathered in testing and evaluation practices. One part of the system, the reporting system for information resulting from a district standardized testing program, was described. The Student-Problem Package software was modified to…

A variety of methods are used by the Austin (Texas) Independent School District to report the results of student achievement testing. These techniques were developed to alleviate some of the problems that occurred previously: (1) a school's average score represents very few of its students because large numbers of students score very high or very…

A study of the correlates of cognitive achievement in Pennsylvania's Educational Quality Assessment Program was conducted by examining both individual (student level) and ecological (building level) correlations. Analyses were completed for grade levels 5, 8 and 11 for the 1985 state assessment. Twenty-four student derived condition variables or…

Describes development of a comprehensive computer literacy assessment battery for K-12 curriculum based on objectives of a curriculum implemented in the Worldwide Department of Defense Dependents Schools system. Test development and field test data are discussed and a correlational analysis which assists in interpretation of test results is…

This research examined student demographic (gender, ethnicity, grades, and previous home economics experience) and geographic (rural/urban school locale and individual school) factors that may be related to performance on a statewide New Mexico achievement test under development in the home economics subject matter area of consumer education and…

In 1983 the Maryland State Department of Public Education (MSDE) issued a request for proposals for "The Development of the Score Reporting System for the Maryland Functional Testing Program." The MSDE called for a literature review, a national survey, a statewide survey of user needs and capabilities, an assessment of the state's report…