Generalizability of performance-based assessment scores across raters and tasks is examined, focusing on implications of generalizability analyses for specific uses and interpretations of assessment results. Although it seems probable that assessment conditions, task characteristics, and interactions with instructional experiences affect the…

Test data from a large licensure examination were used to investigate the impact of the number of score groups and score group size on the Mantel-Haenszel (MH) alpha statistic. Two kinds of quasi-experimental studies were conducted: (1) baseline MH analyses in which the number of score groups and the ethnicity of each randomly equivalent…

This paper explores a logistic regression procedure for estimating item parameters in the Rasch model and testing the hypothesis of item parameter invariance across several groups/populations. Rather than using item responses directly, the procedure relies on "pseudo-paired comparisons" (PC) statistics defined over all possible pairs of…

Scotland, like many countries, has a system of externally-administered syllabus-based examinations, set at two points: the end of compulsory schooling, which serves as a basis for entry to junior college "non-advanced further education" (mainly vocationally oriented); and at the end of grade 12, which serves as a basis for admission to…

A study examined the differences in the essay exam scores of college students who did no planning, some planning, or extensive planning before writing answers to questions on essay exams. Subjects, 100 undergraduate education students enrolled in reading methods classes and 37 graduate reading students enrolled in a psychology of reading class,…

Teacher competency testing for the purpose of screening persons prior to state certification continues to be on the upswing in the United States. Many states have implemented paper-pencil tests, most of which were prepared by Educational Testing Service and National Evaluation Systems. Problem areas to consider when certification tests are used to…

The Maryland State Department of Education issued a request for proposals to develop a score reporting system for the Maryland Functional Testing Program. RMC Research Corporation conducted a literature review of extant literature and developed a national survey of non-norm-referenced test score reporting practices. This comprehensive analysis of…

In the Connecticut School Effectiveness Project, data are collected on seven characteristics of effective schooling: safe and orderly environment, clear school mission, instructional leadership, high expectations, opportunity to learn and time on task, frequent monitoring of student progress, and home-school relations. These data are collected…

The Research Services of the National Education Association (NEA) conducted a nationwide teacher opinion poll (TOP) based upon a stratified disproportionate two-state cluster sample of classroom teachers. This research study was conducted to test the hypothesis that the order of presentation of items would make no difference in the conclusions…

This paper examines some of the issues involved in releasing test results to the press. The first part is based on a survey of National Association of Test Directors members (72 of the 142 members completed a questionnaire on reporting test results to the public). The survey included the following: to whom are results reported; what kind of…

Although isolating the degree of association that exists between a teacher's specific knowledge and his or her particular classroom performance is extremely difficult at best, that is the focus of the knowledge and performance based instruments used in the evaluation of preservice English teachers in the University of Georgia teacher education…

The purpose of this investigation was to examine the interaction of item content and group membership on achievement test items. Estimates of the parameters of the three parameter logistic model were obtained on the 46 item math test for the sample of eighth grade students (N = 2055) participating in the Illinois Inventory of Educational Progress,…

The uses and misuses of standardized test results used for program evaluation as seen by a staff member of an Elementary Secondary Education Act (ESEA) Title I Technical Assistance Center are described. In ESEA Title I, test scores are used to select students for the program. Although federal requirements do not require using standardized test…

Recently the framework of the Concerns-Based Adoption Model was used to guide the implementation of a revised elementary science program in grades 3-6 in the Jefferson County (Colorado) Public Schools. This paper explores how student achievement on a locally developed, criterion-referenced test is related to the length of time the revised science…

A national sample of 3,300 elementary and secondary school teachers, who had recently administered the Metropolitan Achievement Tests in their classrooms, responded to a questionnaire concerning various standardized achievement test issues. Teachers gave their opinion on: the amount of such testing in their schools; personal use of test results;…