This meta-analysis investigates the effects on achievement of type of graphing paper employed in displaying student performance data collected over time. Ongoing curriculum-based measurement systems employing Data-Based Program Development (DBPD) provide a data source of 16 controlled studies with 17 effect sizes. A total of 3,494 subjects…

This study compares intra- and inter-rater agreement and reliability when using three different rating form formats to assess the same stimuli. One format requests assessment by marking detailed criteria without an overall judgement; the second format requests only an overall judgement without the use of detailed criteria; and the third format…

In this paper 45 item-writing rules for multiple-choice tests presented in textbooks on educational measurement in a previous study are identified. The current study presents a quantitative review of the literature with respect to the empirical and theoretical evaluation of these principles of item-writing. Fifty-six studies that addressed at…

A set of instruments was developed to study children's social networks. Mothers and their preschool-age children were interviewed with regard to (1) the composition of each child's social network and (2) the performance of support functions by network members. To determine the reliability of measures, a pilot sample of mothers and children was…

This report outlines the stages of development and validation of the Attitude Toward the Subject Science Scale (ATSSS). The instrument, developed in accordance with the Ajzen and Fishbein (1980) theory of attitude assessment, can be used by junior secondary science teachers or administrators to assess student attitudes toward the subject science…

An alternative procedure is examined to compare test scores which does not require the utilization of computers and therefore, can be easily employed by classroom teachers. This technique is called the Average System: a simple way to score examinees using information obtained from a representative sample (or samples). Examinees are ranked on a…

A program evaluation was conducted of a summer program for academically gifted students in 5th through 10th grades. The purpose of this study was to evaluate discrepancies and congruencies among program teachers, counselors, and students in perceptions of program goal emphasis. The evaluation instrument used was a rating form composed of 60 goal…

Inspired by four recent decisions to change achievement tests used in the Austin Independent School District, the separate forms used and procedures followed have been combined into a systematic approach intended for use in future achievement test selections. A rating scale (Attachment 1) was developed to expedite a systematic comparison among…

The Assessment Resource Center (ARC) at Florida State University provides computer assisted testing (CAT) for approximately 4,000 students each term. Computer capabilities permit a small proctoring staff to administer tests simultaneously to large numbers of students. Programs provide immediate feedback for students and generate a variety of…

Several analyses were performed as part of the process of validating a recently developed scale to measure the attitudes of students toward writing. The Florida Writing Project Student Survey is a 25-item measure of writing attitudes designed for use with students in grades six through twelve. It was developed to assess the attitudes of students…

The objectives for this study were to: (1) develop a valid, reliable measure of test-wiseness with equivalent forms for use with students in the health sciences; and (2) determine the level of test-wiseness of entering medical students. The test-wiseness areas included in this study were: similar options, umbrella term, item give-away, convergence…

As data on the reliability and validity of ratings of infant temperament have accumulated, researchers have begun to ask what caregiver ratings really measure. An argument has been made that ratings of social behavior are less a reflection of enduring individual differences than a measure of rater characteristics and error variance. This study…

The Hiskey-Nebraska Test of Learning Aptitude (H-NTLA) (Hiskey, 1966) has been regarded by reviewers as one of the best instruments for assessing the learning abilities of hearing-impaired children. However, there has been a paucity of research on the validity of this test. Further, there is no established test-retest reliability, and questions…

Despite the popularity of both multiple-choice (MC) and true-false (TF) items, most investigations comparing the two formats have done so to determine the optimum number of choices to be given to students within a given time period. The purpose of this investigation was to compare the reliabilities and the validities of both formats when the items…

The purposes of this study were to examine the reliability and validity of a basal reading series mastery test, and to explore the appropriateness and usefulness of two strategies for investigating the reliability and validity of criterion-referenced tests. Subjects were 47 sixth graders, who were tested on the SRA Reading Achievement Test, the…