In this study, retrospective interviews were used to investigate reliability (and thus validity) threats to a computerized ESL listening comprehension test administered at a university in the US. The participants in the investigation, six international graduate students, were asked to respond to semi- and open-ended questions during individual…

Recently the Educational Testing Service (ETS) has modified its Student Instructional Report II (SIR II) for use in online distance education courses. The SIR II is a second-generation survey based on more than thirty years of experience with student evaluations (Centra, 1998; Centra and Gaubatz, n.d.). The e-SIR II is based on the highly…

The Third International Mathematics and Science Study (TIMSS) is the most ambitious study conducted by the International Association for the Evaluation of Educational Achievement to date. TIMSS developed and administered tests and questionnaires in three student populations to study achievement in participating countries and the factors associated…

A study was conducted by New York's Broome Community College (BCC) to compare student-reported parental income with income reported by the students' parents on their 1982 tax records. Student reports of parental income were obtained from a survey administered to students entering BCC in fall 1983. The college had parents' federal income tax…

Statistical significance is misused in educational and psychological research when it is applied as a method to establish the reliability of research results. Other techniques have been developed which can be correctly utilized to establish the generalizability of findings. Methods that do provide such estimates are known as invariance or…

The Rasch model for test analysis is described and compared with two-parameter and three-parameter latent-trait models. Conditional maximum likelihood equations for estimating item parameters are derived, and estimates of person parameters are described together with their confidence intervals. Goodness of fit tests are discussed, including a…

Based upon an occupational rating instrument entitled the Occupational Analysis Inventory (OAI), this study sought to produce a more stable and interpretable set of OAI job analysis factors. The study was designed (1) to obtain OAI ratings on an additional 600 jobs and thus enlarge the sample to 1,414 jobs and (2) to derive a meaningful set of…

A pilot study was initiated to achieve reliability and especially validity indexes for measuring research and development impact. Two opposing questionnaires were administered to each of three target groups: 164 high school vocational education students, 120 secondary school vocational education teachers, and 56 vocational education…

This technical report discusses the development of a framework for identifying a battery of measures to be used in evaluating Head Start program effects on children 3 to 7 years of age. The report consists of an overview and five chapters, and provides eight appendices (in two additional volumes). Among the topics addressed are background…

This paper reports the development of a Classroom Behavior Inventory and a series of studies which have developed and refined methods for collecting teacher ratings of children's social, emotional and task-oriented behavior from preschool through high school. Findings suggest that the Classroom Behavior Inventory is a relatively economical,…

This research paper is an evaluation of the Dallas County Child Care Council's program and materials for training day care staff. Thirty-five white, middle-class 3-year-old children and their teachers participated in the study. The children were enrolled in two separate day care centers which served as control and experimental environments. The…

The major interest of this study was to examine the interaction between selected ethnic cues in the aural and visual channels and the effect they have on student perception of an information source. Some 186 sixth grade students were divided equally along black and white racial lines into two groups and shown a filmstrip on drug abuse. Three…

This document consists of 47 consecutive issues of the "Parent and Preschooler Newsletter." This newsletter is variously subtitled "A Monthly Exploration of Early Childhood Topics" and "An International Resource for Professionals and Parents." Regularly appearing features are: "Library…

Reviews and summarizes the literature on developmental and behavior problems displayed by young children. Focuses on the definition and classification of problems found in family or child care settings, prevalence of problems as reported by epidemiological studies, and the relative stability of behavior problems from preschool to adolescence.…

Applied a person-centered approach to childhood personality development in 28 diverse samples of 3- to 6-year-olds studied over 6 years. Identified resilient, overcontrolled, and undercontrolled personality types. Found that the undercontrolled personality type related to intellectual decline over 6 years. The number of family risks predicted…