Faculty opinions of an evaluation program for medical school clinical tutors were obtained through a survey of 24 undergraduate clinical tutors. Although students had been using the evaluation instrument to rate teachers for five years, faculty expressed many reservations about its reliability and validity. (SLD)

Describes a method for assessing the quality of translations based on item response theory (IRT). Results from the IRT technique with French and Chinese versions of a scale measuring individualism-collectivism for samples of 250 U.S., 357 French, and 290 Chinese undergraduates show how several biased items are detected. (SLD)

Among concepts that seem to be the guardian angels of school reform, coherence is a rebel angel, advancing human learning, but escaping control. Coherence must not be confused with consistency. It allows for change and imagination but remains true to concepts and experiences that construct coherence without fabricating consistency. (SLD)

Describes a study of the validity and reliability of a writing skills assessment test taken by 4,284 2-year college students in 1986-87. Assesses interrater reliability, influences of nonperformance factors (e.g., gender, native language, and form of test), predictive validity of test for future performance, and implications of findings. (DMM)

The assumption that reliability is a necessary but insufficient condition for validity in assessment is challenged by exploring a dialectic between psychometric and hermeneutic approaches to drawing and warranting interpretations of human products of performance. Hermeneutic alternatives for epistemological and ethical purposes expand the range of…

This paper investigates the psychometric properties of the African Self-Consciousness (ASC) Scale in a noncollege heterogeneous population of 147 African Americans to determine the reliability and validity of the ASC Scale. Based on analysis of the scale's reliability, factor structure, and construct validity, the study shows the ASC Scale to be a…

Constructed School Social Behavior Scales (SSBS) to include teacher-related and peer-related forms of social competence and antisocial behavior. Standardized SSBS using teacher ratings on 1,858 kindergarten through grade 12 students across United States Evidence presented from several related studies in present investigation indicated that SSBS…

A review of 36 social interaction measures found that there are no measures available to evaluate infants and preschool children's basic capacity for social interaction. The available measures are described and grouped into parent-child interaction, social skills, social competence, play, adaptive behavior, communication, general development, and…

Describes research on the development of a measure of student metacognition. The brief, domain-independent measure serves as a collateral measure in construct validation, supporting exploration of the self-regulatory demands of performance assessment. Results show that metacognition can be directly and explicitly measured in the context of…

Examined the role of fourth graders' social self-perceptions in their social development. Found significant relationships among self-perception measures, and they were moderately stable over the school year. Found significant sociometric status and gender effects for generalized and dyadic perceptions. Inaccurate social self-perceptions predicted…

This study examined the psychometric properties of performance measures for three novel, interactive virtual reality vignette exercises developed to assess social competency skills of at-risk adolescents. Performance data were collected from 117 African-American male 15-17 year olds. Data for 18 performance measures were obtained, based on…

By the spring of 2000, forty states had begun using student test scores to rate school performance. Twenty states have gone a step further and are attaching explicit monetary rewards or sanctions to a school's test performance. In this paper, the authors focus on accountability programs in which states measure the effectiveness of individual…

In this study, retrospective interviews were used to investigate reliability (and thus validity) threats to a computerized ESL listening comprehension test administered at a university in the US. The participants in the investigation, six international graduate students, were asked to respond to semi- and open-ended questions during individual…

Recently the Educational Testing Service (ETS) has modified its Student Instructional Report II (SIR II) for use in online distance education courses. The SIR II is a second-generation survey based on more than thirty years of experience with student evaluations (Centra, 1998; Centra and Gaubatz, n.d.). The e-SIR II is based on the highly…

This article describes efforts to examine the validity of a screening process that provides objective data for multidisciplinary team meetings where consideration is being given to teacher referral of a student for assessment and possible placement in special education. In this study, the accuracy with which this process, called Problem Validation…