The goal of this paper is to examine the psychometric properties of a live-coded behavioral measure of joint attention, the "Attention-Following and Initiating Joint Attention Protocol" (JA Protocol), in order to assist researchers and clinicians in identifying when this measure may meet their joint attention assessment needs. Data from…

Examines the tendency of observers to make less reliable recordings of behavorial events when a calibrating observer is absent. Using four different multicategory systems, 26 experienced observers coded 200 hours of videotaped family interactions. Concludes that observers lapse into a less attentive "set" prior to coding without a…

Eighteen adolescents and adults with severe/profound intellectual disability were rated by two staff members using the Motivation Assessment Scale to identify variables maintaining their aggressive behaviors. Analysis of interrater reliability indicated that for some individuals the scale may not represent a feasible alternative to more formal…

This study tested the interrater reliability of the Modified Ashworth Scale in measuring upper and lower limb spasticity in 34 hemiplegic adult patients examined by 2 physiotherapists and 2 doctors. Findings indicated satisfactory reliability for upper limb spasticity but less satisfactory results for lower limb spasticity. (DB)

Development of the Stereotyped Behavior Scale for adolescents and adults with mental retardation is described. Use with 600 individuals resulted in refinement and a 26-item scale with an internal consistency alpha of 0.88, test-retest reliability of p=0.90, and interrater reliability of p=0.76. (DB)

The Quebec Adaptive Behavior Scale (QABS) is widely used in Quebec (Canada) to assess behavior of people with mental retardation in educational, vocational, residential or hospital settings. This study estimated the interrater agreement and test-retest reliability of the QABS. To determine test-retest reliability, the QABS was completed by 27…

Generalizability theory, which subsumes classical measurement theory as a special case, provides a general model for estimating the reliability of observational rating data by estimating the variance components of the measurement design. Research data from the "Heart Smart" health intervention program were analyzed as a heuristic tool.…

This study, involving 24 children or adolescents with pervasive developmental disorders, assessed 3 autism scales: Autism Behavior Checklist, Real Life Rating Scale, and Childhood Autism Rating Scale. The study analyzed interrater reliability, correlations between pairs of the three scales, diagnostic classification cutoff scores, and…

The purpose of this study was to compare the scoring of Teacher Performance Assessment Instruments (TPAI) indicators using discrete descriptors when some are considered "essential" with the scoring of these same indicators, and when no descriptors are considered essential. The two questions addressed in this study were: (1) To what…

This study identifies distinguishing differences in lecture delivery styles of lecturers rated by students in a large multi-instructor course: the Introduction to Clinical Medicine Course (ICM). The 20 lowest- and highest-rated lecturers of the 1982 and 1983 ICM courses served as the target group. Non-student raters observing the 1984 lectures…

Group process and rating techniques were used to create a scale for measuring severity and frequency of 24 problem behaviors in institutionalized mentally retarded persons. A substantial correlation was found between scores and staff-time allocations, indicating usefulness of the scale as a predictor of staffing requirements for behavior…

The influence of day-to-day variation in teacher performance on the reliability and validity of teacher assessment was examined. An attempt was made to identify and quantify sources of score variation attributable to differences in teacher performance, day of observation, observers, and test subscales; and to determine their effects on reliability…

The interrater reliability of three interaction scales--the Maternal Behavior Rating Scale, the Rating Scales of Mother-Child Interaction, and the Teaching Skills Inventory--were estimated with four statistical techniques. The estimates varied widely, both within and across the three interaction scales. Suggestions are offered to help researchers…

The Autism Diagnostic Observation Schedule, a standardized protocol for observation of social and communicative behavior associated with autism, is described. Data on interrater reliability as well as test-retest reliability and discriminant validity are provided. (Author/DB)

Analyses of the internal consistency of three autism scales--the Autism Behavior Checklist (ABC), the Real Life Rating Scale (RLRS), and the Childhood Autism Rating Scale (CARS)--were conducted with 34 children with pervasive developmental disabilities. Good internal consistency was found for the CARS. Adequate full-scale consistency was found for…