CSCL research has given rise to a plethora of analysis methods, all with specific analysis goals, units of analysis, and for specific types of data (chat, threaded discussions, etc.). This article describes some challenges of CSCL-analysis. The development of an analysis method for negotiation processes in multidisciplinary teams serves as an…

Based upon the assumption that the process of peer review of publications and research is flawed, interrater reliability of reviews of 188 research proposals submitted for funding at a major university was studied. The eight dimensions rated were: (1) significance of the research; (2) clarity and reasonableness of the objectives; (3)…

Examines the tendency of observers to make less reliable recordings of behavorial events when a calibrating observer is absent. Using four different multicategory systems, 26 experienced observers coded 200 hours of videotaped family interactions. Concludes that observers lapse into a less attentive "set" prior to coding without a…

Four experienced stuttering researchers viewed videodisks of spontaneous speech from chronic stutterers and attempted to locate the precise onset and offset of individual stuttering events. Results showed interjudge disagreements that challenge the reliability and validity of onset and offset judgments. Highly agreed stuttering events were…

The Correct Information Unity analysis for measuring the communicative information and efficiency of connected speech was applied to the naturally occurring conversation of a person with moderate aphasia. Results indicated low intrarater and interrater reliability although reliability of word counts was good. Most rater disagreements resulted from…

This study was designed as a reconsideration of the weights used in evaluative decisions made with regard to research proposals submitted for funding at a major state university. The specific objective of the study was to determine whether the actual weights for components used in the evaluation of the proposals differed from a priori weights…

Eighteen adolescents and adults with severe/profound intellectual disability were rated by two staff members using the Motivation Assessment Scale to identify variables maintaining their aggressive behaviors. Analysis of interrater reliability indicated that for some individuals the scale may not represent a feasible alternative to more formal…

Reliability analysis of the Motivation Assessment Scale was conducted on subscales completed by staff members working with 47 institutionalized adults with severe to profound mental retardation and self-injurious behavior problems. Internal consistency was found to be superior to interrater reliability. The instrument's internal consistency…

Sixty-five pairs of teachers and parents of elementary and secondary school learning-disabled students completed the Homework Problem Checklist (HPC). The HPC demonstrated a moderate level of interrater reliability. Acceptable levels of internal consistency were reported for both teacher and parent ratings. (JDD)

Forty neuropsychologists, neurologists, psychiatrists, and physiatrists identified neurologically relevant items (NRIs) in the Minnesota Multiphasic Personality Inventory-2 (MMPI-2). Raters identified four sets of NRIs: one for brain damage in general and three partially overlapping sets for stroke, traumatic brain damage, and whiplash.…

Early identification of social-emotional behavioral problems in infants and preschoolers is critical. Nine parent-report and caregiver/teacher-report instruments measuring preschool social-emotional behavioral problems and strengths are reviewed. Advantages to the use of parent-report and caregiver/teacher-report instruments are that they are easy…

Until recently, research studies have implied that domestic violence does not affect Asian American and immigrant communities, or even Asians abroad, because ethnicity or culture has not been addressed. In this content analysis, the authors examined trends in publications in leading scholarly journals on violence relating to Asian women and…

As part of a new teacher evaluation program initiated by the local school board, the Charleston County School District (South Carolina) adopted the Assessments of Performance in Teaching (APT) as a major evaluation tool to assess the teaching performance of annual contract teachers. Since evaluation procedures can ultimately lead to teacher…

Thirty-two children aged 7 to 12 participated in a study to determine the reliability of the Ekwall Reading Inventory (ERI) and the Classroom Reading Inventory (CRI). The children were randomly assigned to take one of the two inventories, which were administered by four different specially trained teachers. The study used a test-retest design, in…

Using instructional variables identified by the literature as important in predicting classroom achievement, a bi-polar rating scale was designed to assess the structure of instruction in resource rooms. The data for 158 elementary school children in four school districts were analyzed. The scale evidenced good reliability, both in terms of…