ERIC Number: EJ958835
Record Type: Journal
Publication Date: 2012
Pages: 7
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0741-9325
EISSN: N/A
Embracing Our Visual Inspection and Analysis Tradition: Graphing Interobserver Agreement Data
Artman, Kathleen; Wolery, Mark; Yoder, Paul
Remedial and Special Education, v33 n2 p71-77 Mar-Apr 2012
Most investigators using single-case experimental designs use interobserver agreement (IOA) checks to enhance the credibility of the collected data, and they report the results of those assessments using percentage of agreement estimates. An alternative is to graph both observers' records of the measured behavior on the primary study graphs. Such graphing leads to greater transparency and is advocated for five reasons: (a) to make explicit how IOA assessments were distributed across the study, (b) to ensure agreement estimates are reported at the level of the measured behavior of interest rather than a broader observational code, (c) to detect observer drift, (d) to detect the effect of observer expectations, and (e) to put the IOA data in a more suitable context for assessing the internal validity of the study by eliminating the need for an arbitrary agreement criterion. (Contains 3 figures.)
Descriptors: Research Methodology, Inspection, Interrater Reliability, Research Design, Credibility, Behavior Change, Intervention, Evaluation
SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://bibliotheek.ehb.be:2814
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A