ERIC Number: EJ742537
Record Type: Journal
Publication Date: 2006
Pages: 13
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0013-1644
EISSN: N/A
Including Omission Mistakes in the Calculation of Cohen's Kappa and an Analysis of the Coefficient's Paradox Features
Simon, Patricia
Educational and Psychological Measurement, v66 n5 p765-777 2006
The application range of Cohen's Kappa is extended to the field of sequential observation data, where omission mistakes of an observer may often occur. It is shown how the omission mistakes can be incorporated into the calculation of the Kappa coefficient without violating the statistic it is based on. The enhanced coefficient is termed Kappa Coefficient With Omission Calculation (K[woc]). In addition, the so-called paradox features of the Kappa coefficient, the base-rate problem, and the observer bias are discussed. It is shown that, in the case of observation data, these attributes are desirable features of the Kappa coefficient. (Contains 2 tables and 2 figures.)
Descriptors: Computation, Statistical Bias, Statistical Analysis, Logical Thinking, Philosophy, Interrater Reliability, Sequential Approach, Error Correction, Observation
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://bibliotheek.ehb.be:2814
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A