Cited 0 times in

148 46

A Study on Comparison of Generalized Kappa Statistics in Agreement Analysis

Authors
 Kim Min-Seon ; Song Ki-Jun ; Jung In-Kyung ; Nam Chung-Mo 
Citation
 응용통계연구, Vol.25(5) : 719~731, 2012 
Journal Title
 응용통계연구 
ISSN
 1225-066X 
Issue Date
2012
Abstract
Agreement analysis is conducted to assess reliability among rating results performed repeatedly on the same subjects by one or more raters. The kappa statistic is commonly used when rating scales are categorical. The simple and weighted kappa statistics are used to measure the degree of agreement between two raters, and the generalized kappa statistics to measure the degree of agreement among more than two raters. In this paper, we compare the performance of four different generalized kappa statistics proposed by Fleiss (1971), Conger (1980), Randolph (2005), and Gwet (2008a). We also examine how sensitive each of four generalized kappa statistics can be to the marginal probability distribution as to whether marginal balancedness and/or homogeneity hold or not. The performance of the four methods is compared in terms of the relative bias and coverage rate through simulation studies in various scenarios with different numbers of raters, subjects, and categories. A real data example is also presented to illustrate the four methods.
URI
http://ir.ymlib.yonsei.ac.kr/handle/22282913/92448
DOI
10.5351/KJAS.2012.25.5.719
Appears in Collections:
1. 연구논문 > 1. College of Medicine > Dept. of Biostatistics
1. 연구논문 > 1. College of Medicine > Dept. of Preventive Medicine
Yonsei Authors
사서에게 알리기
  feedback
Files in This Item:
T201203721.pdfDownload
Export
RIS (EndNote)
XLS (Excel)
XML

qrcode

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Browse