TY - JOUR
T1 - Intercoder reliability indices: Disuse, misuse, and abuse
AU - Feng, Guangchao Charles
PY - 2014/5
Y1 - 2014/5
N2 - Although intercoder reliability has been considered crucial to the validity of a content study, the choice among them has been controversial. This study analyzed all the content studies published in the two major communication journals that reported intercoder reliability, aiming to find how scholars conduct intercoder reliability test. The results revealed that some intercoder reliability indices were misused persistently concerning the levels of measurement, the number of coders, and the means of reporting reliability over the past 30 years. Implications of misuse, disuse, and abuse were discussed, and suggestions regarding proper choice of indices in various situations were made at last.
AB - Although intercoder reliability has been considered crucial to the validity of a content study, the choice among them has been controversial. This study analyzed all the content studies published in the two major communication journals that reported intercoder reliability, aiming to find how scholars conduct intercoder reliability test. The results revealed that some intercoder reliability indices were misused persistently concerning the levels of measurement, the number of coders, and the means of reporting reliability over the past 30 years. Implications of misuse, disuse, and abuse were discussed, and suggestions regarding proper choice of indices in various situations were made at last.
UR - http://www.scopus.com/inward/record.url?eid=2-s2.0-84897431266&partnerID=MN8TOARS
U2 - 10.1007/s11135-013-9956-8
DO - 10.1007/s11135-013-9956-8
M3 - Journal article
SN - 0033-5177
VL - 48
SP - 1803
EP - 1815
JO - Quality and Quantity
JF - Quality and Quantity
ER -