TY - JOUR
T1 - Estimating intercoder reliability
T2 - A structural equation modeling approach
AU - Feng, Guangchao Charles
PY - 2014/7
Y1 - 2014/7
N2 - Intercoder reliability is usually estimated with a summary index, and yet the limitations concerning the indexing approach have been well noted. This study critically reviewed all the existing major modeling approaches to estimating intercoder reliability, and empirically tested and further compared these approaches. It was found that latent variable modeling, also called the second-generation SEM, generally perform better than log-linear modeling, and is able to explain the paradox haunting some indices, and to spot the sources of disagreement among coders. Implications were discussed at last.
AB - Intercoder reliability is usually estimated with a summary index, and yet the limitations concerning the indexing approach have been well noted. This study critically reviewed all the existing major modeling approaches to estimating intercoder reliability, and empirically tested and further compared these approaches. It was found that latent variable modeling, also called the second-generation SEM, generally perform better than log-linear modeling, and is able to explain the paradox haunting some indices, and to spot the sources of disagreement among coders. Implications were discussed at last.
KW - Intercoder reliability
KW - Modeling
KW - SEM
UR - http://www.scopus.com/inward/record.url?eid=2-s2.0-84902366470&partnerID=MN8TOARS
U2 - 10.1007/s11135-014-0034-7
DO - 10.1007/s11135-014-0034-7
M3 - Journal article
SN - 0033-5177
VL - 48
SP - 2355
EP - 2369
JO - Quality and Quantity
JF - Quality and Quantity
ER -