Mistakes and How to Avoid Mistakes in Using Intercoder Reliability Indices

Research output: Contribution to journalJournal articlepeer-review

77 Citations (Scopus)

Abstract

Although intercoder reliability has been considered crucial to the validity of a content study, the choice among them has been controversial. This study analyzed all the content studies published in the two major communication journals that reported intercoder reliability, aiming to find how scholars conduct the intercoder reliability test. The results revealed that some intercoder reliability indices were misused persistently concerning the levels of measurement, the number of coders, and the means of reporting reliability over the past 30 years. Implications of misuse, disuse, and abuse were discussed, and suggestions regarding proper choice of indices in various situations were made at last.
Original languageEnglish
Pages (from-to)13-22
Number of pages10
JournalMethodology
Volume11
Issue number1
DOIs
Publication statusPublished - Jan 2015

User-Defined Keywords

  • intercoder reliability
  • content analysis
  • misuse

Fingerprint

Dive into the research topics of 'Mistakes and How to Avoid Mistakes in Using Intercoder Reliability Indices'. Together they form a unique fingerprint.

Cite this