Scott’s π (1955) and Krippendorff's α (1980) have been among the most-often used or recommended general indicators of reliability. This article presents paradoxes showing that neither can be a general indicator. We show that π or α should be used only when (a) coders enforce a predetermined quota as the first priority and (b) coders maximize chance coding as the second priority. Because the two conditions rarely hold, π or α should rarely be used.
|Publication status||Submitted - Aug 2011|
|Event||Association for Education in Journalism and Mass Communication (AEJMC) 2011 Annual Conference - St. Louis, United States|
Duration: 10 Aug 2011 → 13 Aug 2011
|Conference||Association for Education in Journalism and Mass Communication (AEJMC) 2011 Annual Conference|
|Period||10/08/11 → 13/08/11|