Measures of response agreement for qualitative data: some generalizations and alternatives.

RJ Light - Psychological bulletin, 1971 - psycnet.apa.org
RJ Light
Psychological bulletin, 1971psycnet.apa.org
Notes that various procedures are available for measuring agreement among 2 or more os
who classify responses among nominal categories, but that different problem situations
require different measures. The general model of a contingency table with fixed margins is
used to suggest (a) a measure of level of agreement among several os when compared
internally,(b) a conditional measurement of agreement for several os compared internally,(c)
a test for the joint agreement of several os when compared with a standard, and (d) a …
Abstract
Notes that various procedures are available for measuring agreement among 2 or more os who classify responses among nominal categories, but that different problem situations require different measures. The general model of a contingency table with fixed margins is used to suggest (a) a measure of level of agreement among several os when compared internally,(b) a conditional measurement of agreement for several os compared internally,(c) a test for the joint agreement of several os when compared with a standard, and (d) a statistic for evaluating the pattern of agreement between 2 os. Illustrations are presented for each situation, and results of a monte carlo study of the behavior of the pattern agreement statistic are discussed.(19 ref.)(PsycINFO Database Record (c) 2016 APA, all rights reserved)
American Psychological Association