Assessment of interjudge reliability in the open-ended questions coding process

作     者：Leiva, Francisco Munoz Rios, Francisco Javier Montoro Martinez, Teodoro Luque 

作者机构：Univ Granada Dept Mkt & Market Res Fac Econ & Business Sci E-18071 Granada Spain 

出 版 物：《QUALITY & QUANTITY》 (质与量)

年 卷 期：2006年第40卷第4期

页      面：519-537页

核心收录：

学科分类：0303[法学-社会学] 03[法学] 0714[理学-统计学（可授理学、经济学学位）] 

基　　金：EU FEDER Spanish National R&D Plan 

主　　题：interjudge reliability open-ended questions concordance coefficients coding process 

摘      要：In the process of coding open-ended questions, the evaluation of interjudge reliability is a critical issue. In this paper, using real data, the behavior of three coefficients of reliability among coders, Cohen s K, Krippendorff s alpha and Perreault and Leigh s I (r) are patterned, in terms of the number of judges involved and the categories of answer defined. The outcome underlines the importance of both variables in the valuations of interjudge reliability, as well as the higher adequacy of Perreault and Leigh s I (r) and Krippendorff s alpha for marketing and opinion research.