检索结果-内蒙古大学图书馆

An approach for selecting and using a method of inter-coder reliability in information management research

interNATIONAL JOURNAL OF INFORMATION MANAGEMENT 2020年 54卷

作者： Nili, Alireza Tate, Mary Barros, Alistair Johnstone, David Queensland Univ Technol Brisbane Qld Australia Victoria Univ Wellington Wellington New Zealand

Qualitative researchers in information management research often need to evaluate inter-coder reliability (ICR) to test the trustworthiness of their content analysis. A suitable method of evaluating ICR enables researchers to rigorously assess the degree of agreement among two or more independent qualitative coders. This allows researchers to identify mistakes in the content analysis before the codes are used in developing and testing a theory or a measurement model and avoid any associated time, effort and financial cost. Different methods have been proposed, but little guidance is available on which approach to evaluating ICR should be used. In this paper, we review and compare leading ICR methods that are suitable for qualitative information management research. We propose an approach for selecting and using an ICR method, supported by an illustrative example. The five steps in our proposed approach include: selecting an ICR method based on its characteristics and requirements of a project;developing a coding scheme;selecting and training independent coders;calculating the ICR coefficient and resolving discrepancies;and reporting the process of evaluating ICR and its results.

关键词： inter-coder reliability Content analysis Information Management

来源：评论

学校读者我要写书评

暂无评论

An Evaluation of inter-coder and Intra-coder reliability for 24-Hour Dietary Recall Data Entered in WebNEERS

引用

JOURNAL OF NUTRITION EDUCATION AND BEHAVIOR 2019年第4期51卷 432-439页

作者： Moore, Carla J. Williams, Tiffany N. Berg, Alison C. Durward, Carrie M. Univ Georgia Dept Foods & Nutr 203 Hoke Smith Annex Athens GA 30602 USA Utah State Univ Dept Nutr Dietet & Food Sci Logan UT 84322 USA

Objective: To evaluate inter-coder (between-coder) and intra-coder (within-coder) reliability among trained data coders who enter 24-hour dietary recall data collected through Expanded Food and Nutrition Education Program operations in the state of Georgia. Design: This study employed multiple cross-sectional evaluations of inter-coder reliability and a short-term longitudinal evaluation of intra-coder reliability. Participants/Setting: Study participants consisted of trained data coders (n = 9) who were employed during the 12-month period of evaluation. Main Outcome Measures: Primary outcome measures were inter-coder and intra-coder reliability across data entered into the Web-based Nutrition Education Evaluation and Reporting System. Statistical analyses were conducted using IBM SPSS 24. Descriptive statistics were generated and inter-coder and intra-coder reliability were assessed using 2-way mixed intraclass correlation coefficients. Results: Results of this evaluation indicated good to excellent inter-coder reliability among all coders, and excellent intra-coder reliability among the majority of coders. However, some notable inconsistencies were identified within the intra-coder reliability analyses. Conclusions: Future strategies to improve data quality within Expanded Food and Nutrition Education Program operations might include enhanced training for data coders, implementation of error detection protocols, expansion of the Web-based Nutrition Education Evaluation and Reporting System database, and exploration of automated, computer-assisted administration of 24-hour dietary recalls.

关键词： data entry data quality dietary recall EFNEP inter-coder reliability

来源：评论

学校读者我要写书评

暂无评论

Personality-based pair programming: toward intrinsic motivation alignment in very small entities

引用

PEERJ COMPUTER SCIENCE 2025年 11卷 e2774-e2774页

作者： Valovy, Marcel Buchalcevova, Alena Univ Econ Prague Dept Informat Technol Prague Czech Republic

Aim This study explores whether personality-based role assignments (Pilot, Navigator, Solo) can raise intrinsic motivation in pair programming, focusing on designing a framework and process extension for the resource-constrained environment of very small entities (VSEs). Method We employed a mixed-methods design across three quasi-experimental datasets (n = 73 participants), applying linear mixed-effects (LME) modeling to assess motivational outcomes and thematically analyzing (n = 25) interviews for socio-psychological insights. Findings Openness strongly correlates with Pilot roles;Extraversion & Agreeableness favor Navigator roles;and Neuroticism aligns more comfortably with Solo roles-each yielding substantial boosts in intrinsic motivation (up to 60-65%). Twelve qualitative themes underscore the influence of mentorship, pairing constellations, and flow disruptions on developer experiences. Implications Building on these results, we propose the role-optimization motivation alignment (ROMA) framework, mapped to the ISO/IEC 29110 Software Basic Profile and Agile Guidelines, with practical tasks (T1-T7) to facilitate systematic role-trait alignments in small agile teams. Although our data primarily involve Gen-Z undergraduates, the recurring patterns suggest broader applicability, further supported by a separately published application for ongoing generalizability. Conclusion Personality-driven role optimization may significantly enhance collaboration and developer satisfaction in VSEs, though further studies in professional settings and investigations into AI-assisted or distributed pair programming are warranted.

关键词： Intrinsic motivation Agile software development Linear mixed-effects Software engineering Mixed-methods research Big Five Large language models (LLMs) Pair programming ISO/IEC 29110 inter-coder reliability

来源：评论

学校读者我要写书评

暂无评论

How prevalent are suggestive brand names and Distinctive Assets? An AI-human approach

引用

interNATIONAL JOURNAL OF MARKET RESEARCH 2024年第5期66卷 631-649页

作者： Bali, Larissa Mae Anesbury, Zachary William Phua, Peilin Sharp, Byron Univ South Australia Adelaide Australia Univ South Australia Ehrenberg Bass Inst UniSA Business AUS Level 4 Yungondi Bldg70 North Terrace Adelaide SA 5000 Australia

Despite the concept of a suggestive brand name existing for over one hundred years (Viehoever, 1920), the prevalence of suggestive versus non-suggestive brand names has not been documented. Previously, to do so extensively would have taken considerable time and money. We now show that artificial intelligence can replace manual coding with increased accuracy. We found the coding performances of Chat GPT-4 are 34% more accurate than GPT-3.5 and 44% more accurate than human coders. Systematically expanding our research to over 4,600 brands from consumer goods, services, and durables in major English-speaking markets (United Kingdom, United States, and Australia), we find that overall, slightly more than a quarter of all brand names are suggestive - ranging from 10% of durables to 56% of service brands. Further, we expand the suggestiveness research to non-brand name elements of almost 600 Distinctive Assets (e.g., colours, logos) across consumer goods, services, durables, and retailers (in the same three countries), finding that two in five are suggestive. The brand name and Distinctive Asset prevalence distributions are positively skewed, with most categories falling beneath the respective averages. Furthermore, regarding performance, on average, suggestive Distinctive Assets display lower levels of Fame and Uniqueness than non-suggestive Distinctive Assets.

关键词： suggestive brand names artificial intelligence inter-coder reliability distinctive assets associative network theory interference theory memory

来源：评论

学校读者我要写书评

暂无评论

More than words can say: a mutt medal approach to understanding meaning and sentiment in social media

引用

JOURNAL OF MARKETING MANAGEMENT 2022年第13-14期38卷 1461-1493页

作者： Mehmet, Mehmet Ibrahim D'Alessandro, Steven Univ Wollongong Fac Business Wollongong NSW Australia Univ Tasmania Sch Management & Mkt Hobart Tas 7007 Australia

The authors develop a multimodal social listening analysis (MSLA) approach as a framework for managers to understand how meaning is constructed in social media posts using both text and other media. The research adds to Al and text analysis approaches by considering the whole meaning of a post rather than an analysis of subsets of information in text and other media. The use of MSLA is validated across the social media platforms of Facebook, Twitter and Instagram. The findings show that MSLA helps (i) reveal structures in what appear to be unstructured multimodal posts;(ii) identify all the sentiment items in a post;(iii) identify implicit meanings, such as irony, humour and sarcasm;and (iv) further identify emotions and judgements in multimodal communication. Importantly, this paper explains how decisions and opinions are made online and how marketing strategies can be tailored towards meanings derived from multimodal communication in social media.

关键词： Multimodal social listening consumer sentiment social media social networking inter-coder reliability qualitative research

来源：评论

学校读者我要写书评

暂无评论

Preparing for analysis: a practical guide for a critical step for procedural rigor in large-scale multisite qualitative research studies

引用

QUALITY & QUANTITY 2018年第2期52卷 815-828页

作者： Yang, Yang Pankow, Jennifer Swan, Holly Willett, Jennifer Mitchell, Shannon Gwin Rudes, Danielle S. Knight, Kevin Univ Louisiana Lafayette 104 E Univ Circle Lafayette LA 70504 USA Texas Christian Univ Ft Worth TX 76129 USA ABT Associates Inc Cambridge MA 02138 USA Univ Nevada Reno NV 89557 USA Friends Res Inst Inc Baltimore MD USA George Mason Univ Fairfax VA 22030 USA

Despite attention to technical aspects of conducting qualitative research, few studies describe procedures for managing pre-analysis activities in large-scale multisite qualitative projects. As part of the data collection for the Criminal Justice Drug Abuse Treatment Studies, a national multisite research cooperative with nine research centers (RCs) conducted 700 semi-structured interviews to evaluate interorganizational strategies in three protocols focused on improving addiction- and health related service delivery in criminal justice settings. Guided by the research cooperative, RCs collaborated on many aspects of the qualitative data activities (e.g., codebook development and coding activities), however, pre-analysis procedures, such as organizing and managing resources, were primarily managed at the RC level. The present study examines these various practices and describes two exemplary approaches to pre-analysis, with emphasis on lessons learned and recommendations for coordinating resources, managing data, and maintaining fidelity to the study procedures for large-scale qualitative projects.

关键词： Qualitative research Procedural rigor Team building inter-coder reliability Multisite research

来源：评论

学校读者我要写书评

暂无评论

Workplace democracy and psychological capital: a paradigm shift in workplace

引用

MANAGEMENT RESEARCH REVIEW 2018年第9期41卷 1088-1116页

作者： Han, Ki-Soon Garg, Pooja Incheon Natl Univ Dept Creat HRD Incheon South Korea Indian Inst Technol Roorkee Dept Humanities & Social Sci Roorkee Uttar Pradesh India

Purpose This paper aims to explore the role of workplace democracy in generating psychological capital, which is an inevitable paradigm for the contemporary organizations. The study also provides a conceptual framework which connotes the nexus between the two constructs. Design/methodology/approach The study is qualitative in nature and uses content analysis to identify the determinants of workplace democracy and psychological capital. Furthermore, the study used SPSS macro, i.e. PROCESS, a computational tool for calculating inter-coder reliability by using KALPHA, i.e. Krippendorff's alpha reliability estimate (Hayes, 2013;Krippendorff, 2011). Findings The present study adds to the literature by signaling the dire need for building democratic workplaces and offers significant insights for the management and human resource practitioners to cultivate workplace democracy to build their employees' psychological strengths, which in turn will result in enhanced organizational outcomes. Originality/value The present study brings attention toward the necessity for a shift in the generic organizational strategies and instigate organizations to nurture a democratic setup for developing employees' psychological capital.

关键词： Human resource management Psychological Capital Positive psychology inter-coder reliability KALPHA Workplace democracy

来源：评论

学校读者我要写书评

暂无评论

reliability of Identification of Behavior Change Techniques in intervention Descriptions

引用

ANNALS OF BEHAVIORAL MEDICINE 2015年第6期49卷 885-900页

作者： Abraham, Charles Wood, Caroline E. Johnston, Marie Francis, Jill Hardeman, Wendy Richardson, Michelle Michie, Susan Univ Exeter Psychol Appl Hlth Grp Sch Med Exeter EX1 2LU Devon England UCL Res Dept Clin Educ & Hlth Psychol London WC1E 7HB England Univ Aberdeen Inst Appl Hlth Sci Coll Life Sci & Med Aberdeen AB25 2ZD Scotland City Univ London Sch Hlth Sci London EC1V 0HB England Univ Cambridge Primary Care Unit Cambridge Inst Publ Hlth Cambridge CB2 0SR England UCL Inst Educ Evidence Policy & Practice Informat & Coordinatin Social Sci Res Unit London England

The aim of this paper is to assess the frequency of identification as well as the inter-coder and test-retest reliability of identification of behavior change techniques (BCTs) in written intervention descriptions. Forty trained coders applied the "Behavior Change Technique Taxonomy version 1" (BCTTv1) to 40 intervention descriptions published in protocols and repeated this 1 month later. Eighty of 93 defined BCTs were identified by at least one trained coder, and 22 BCTs were identified in 16 (40 %) or more of 40 descriptions. Good inter-coder reliability was observed across 80 BCTs identified in the protocols: 66 (80 %) achieved mean prevalence and bias-adjusted kappa (PABAK) scores of 0.70 or greater, and 59 (74 %) achieved mean scores of 0.80 or greater. There was good within-coder agreement between baseline and 1 month, demonstrating good test-retest reliability. BCTTv1 can be used by trained coders to identify BCTs in intervention descriptions reliably. However, some frequently occurring BCT definitions require further clarification.

关键词： Behavior change intervention Behavior change technique Taxonomy inter-coder reliability Test-retest reliability

来源：评论

学校读者我要写书评

暂无评论

An annotation scheme for agreement analysis

An annotation scheme for agreement analysis

引用

interSPEECH 2006 and 9th international Conference on Spoken Language Processing, interSPEECH 2006 - ICSLP

作者： Toh, Siew Leng Yang, Fan Heeman, Peter A. Center for Spoken Language Understanding OGI School of Science and Engineering Oregon Science and Engineering University

ISBN: (纸本)9781604234497

To accomplish a task that requires collaboration, people would first agree on a strategy and then together carry it out [1]. Our research interest lies in understanding how people explore different strategies and reach an agreement in conversation. We began by examining two-person dialogues in a very limited domain, in which we could just focus on the agreement process. In this paper, we describe an annotation scheme of coding the conversants' behaviors of exploring possible strategies, suggesting and accepting the optimal one, and then maintaining it. We report the inter-coder reliability of the annotation scheme on three expert annotators and two non-experts.

关键词： Agreement Annotation scheme Dialogue inter-coder reliability

来源：评论

学校读者我要写书评

暂无评论

The employer's perception: Employment of individuals with developmental disabilities

引用

JOURNAL OF VOCATIONAL REHABILITATION 2005年第1期23卷 39-49页

作者： Morgan, Robert Alexander, Melina Utah State Univ Dept Special Educ & Rehabil 2865 Old Main Dr Logan UT 84322 USA

In this study, employers with and without experience in hiring individuals with developmental disabilities were surveyed regarding their perceptions. Respondents were surveyed and their responses were divided based on location (small or large city), type and size of business, average length of employment, and educational qualifications. Most respondents with experience indicated the employment usually or sometimes worked well and they were likely to hire again. Many inexperienced respondents were also receptive to hiring. Experienced respondents identified advantages to employing individuals with disabilities at higher rates than inexperienced respondents. The most frequently identified advantages were consistent attendance, workforce diversity, long-term employment, and co-worker partnerships. Experienced respondents also identified more concerns than inexperienced respondents. The most frequently identified concern was safety. Implications of the research are examined.

关键词： Employer perceptions employers with experience employers without experience inter-coder reliability

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：