qualitative data analysis (QDA) tools are essential for extracting insights from complex datasets. This study investigates researchers' perceptions of the usability, user experience (UX), mental workload, trust, t...
详细信息
qualitative data analysis (QDA) tools are essential for extracting insights from complex datasets. This study investigates researchers' perceptions of the usability, user experience (UX), mental workload, trust, task complexity, and emotional impact of three tools: Taguette 1.4.1 (a traditional QDA tool), ChatGPT (GPT-4, December 2023 version), and Gemini (formerly Google Bard, December 2023 version). Participants (N = 85), Master's students from the Faculty of Electrical Engineering and Computer Science with prior experience in UX evaluations and familiarity with AI-based chatbots, performed sentiment analysis and data annotation tasks using these tools, enabling a comparative evaluation. The results show that AI tools were associated with lower cognitive effort and more positive emotional responses compared to Taguette, which caused higher frustration and workload, especially during cognitively demanding tasks. Among the tools, ChatGPT achieved the highest usability score (SUS = 79.03) and was rated positively for emotional engagement. Trust levels varied, with Taguette preferred for task accuracy and ChatGPT rated highest in user confidence. Despite these differences, all tools performed consistently in identifying qualitative patterns. These findings suggest that AI-driven tools can enhance researchers' experiences in QDA while emphasizing the need to align tool selection with specific tasks and user preferences.
This study investigates the efficacy of ChatGPT in enhancing the initial phases of qualitative data analysis (QDA), particularly in data familiarization and exploration in education research. Analyzing interview data ...
详细信息
Large language models (LLMs) have transformed textual or qualitativedata processing and analysis by automating and enhancing interpretive accuracy, particularly in complex areas like cybersecurity, ethics, and compli...
详细信息
Large language models (LLMs) have transformed textual or qualitativedata processing and analysis by automating and enhancing interpretive accuracy, particularly in complex areas like cybersecurity, ethics, and compliance. This study examines the effective-ness of local LLMs in analyzing qualitative research using the data gathered from the case study on “perspectives on security and privacy issues associated with the introduction of gamified workforce studies”. The research presented in this paper utilized 23 interview transcripts to evaluate three popular LLMs, namely LLaMA, Gemma, and Phi, running on a local infrastructure. We observed that LLaMA focuses on practical data security, Gemma on regulatory compliance, and Phi on ethical transparency and trust-building. By combining these models, researchers can gain a more comprehensive understanding of the complex implications of gamification in workforce studies. Local LLMs provide the added benefit of enhanced data privacy and security by processing sensitive data entirely within a controlled environment. This study explores the system and user prompts that can improve the interpretive accuracy of various qualitative research approaches, such as thematic analysis, frequency analysis, impact level analysis, sensitivity analysis, and disclosure analysis, demonstrating the potential of local LLMs for qualitativeanalysis for sensitive data. This study recommends the usage of LLMs for the initial stage of the qualitativeanalysis process to enhance the efficiency and effectiveness of subsequent completely manual or software-assisted manual analysis.
Science and technology roadmapping is currently a popular method to develop long-term strategies for e-government. In the scope of the EC-co-funded research project eGovRTD2020, an innovative methodology has been deve...
详细信息
ISBN:
(数字)9783642035166
ISBN:
(纸本)9783642035159
Science and technology roadmapping is currently a popular method to develop long-term strategies for e-government. In the scope of the EC-co-funded research project eGovRTD2020, an innovative methodology has been developed, which combines scenarios and roadmapping to support long-term strategic policy-making for e-government research. This approach bases on systematically analyzing qualitativedata throughout the whole roadmapping process based on individual issues and their interrelations. The paper explores the complex analysis of the network of relations and interdependencies between these issues. We introduce a concept for the systematic analysis of interlinks between single issues, which helps improving the quality of analysis and advances the consolidation of results to form well grounded strategic policy-making. A case example extracted from the project serves as proof of concept.
The creation of domain models from qualitative input relies heavily on experience. An uncodified ad-hoc modeling process is still common and leads to poor documentation of the analysis. In this article we present a ne...
详细信息
The creation of domain models from qualitative input relies heavily on experience. An uncodified ad-hoc modeling process is still common and leads to poor documentation of the analysis. In this article we present a new method for domain analysis based on qualitative data analysis. The method helps identify inconsistencies, ensures a high degree of completeness, and inherently provides traceability from analysis results back to stakeholder input. These traces do not have to be documented after the fact. We evaluate our approach using four exploratory studies.
Using qualitative data analysis (QDA) to perform domain analysis and modeling has shown great promise. Yet, the evaluation of such approaches has been limited to single-case case studies. While these exploratory cases...
详细信息
Using qualitative data analysis (QDA) to perform domain analysis and modeling has shown great promise. Yet, the evaluation of such approaches has been limited to single-case case studies. While these exploratory cases are valuable for an initial assessment, the evaluation of the efficacy of QDA to solve the suggested problems is restricted by the common single-case case study research design. Using our own method, called QDAcity-RE, as the example, we present an in-depth empirical evaluation of employing qualitative data analysis for domain modeling using a controlled experiment design. Our controlled experiment shows that the QDA-based method leads to a deeper and richer set of domain concepts discovered from the data, while also being more time efficient than the control group using a comparable non-QDA-based method with the same level of traceability.
The use of qualitative data analysis software has been increasing in recent years. A number of qualitative researchers have raised questions concerning the effect of such software in the research process. Pears have b...
详细信息
The use of qualitative data analysis software has been increasing in recent years. A number of qualitative researchers have raised questions concerning the effect of such software in the research process. Pears have been expressed that the use of the computer for qualitativeanalysis may interfere with the relationship between the researcher and the research process itself by distancing the researcher from both the data and the respondent. Others have suggested that the use of a quantitative tool, the computer, would lead to data dredging, quantification of results, and loss of the ''art'' of qualitativeanalysis. In this study of 12 qualitative researchers, including both faculty members and graduate students, we have found that these fears are exaggerated. Users of qualitative data analysis software in most cases use the computer as an organizational time-saving tool and take special care to maintain close relationships with both the data and the respondents. It is an open question, however, whether or not the amount of time and effort saved by the computer enhance research creativity. The research findings are mixed in this area. At issue is the distinction between creativity and productivity when computer methods are used.
In qualitative field studies, researchers frequently deal with comprehending a multifaceted reality. Large quantities of data are collected for analysis at a later stage. Alternation between proximity and distance is ...
详细信息
In qualitative field studies, researchers frequently deal with comprehending a multifaceted reality. Large quantities of data are collected for analysis at a later stage. Alternation between proximity and distance is a crucial mechanism in the analysis of qualitativedata. This article's aim is to make intersubjective analysis of qualitativedata comprehensible through the investigation and description of phases and key components in a case of productive team co-operation. The argument is methodological, and addresses how empirical data can make a difference within a certain theoretical framework in analytical generalisation. Experiences from a case of intersubjective analysis work between four researchers are described and made sense of. Phases and key components are discussed. Close co-operation of a research team is suggested as a possibility in qualitative fieldwork and analysis. It is concluded that: (a) the idea of collectivity has hitherto been an underdeveloped possibility for qualitative research;(b) purposely intertwining data collection with analysis can be a powerful route for gaining reliable qualitative research;and (c) dataanalysis as close teamwork is promising as a means of keeping an openness to discoveries, thus gaining validity in the qualitative research endeavour. Coordinating with others in concentrated teamwork may defend the analytical task against other demands an academic post entails.
This article reports the author's experience teaching sociology graduate students how to analyze qualitativedata. The course focused on teaching practical skills of defining coding categories, coding text, analyz...
详细信息
This article reports the author's experience teaching sociology graduate students how to analyze qualitativedata. The course focused on teaching practical skills of defining coding categories, coding text, analyzing coded text, and writing up the results of analysis. The assignments used Qualrus software to give students hands-on practice doing all of these. The course was enthusiastically received and will become a permanent part of the sociology methods course offerings at American University.
This paper argues that qualitative Hospitality research is infrequently reported in Hospitality journals and that when such research does appear, the processes of dataanalysis seldom receive rigorous attention. Diffe...
详细信息
暂无评论