Generative ai, particularly Large Language models (LLMs), presents innovative opportunities to enhance software engineering education. opensource LLMs such as LLaMA and Mistral leverage the potential of generative ai...
详细信息
ISBN:
(纸本)9798350378986;9798350378979
Generative ai, particularly Large Language models (LLMs), presents innovative opportunities to enhance software engineering education. opensource LLMs such as LLaMA and Mistral leverage the potential of generative ai offering distinct advantages over proprietary options including transparency, customizability, collaboration, and cost savings. This paper develops a catalog of LLM prompt examples tailored for software engineering training, mapped to knowledge areas from the Software Engineering Body of Knowledge (SWEBoK) framework. Example prompts demonstrate LLMs' capabilities in eliciting requirements, diagram generation, API simulation, effort estimation through role-playing, and other areas. The methodology involves evaluating prompt responses from ChatGPT, Mistral, and LLaMA on representative tasks. Quantitative and qualitative analysis assesses quality, usefulness, and correctness. Findings show ChatGPT and Mistral outperforming LLaMA overall, but no model perfectly executes complex interactions. We examine implications and challenges of integrating opensource LLMs into classrooms, emphasizing the need for oversight, verification, and prompt design aligned with pedagogical objectives.
暂无评论