Within the realm of software engineering, specialized tasks on code, such as program repair, present unique challenges, necessitating fine-tuning Large language models (LLMs) to unlock state-of-the-art performance. Fi...
详细信息
Within the realm of software engineering, specialized tasks on code, such as program repair, present unique challenges, necessitating fine-tuning Large language models (LLMs) to unlock state-of-the-art performance. Fine-tuning approaches proposed in the literature for LLMs on program repair tasks generally overlook the need to reason about the logic behind code changes, beyond syntactic patterns in the data. High-performing fine-tuning experiments also usually come at very high computational costs. With MORepair, we propose a novel perspective on the learning focus of LLM fine-tuning for program repair: we not only adapt the LLM parameters to the syntactic nuances of the task of code transformation (objective ➊), but we also specifically fine-tune the LLM with respect to the logical reason behind the code change in the training data (objective ➋). Such a multi-objective fine-tuning will instruct LLMs to generate high-quality *** apply MORepair to fine-tune four open-source LLMs with different sizes and architectures. Experimental results on function-level and repository-level repair benchmarks show that the implemented fine-tuning effectively boosts LLM repair performance by 11.4% to 56.0%. We further show that our fine-tuning strategy yields superior performance compared to the state-of-the-art approaches, including standard fine-tuning, Fine-tune-CoT, and RepairLLaMA.
The two-volume set LNAI 6634 and 6635 constitutes the refereed proceedings of the 15th Pacific-Asia Conference on Knowledge Discovery and data Mining, PAKDD 2011, held in Shenzhen, China in May 2011. The total of 32 r...
详细信息
ISBN:
(数字)9783642208478
ISBN:
(纸本)9783642208461
The two-volume set LNAI 6634 and 6635 constitutes the refereed proceedings of the 15th Pacific-Asia Conference on Knowledge Discovery and data Mining, PAKDD 2011, held in Shenzhen, China in May 2011. The total of 32 revised full papers and 58 revised short papers were carefully reviewed and selected from 331 submissions. The papers present new ideas, original research results, and practical development experiences from all KDD-related areas including data mining, machine learning, artificial intelligence and pattern recognition, data warehousing and databases, statistics, knowledge engineering, behavior sciences, visualization, and emerging areas such as social network analysis.
This book constitutes the refereed proceedings of the First International Conference on Health informationscience, held in Beijing, China, in April 2012. The 15 full papers presented together with 1 invited pape...
详细信息
ISBN:
(数字)9783642293610
ISBN:
(纸本)9783642293603
This book constitutes the refereed proceedings of the First International Conference on Health informationscience, held in Beijing, China, in April 2012. The 15 full papers presented together with 1 invited paper and 3 industry/panel statements in this volume were carefully reviewed and selected from 38 submissions. The papers cover all aspects of the health informationsciences and the systems that support this health information management and health service delivery. The scope includes 1) medical/health/biomedicine information resources, such as patient medical records, devices and equipments, software and tools to capture, store, retrieve, process, analyze, optimize the use of information in the health domain, 2) data management, data mining, and knowledge discovery (in health domain), all of which play a key role in decision making, management of public health, examination of standards, privacy and security issues, and 3) development of new architectures and applications for health informationsystems.
The Internet of Production fosters collaboration between humans, machines, data and models in industrial production. This book provides research results from the Cluster of Excellence at RWTH Aachen university. Cluste...
详细信息
ISBN:
(数字)9783030980627
The Internet of Production fosters collaboration between humans, machines, data and models in industrial production. This book provides research results from the Cluster of Excellence at RWTH Aachen university. Clusters of Excellence are the backbone of the German Excellence Strategy, providing longterm interdisciplinary research at university of Excellence.
This is an open access book.
This is an open access book.
Body joint modeling and human pose reconstruction provide precise motion and quantitative geometric information about human dynamics. The rich motion information obtained from human pose estimation plays important rol...
详细信息
Body joint modeling and human pose reconstruction provide precise motion and quantitative geometric information about human dynamics. The rich motion information obtained from human pose estimation plays important roles in a wide range of digital twin and connected health applications. However, current related researches have difficulties in extracting the joints’ spatial-temporal correlations from different levels. This is due to the poses being at various complexities in moving various joints differently. Hence, the typical conventional transformer method is non-adaptable and barely meets the aforementioned requirement. In this paper, we propose the Body Joint Interactive transFormers (BJIFormer) to extract the multi-level joints’ spatial-temporal information. The design enables the model to learn the inner joints’ correlation inside the body parts across frames and propagate the extracted information across the body parts with shared joints. The multi-level body joint interactive scheme has greater efficiency improvement by restricting the self-attention computation to partial body parts and connecting each body part by torso. The proposed interactive approach explores the spatial-temporal correlation following the hierarchical paradigm and effectively estimates and reconstructs 3D human poses.
暂无评论