This paper presents an educational activity developed within the AIM@VET project, aimed at integrating Large language Models (LLMs) into Vocational Education and Training (VET) for programming robots using natural lan...
详细信息
ISBN:
(纸本)9783031777370;9783031777387
This paper presents an educational activity developed within the AIM@VET project, aimed at integrating Large language Models (LLMs) into Vocational Education and Training (VET) for programming robots using naturallanguage. The curriculum covers key AI topics such as Human-Robot Interaction (HRI), naturallanguage processing, and the use of advanced models like ChatGPT. Students engage in activities from basic command interpretation to advanced voice-controlled interactions, gaining practical experience with LLMs in robotics. Evaluations showed significant improvements in understanding and engagement, highlighting the effectiveness of LLMs in enhancing robotics education for VET students.
This paper presents a naturallanguage design environment that enables the programming of complex robotic agent systems, comprising of a top level BDI architecture in conjunction with a low level operational system th...
详细信息
This paper presents a naturallanguage design environment that enables the programming of complex robotic agent systems, comprising of a top level BDI architecture in conjunction with a low level operational system that relates to the hardware interface and supplemental computational processes. The design environment enforces synergy between the development of these traditionally disparate aspects through sharing of ontological information and implementing a form of natural language programming called sEnglish. The resultant system provides an inherent abstraction of defined operational concepts and procedures for agent reasoning and shared meaning between man and machine. Through this shared knowledge the robot's operational logic and skill execution details are clear to human operators and may thus facilitate the work of design teams to enable rapid prototyping of physical agent systems in simulation or hardware.
natural language programming (NLPr) allows people to program in naturallanguage (NL) for specific domains. It poses great potential since it gives non-experts the ability to develop projects without exhaustive traini...
详细信息
ISBN:
(数字)9783030770914
ISBN:
(纸本)9783030770914;9783030770907
natural language programming (NLPr) allows people to program in naturallanguage (NL) for specific domains. It poses great potential since it gives non-experts the ability to develop projects without exhaustive training. However, complex descriptions can sometimes have multiple interpretations, making program synthesis difficult. Thus, if the high-level abstractions can be broken down into a sequence of precise low-level steps, existing naturallanguage processing (NLP) and NLPr techniques could be adaptable to handle the tasks. In this paper, we present an algorithm for converting high-level task descriptions into low-level specifications by parsing the sentences into sentence frames and using generated low-level NL instructions to generate executable programs for pathfinding tasks in a LEGO Mindstorms EV3 robot. Our analysis shows that breaking down the high-level pathfinding abstractions into a sequence of low-level NL instructions is effective for the majority of collected sentences, and the generated NL texts are detailed, readable, and can easily be processed by the existing NLPr system.
naturallanguage (NL) programming, the concept of synthesizing code from naturallanguage inputs, has garnered growing interest among the software community in recent years. Unfortunately, current solutions in the spa...
详细信息
ISBN:
(纸本)9781665495981
naturallanguage (NL) programming, the concept of synthesizing code from naturallanguage inputs, has garnered growing interest among the software community in recent years. Unfortunately, current solutions in the space all suffer from the same problem, they require many labeled training examples due to their data-driven nature. To address this issue, this paper proposes an NLU-driven approach that forgoes the need for large numbers of labeled training examples. Inspired by how humans learn programming, this solution centers around naturallanguage Understanding and draws on a novel graph-based mapping algorithm. The resulting NL programming framework, HISyn, uses no training examples, but gives synthesis accuracies comparable to data-driven methods trained on hundreds of samples. HISyn meanwhile demonstrates advantages in terms of interpretability, error diagnosis support, and cross-domain extensibility. To encourage adoption of HISyn among developers, the tool is made available as an extension for the Visual Studio Code IDE, thereby allowing users to easily submit inputs to HISyn and insert the generated code expressions into their active programs. A demo of the HISyn Extension can be found at https://***/KKOqJS24FNo.
Recently, naturallanguage (NL)-based program synthesis has drawn increasing interest. Conventional methods that depend on some predefined domain-specific rules suffer from the lack of robustness and generality. Recen...
详细信息
ISBN:
(纸本)9781665405843
Recently, naturallanguage (NL)-based program synthesis has drawn increasing interest. Conventional methods that depend on some predefined domain-specific rules suffer from the lack of robustness and generality. Recent efforts on adopting deep learning to map queries to code requires a large number of labeled examples, making them not applicable on domains with scarce labeled examples. Although a third alternative, naturallanguage understanding (NLU)-driven approach addresses the problems, the long response time hinders its adoption in practice, especially in an interactive scenario. This paper presents a solution to enable near real-time NLU-driven NL programming. The solution features a new algorithm, dynamic grammar graph-based translation (DGGT), for identifying the best grammar tree for a query via dynamic programming. It also introduces two new optimizations, grammar-based pruning and orphan node relocation, to further reduce the search space and address the special complexities from queries. Evaluations on two domains, text editing and program source code analysis, show that the DGGT algorithm and the optimizations shortens the response time of a state-of-the-art NLU-driven synthesizer by up to 1887x (25-133 x on average) while improving the accuracy by 2-12%.
naturallanguage (NL) programming has become more approachable due to the powerful code-generation capability of large language models (LLMs). This shift to using NL to program enhances collaborative programming by re...
详细信息
ISBN:
(纸本)9798400703300
naturallanguage (NL) programming has become more approachable due to the powerful code-generation capability of large language models (LLMs). This shift to using NL to program enhances collaborative programming by reducing communication barriers and context-switching among programmers from varying backgrounds. However, programmers may face challenges during prompt engineering in a collaborative setting as they need to actively keep aware of their collaborators' progress and intents. In this paper, we aim to investigate ways to assist programmers' prompt engineering in a collaborative context. We first conducted a formative study to understand the workflows and challenges of programmers when using NL for collaborative programming. Based on our findings, we implemented a prototype, CoPrompt, to support collaborative prompt engineering by providing referring, requesting, sharing, and linking mechanisms. Our user study indicates that CoPrompt assists programmers in comprehending collaborators' prompts and building on their collaborators' work, reducing repetitive updates and communication costs.
natural language programming (NLPr) is a sub-field of naturallanguage processing (NLP) that provides a bridge between naturallanguages (NL) and programminglanguages (PL), allowing users to design programs in the fo...
详细信息
ISBN:
(纸本)9789897584848
natural language programming (NLPr) is a sub-field of naturallanguage processing (NLP) that provides a bridge between naturallanguages (NL) and programminglanguages (PL), allowing users to design programs in the form of structured NL documents. Due to the imprecise and ambiguous nature of NL, it is essential to ensure the correctness of translation for critical applications where errors are unacceptable. Machine learning-based approaches for error checking are insufficient as it can be difficult for even the most sophisticated models to capture all the relevant intricacies of a naturallanguage. Automata offer a formalism that has been used in compiling programminglanguages, and this paper extends automata-based methods to validating programs written in naturallanguages. In particular, we propose a hierarchically structured finite-state automaton, modeled based on domain-specific knowledge, for NLPr input validation and semantic error reporting. Experimental results from validating a set of collected NL sentences show that the proposed validation and error reporting can catch the unexpected input components while validating the semantics.
naturallanguage (NL) programming automatically synthesizes code based on inputs expressed in naturallanguage. It has recently received lots of growing interest. Recent solutions however all require many labeled trai...
详细信息
ISBN:
(纸本)9781450370431
naturallanguage (NL) programming automatically synthesizes code based on inputs expressed in naturallanguage. It has recently received lots of growing interest. Recent solutions however all require many labeled training examples for their data-driven nature. This paper proposes an NLU-driven approach, a new approach inspired by how humans learn programming. It centers around naturallanguage Understanding and draws on a novel graph-based mapping algorithm, foregoing the need of large numbers of labeled examples. The resulting NL programming framework, HISyn, using no training examples, gives synthesis accuracy comparable to those by data-driven methods trained on hundreds of training numbers. HISyn meanwhile demonstrates advantages in interpretability, error diagnosis support, and cross-domain extensibility.
The paper describes a system for executable papers for publishers enabling them to reuse content and to generate further advances of science and engineering. The executable algorithmic descriptions within a paper are ...
详细信息
The paper describes a system for executable papers for publishers enabling them to reuse content and to generate further advances of science and engineering. The executable algorithmic descriptions within a paper are presented in naturallanguage sentences and basic code, thereby making long term compatibility absolute. Authors are required to use publicly numerical libraries on the Internet or references to publications with executable papers. As used by authors the system automatically creates a web of algorithmic knowledge on the Internet. Novelty of new algorithms in publications can be evaluated by automated tools available to authors, reviewers and readers of scientific papers published.
The paper describes a system for executable papers for publishers enabling them to reuse content and to generate further advances of science and engineering. The executable algorithmic descriptions within a paper are ...
详细信息
The paper describes a system for executable papers for publishers enabling them to reuse content and to generate further advances of science and engineering. The executable algorithmic descriptions within a paper are presented in naturallanguage sentences and basic code, thereby making long term compatibility absolute. Authors are required to use publicly numerical libraries on the Internet or references to publications with executable papers. As used by authors the system automatically creates a web of algorithmic knowledge on the Internet. Novelty of new algorithms in publications can be evaluated by automated tools available to authors, reviewers and readers of scientific papers published.
暂无评论