Foundational multi-modal models have democratized AI access, yet the construction of complex, customizable machine learning pipelines by novice users remains a grand challenge. This paper demonstrates a visual program...
详细信息
ISBN:
(纸本)9798400703317
Foundational multi-modal models have democratized AI access, yet the construction of complex, customizable machine learning pipelines by novice users remains a grand challenge. This paper demonstrates a visual programming system that allows novices to rapidly prototype multimodal AI pipelines. We first conducted a formative study with 58 contributors and collected 236 proposals of multimodal AI pipelines that served various practical needs. We then distilled our findings into a design matrix of primitive nodes for prototyping multimodal AI visual programming pipelines, and implemented a system with 65 nodes. To support users' rapid prototyping experience, we built InstructPipe, an AI assistant based on large language models (LLMs) that allows users to generate a pipeline by writing text-based instructions. We believe InstructPipe enhances novice users onboarding experience of visual programming and the controllability of LLMs by offering non-experts a platform to easily update the generation.
There has always been a fine line separating the art of programming and dynamic modeling for simulation. This research attempts to bridge the two by explicitly defining how dynamic multimodeling methods, from the fiel...
详细信息
ISBN:
(纸本)0819453463
There has always been a fine line separating the art of programming and dynamic modeling for simulation. This research attempts to bridge the two by explicitly defining how dynamic multimodeling methods, from the field of simulation, can be used to create computer programs. We investigate the relation between modeling and programming, especially from the field of UML. We also cover the elements of how programming language principles and theory can be manifested in dynamic systems, and illustrate this using a customizable visual modeling system.
This paper is a result of an investigation into visual programming methods and their effective use in substation applications. It particularly concerns with developing a software-based tool for the design of Composed ...
详细信息
ISBN:
(纸本)0852967489
This paper is a result of an investigation into visual programming methods and their effective use in substation applications. It particularly concerns with developing a software-based tool for the design of Composed Object Types (COT) as applied to substation automation and control systems. A brief discussion illustrating that substation automation and control systems can be developed using COTs is given. Number of existing textual techniques for the development of substation systems are described. This is followed by a summary of some of the shortcomings of the textual technique and how to overcome them. A comparison between textual and visual programming (or graphical) methods is then given. Three interfacing methods are then described in order to examine and determine which of the two discussed methods is most suitable for the development of substation automation and control systems. These interfaces are based on command driven, menu driven and direct manipulation approaches.
This paper introduces NetsBlox, a visual programming environment for learning distributed programming principles. Extending both the visual formalism and open source code base of Snap!, NetsBlox provides two accessibl...
详细信息
ISBN:
(纸本)9781450346986
This paper introduces NetsBlox, a visual programming environment for learning distributed programming principles. Extending both the visual formalism and open source code base of Snap!, NetsBlox provides two accessible distributed programming abstractions to simplify the process of creating networked applications: message passing and Remote Procedure Calls (RPC). Messaging passing allows NetsBlox applications to send data to other connected NetsBlox clients. Remote Procedure Calls enable seamless integration of third party services, such as Google Maps, weather, traffic and other public domain data sources, into NetsBlox applications. Other RPCs help coordinating distributed clients which may be difficult for novice programmers allowing the user to more quickly create captivating and sophisticated applications. These abstractions empower users to develop networked programs, including multi-player games and client-server applications. By providing networking support, NetsBlox not only allows users to learn distribute programming concepts but also makes programming more engaging by incorporating diverse services available on the web.
In this paper, we present a visual programming software for enabling non-technical domain experts to create robot-assisted therapy scenarios for multiple robotic platforms. Our new approach is evaluated by comparing i...
详细信息
ISBN:
(纸本)9781450393898
In this paper, we present a visual programming software for enabling non-technical domain experts to create robot-assisted therapy scenarios for multiple robotic platforms. Our new approach is evaluated by comparing it with Choregraphe, the standard visual programming framework for the often used robotics platforms Pepper and NAO. We could show that our approach receives higher usability values and allows users to perform better in some practical tasks, including understanding, changing and creating small robot-assisted therapy scenarios.
The authors evaluate a new general-purpose visual programming system, PrologSpace. The system addresses classic issues of visual interfaces: layout, shape, colour, and iconography; and those of particular concern to v...
详细信息
ISBN:
(纸本)081867508X
The authors evaluate a new general-purpose visual programming system, PrologSpace. The system addresses classic issues of visual interfaces: layout, shape, colour, and iconography; and those of particular concern to visual programming: multiple views (visual abstractions), synchronised views, integration of visual and textual dimensions, visual debugging, cognitive dimensions, and the problems of scale. They describe the system and examine its cognitive dimensions. They argue that: (1) PrologSpace enhances Prolog programming, and (2) PrologSpace has better 'viscosity', 'visibility', and 'secondary notation' than two other notable general visual programming systems and without any significant loss of dimensionality in other respects.
In the digital age, the range of digital technologies used in mathematics education grows. Since beliefs are affective-cognitive elements that significantly determine teachers' behavior in the classroom, they are ...
详细信息
In the digital age, the range of digital technologies used in mathematics education grows. Since beliefs are affective-cognitive elements that significantly determine teachers' behavior in the classroom, they are an interesting field of research in mathematics education. A review of previous research has identified different groups of beliefs about the use of digital technologies in mathematics classes. These studies are not focused on specific digital technologies. In an empirical case study that is presented in this paper, the aim was to figure out how beliefs that can be described specifically about the use of visual programming relate to general beliefs about the use of digital technologies in mathematics education. A qualitative content analysis of the reflection journals of seven undergraduate mathematics education students on their work with Scratch, a visual programming environment, in a university seminar led to the formation of ten belief categories about the use of visual programming in mathematics classes. Most of the beliefs are associated with a positive attitude towards visual programming in mathematics education. However, some beliefs could also be identified that refer to the limits and challenges of using visual programming and thus demonstrate rather negative associations. Only a few of the categories identified match the list of belief groups about digital technologies in mathematics education identified in previous research. Some possible reasons for these results are discussed and further research interests in the field of beliefs about the use of digital technologies are suggested.
Industrial products tend to be customized by third-parties for different use cases. This is currently supported by adding external Programmable Logic Controllers (PLC) to installations. As IoT software ecosystems beco...
详细信息
ISBN:
(纸本)9781450353182
Industrial products tend to be customized by third-parties for different use cases. This is currently supported by adding external Programmable Logic Controllers (PLC) to installations. As IoT software ecosystems become wide-spread, the need for such hardware will decrease. However, removing the controllers opens the challenge of configuring distributed industrial installations. This paper argues for modeling application requirements on industrial installations so that they can be evaluated automatically based on information about targeted installations. GIMLE, a visual language for modeling application requirements using expressive domain knowledge, is proposed. GIMLE enables modeling requirements on physical features of installations, which hasn't received significant attention in the related work. A study with domain experts is used to reflect on the proposed process. The scalability of the visual language is evaluated using a model for a real-world application. The support for reuse of requirements enabled us to build models that can add support for new installations without significant changes and with a slower increase in size the more components can be reused.
visual programming is widely used to allow users to create programs by manipulating program elements graphically rather than by specifying them textually. It is intuitive and effective. However, it has only just begun...
详细信息
ISBN:
(纸本)9781467373388
visual programming is widely used to allow users to create programs by manipulating program elements graphically rather than by specifying them textually. It is intuitive and effective. However, it has only just begun to be used in robotic programming. For example, in the Robot Operating System (ROS) - a popular framework used for developing robotic applications - in order to run multiple modules together, a ROS launch file needs to be created and used. The files are in XML format and are difficult to write and understand for nontechnical users. To address this problem, in this paper, we propose a visual programming software tool that helps in the creation and visualization of these ROS launch files. This tool enables non-experienced operators to program a robot at a modular level. The tool is one among a set of software tools in the Robot Application Development and Operating Environment (RADOE), which aims to ease the development of robot applications in ROS.
visual programming Languages (VPLs), coupled with the high-level abstractions that are commonplace in visual programming environments, enable users with less technical knowledge to become proficient programmers. Howev...
详细信息
ISBN:
(纸本)9781450385626
visual programming Languages (VPLs), coupled with the high-level abstractions that are commonplace in visual programming environments, enable users with less technical knowledge to become proficient programmers. However, the lower skill floor required by VPLs also entails that programmers are more likely to not adhere to best practices of software development, producing systems with high technical debt, and thus poor maintainability. Duplicated code is one important example of such technical debt. In fact, we observed that the amount of duplication in the OUTSYSTEMS VPL code bases can reach as high as 39%. Duplicated code detection in text-based programming languages is still an active area of research with important implications regarding software maintainability and evolution. However, to the best of our knowledge, the literature on duplicated code detection for VPLs is very limited. We propose a novel and scalable duplicated code pattern mining algorithm that leverages the visual structure of VPLs in order to not only detect duplicated code, but also high-light duplicated code patterns that explain the reported duplication. The performance of the proposed approach is evaluated on a wide range of real-world mobile and web applications developed using OUTSYSTEMS.
暂无评论