visual programming is widely adopted in learning, usually with jigsaw-style blocks that may be freely placed on a canvas. While grammatical correctness is forced by the allowed compositions, syntactic information is n...
详细信息
ISBN:
(数字)9781665442145
ISBN:
(纸本)9781665442152;9781665442145
visual programming is widely adopted in learning, usually with jigsaw-style blocks that may be freely placed on a canvas. While grammatical correctness is forced by the allowed compositions, syntactic information is not communicated to learners, causing the underlying language grammar to be experientially assimilated. But grammars are crucial for the deeper understanding of languages, since syntax reflects all important semantic aspects and elements. We present a general-purpose syntax-directed visual editor with syntactic tooltips, accepting as input the grammar of the subject language. It adopts a block-based visual style for program elements. However, contrasting to the typical canvas layout, it supports a row-based grid for spatial organization, enabling newlines and indentation. It also allows users view the production chain of any program element for a better understanding of the language. Our early evaluation findings indicate that such a combination of interactive syntax and visual code blocks is very positively received by learners.
Prompt engineering for large language models (LLMs) is a critical to effectively leverage their capabilities. However, due to the inherent stochastic and opaque nature of LLMs, prompt engineering is far from an exact ...
详细信息
ISBN:
(纸本)9798400700965
Prompt engineering for large language models (LLMs) is a critical to effectively leverage their capabilities. However, due to the inherent stochastic and opaque nature of LLMs, prompt engineering is far from an exact science. Crafting prompts that elicit the desired responses still requires a lot of trial and error to gain a nuanced understanding of a model's strengths and limitations for one's specific task context and target application. To support users in sensemaking around the outputs of LLMs, we create Chain-Forge, an open-source visual programming environment for prompt engineering. ChainForge is publicly available, both on the web (https://***) and as a locally installable Python package hosted on PyPI. We detail some features of ChainForge and how we iterated the design in response to internal and external feedback.
programming languages have been trapped in a world of linear textual representations fundamentally unchanged for half a century. Even systems pushing beyond these forms visual languages, projectional language workbenc...
详细信息
ISBN:
(纸本)9798400712159
programming languages have been trapped in a world of linear textual representations fundamentally unchanged for half a century. Even systems pushing beyond these forms visual languages, projectional language workbenches, and end-user programming tools - largely ape the strictures of stream-of-bytes compilers and confine themselves to the popular paradigms of conventional textual systems. Instead of recreating what succeeded in textual paradigms, newprogramming systems should also be exploring what did not- the confounding, confusing, convoluted approaches that fell by the wayside- with the sorts of direct manipulation, spatial connection, and change over time that textual languages could never match;and they should use their control of presentation to let the user choose the right representation for a piece of code in the moment- and change it. We argue that these two points unlock new frontiers for programming systems, and present preliminary explorations to highlight how multiple-representation environments can lower the pressure on more speculative visual paradigms, to encourage more investigation of this underexamined space.
The Insight Segmentation and Registration Toolkit (ITK) is a long-established, software package used for image analysis, visualization, and image-guided surgery applications. This package is a collection of C++ librar...
详细信息
ISBN:
(纸本)9780819485069
The Insight Segmentation and Registration Toolkit (ITK) is a long-established, software package used for image analysis, visualization, and image-guided surgery applications. This package is a collection of C++ libraries, that can pose usability problems for users without C++ programming experience. To bridge the gap between the programming complexities and the required learning curve of ITK, we present a higher-level visual programming environment that represents ITK methods and classes by wrapping them into "blocks" within MATLAB's visual programming environment, Simulink. These blocks can be connected to form workflows: visual schematics that closely represent the structure of a C++ program. Due to the heavily C++ templated nature of ITK, direct interaction between Simulink and ITK requires an intermediary to convert their respective datatypes and allow intercommunication. We have developed a "Virtual Block" that serves as an intermediate wrapper around the ITK class and is responsible for resolving the templated datatypes used by ITK to native types used by Simulink. Presently, the wrapping procedure for SimITK is semi-automatic in that it requires XML descriptions of the ITK classes as a starting point, as this data is used to create all other necessary integration files. The generation of all source code and object code from the XML is done automatically by a CMake build script that yields Simulink blocks as the final result. An example 3D segmentation workflow using cranial-CT data as well as a 3D MR-to-CT registration workflow are presented as a proof-of-concept.
The design and implementation of a new visual programming language is a difficult task. The article presents a new meta tool which eases the initial design phase. The approach differs from existing techniques as it is...
详细信息
ISBN:
(纸本)0818685859
The design and implementation of a new visual programming language is a difficult task. The article presents a new meta tool which eases the initial design phase. The approach differs from existing techniques as it is based on an easy-to-use description language, each lexeme of which is represented as an individual node on the workplace and is described by a special code file. The broad aim of this research is to investigate how visual elements/techniques could be integrated into a concrete visual environment which supports the programming task Thus, the emphasis lies primarily on the visualisation of structures or relationships rather than on implementation details. To keep the ongoing research as open as possible, the separation of the underlying semantics from the visual representation is of great importance.
Basic vision science research has reached the point that many investigators are now designing quantitative models of human visual function in areas such as, pattern discrimination, motion detection, optical flow, colo...
详细信息
ISBN:
(纸本)081942739X
Basic vision science research has reached the point that many investigators are now designing quantitative models of human visual function in areas such as, pattern discrimination, motion detection, optical flow, color discrimination, adaptation and stereopsis. These models have practical significance in their application to image compression technologies and as tools for evaluating image quality. We have been working on a vision modeling environment, called Mindseye, that is designed to simplify the implementation and testing of general purpose spatio-temporal models of human vision. Mindseye is an evolving general-purpose vision-modeling environment that embodies the general structure of the visual system and provides a set of modular tools within a flexible platform tailored to the needs of researchers. The environment employs a user-friendly graphics interface with on-line documentation that describes the functionality of the individual modules. Mindseye, while functional, is still research in progress. We are seeking input from the image compression and evaluation community as well as from the vision science community as to the potential utility of Mindseye, and how it might be enhanced to meet future needs.
A visual programming Environment (VPE) promises a shallow learning curve, improved code output performance, immediate visual feedback, rapid functional and graphical prototyping, and citizen development-all without ha...
详细信息
ISBN:
(纸本)9798400717642
A visual programming Environment (VPE) promises a shallow learning curve, improved code output performance, immediate visual feedback, rapid functional and graphical prototyping, and citizen development-all without handwritten code. With this work, we put forward novel design considerations for flow-based VPEs, addressing shortcomings of current VPEs discussed in literature. To a certain extent, these considerations are already being implemented in MVP, a Multi-user general-purpose flow-based visual programming environment that is currently under development.
Deep Learning (DL) developers come from different backgrounds, e.g., medicine, genomics, finance, and computer science. To create a DL model, they must learn and use high-level programming languages (e.g., Python), th...
详细信息
ISBN:
(纸本)9798400702068
Deep Learning (DL) developers come from different backgrounds, e.g., medicine, genomics, finance, and computer science. To create a DL model, they must learn and use high-level programming languages (e.g., Python), thus needing to handle related setups and solve programming errors. This paper presents DeepBlocks, a visual programming tool that allows DL developers to design, train, and evaluate models without relying on specific programming languages. DeepBlocks works by building on the typical model structure: a sequence of learnable functions whose arrangement defines the specific characteristics of the model. We derived DeepBlocks' design goals from a 5-participants formative interview, and we validated the first implementation of the tool through a typical use case. Results are promising and show that developers could visually design complex DL architectures.
Deep learning is one of the fastest growing technologies in computer science with a plethora of applications. But this unprecedented growth has so far been limited to the consumption of deep learning experts. The prim...
详细信息
ISBN:
(纸本)9781450377164
Deep learning is one of the fastest growing technologies in computer science with a plethora of applications. But this unprecedented growth has so far been limited to the consumption of deep learning experts. The primary challenge being a steep learning curve for learning the programming libraries and the lack of intuitive systems enabling non-experts to consume deep learning. Towards this goal, we study the effectiveness of a "no-code" paradigm for designing deep learning models. Particularly, a visual drag-and-drop interface is found more efficient when compared with the traditional programming and alternative visual programming paradigms. We conduct user studies of different expertise levels to measure the entry level barrier and the developer load across different programming paradigms. We obtain a System Usability Scale (SUS) of 90 and a NASA Task Load index (TLX) score of 21 for the proposed visual programming compared to 68 and 52, respectively, for the traditional programming methods.
Across many domains (e.g., media/entertainment, mobile apps, fnance, IoT, cybersecurity), there is a growing need for stateful analytics over streams of events to meet key business outcomes. Stateful analytics over ev...
详细信息
ISBN:
(纸本)9798400703300
Across many domains (e.g., media/entertainment, mobile apps, fnance, IoT, cybersecurity), there is a growing need for stateful analytics over streams of events to meet key business outcomes. Stateful analytics over event streams entails carefully modeling the sequence, timing, and contextual correlations of events to dynamic attributes. Unfortunately, existing frameworks and languages (e.g., SQL, Flink, Spark) entail signifcant code complexity and expert efort to express such stateful analytics because of their dynamic and stateful nature. Our overarching goal is to simplify and democratize stateful analytics. Through an iterative design and evaluation process including a foundational user study and two rounds of formative evaluations with 15 industry practitioners, we created SEAM-EZ, a no-code visual programming platform for quickly creating and validating stateful metrics. SEAM-EZ features a node-graph editor, interactive tooltips, embedded data views, and auto-suggestion features to facilitate the creation and validation of stateful analytics. We then conducted three real-world case studies of SEAM-EZ with 20 additional practitioners. Our results suggest that practitioners who previously could not or had to spend signifcant efort to create stateful metrics using traditional tools such as SQL or Spark can now easily and quickly create and validate such metrics using SEAM-EZ.
暂无评论