Today, technology plays a pivotal role in our daily lives, significantly impacting individuals. Individuals with muscular dystrophy, such as Amyotrophic Lateral Sclerosis (ALS), benefit from eye-tracking technology, a...
详细信息
The rise of large language models (LLMs) has revolutionized user interactions with knowledge-based systems, enabling chatbots to synthesize vast amounts of information and assist with complex, exploratory tasks. Howev...
详细信息
The intensification of urbanization has exacerbated traffic congestion issues, necessitating intelligent traffic light control system to optimize traffic flow. This study designs and implements an intelligent traffic ...
详细信息
The proceedings contains 31 papers from 01 UIST: proceedings of the 14th Annual acmsymposium on userinterfacesoftware and technology. Topics discussed include: fluid interaction with high-resolution wall-size displ...
详细信息
The proceedings contains 31 papers from 01 UIST: proceedings of the 14th Annual acmsymposium on userinterfacesoftware and technology. Topics discussed include: fluid interaction with high-resolution wall-size displays;support for multitasking and background awareness using interactive peripheral displays;parallel bargrams for consumer-based information exploration and choice and a framework for unifying presentation space.
Modernization and computer technology play a key role in school management. As the demand for information within educational institutions increases, tasks become increasingly complex and labor-intensive, including the...
详细信息
Interaction in virtual reality (VR) remains a major research challenge, due to the difficulty of accurately reproducing a user’s position, the differences that exist between the virtual and real worlds, and the need ...
详细信息
Interaction in virtual reality (VR) remains a major research challenge, due to the difficulty of accurately reproducing a user’s position, the differences that exist between the virtual and real worlds, and the need to ensure a faster response than in traditional computer systems. Our work focuses on software-based approaches that support the user’s hand running over VR objects. Existing constraint-based methods implemented in game engines result in visible glitches which negatively affect the user’s immersion. To mitigate this, we have developed an easy-to-implement human-object interface based on auxiliary projection shapes. Our method, like other software-centered solutions, does not require any additional advanced haptic hardware; it relies solely on a standard VR headset (HMD) with controllers. The evaluation performed confirmed that our approach allows smooth motion to be attained in a 3D scene without adding additional latency to the VR system. Furthermore, for different projection shapes, different hand behavior on the same 3D object is obtained. As a result, scene designers are offered a simple visual mechanism to manipulate hand motion on 3D objects’ surfaces, enhancing its precision while sliding to create more desirable hand trajectories.
Graphical userinterface (GUI) agents are autonomous systems that interpret and generate actions, enabling intelligent user assistance and automation. Effective training of these agent presents unique challenges, such...
详细信息
ISBN:
(纸本)9798400713316
Graphical userinterface (GUI) agents are autonomous systems that interpret and generate actions, enabling intelligent user assistance and automation. Effective training of these agent presents unique challenges, such as sparsity in supervision signals, scalability for large datasets, and the need for nuanced user understanding. We propose stateful screen schema, an efficient representation of GUI interactions that captures key user actions and intentions over time. Building on this foundation, we introduce ScreenLLM, a set of multimodal large language models (MLLMs) tailored for advanced UI understanding and action prediction. Extensive experiments on both open-source and proprietary models show that ScreenLLM accurately models user behavior and predicts actions. Our work lays the foundation for scalable, robust, and intelligent GUI agents that enhance user interaction in diverse software environments.
Natural Language interfaces (NLIs) backed by Large Language Models (LLMs) are used to interact with visualizations through natural language queries. Using the specific example of 2.5D treemaps, the Delphi tool was rec...
详细信息
ISBN:
(纸本)9798400713316
Natural Language interfaces (NLIs) backed by Large Language Models (LLMs) are used to interact with visualizations through natural language queries. Using the specific example of 2.5D treemaps, the Delphi tool was recently presented, introducing an interactive 2.5D visualization with an accompanying chat interface, where the LLM can react to user input and adapt the visualization at its own discretion. While Delphi has demonstrated effectiveness, the authors have not included an evaluation of the LLM's performance with respect to its prompt and specific task types. In this study, we systematically evaluate the impact of prompt engineering on Delphi's ability to answer factual questions related to data and visualization. Specifically, we investigate the effect of the Chain-of-Thought prompting technique by employing a questionnaire comprising 40 questions across ten low-level analytic tasks. Our findings aim to refine prompt design methodologies and enhance the usability and effectiveness of NLIs in advanced visualization systems.
This paper presents an architecture for information retrieval agents in which each agent declaratively describes its domain, input, output, and userinterface. A mediating piece of software can then assemble software ...
详细信息
This paper presents an architecture for information retrieval agents in which each agent declaratively describes its domain, input, output, and userinterface. A mediating piece of software can then assemble software agents for a given information retrieval task, and produce a single, unified userinterface for that task from the individual agents' descriptions.
暂无评论