this paper introduces GestLLM, an advanced system for human-robot interaction that enables intuitive robot controlthrough hand gestures. Unlike conventional systems, which rely on a limited set of predefined gestures...
详细信息
ISBN:
(数字)9798350378931
ISBN:
(纸本)9798350378948
this paper introduces GestLLM, an advanced system for human-robot interaction that enables intuitive robot controlthrough hand gestures. Unlike conventional systems, which rely on a limited set of predefined gestures, GestLLM leverages large language models and feature extraction via MediaPipe [1] to interpret a diverse range of gestures. this integration addresses key limitations in existing systems, such as restricted gesture flexibility and the inability to recognize complex or unconventional gestures commonly used in human communication. By combining state-of-the-art feature extraction and language model capabilities, GestLLM achieves performance comparable to leading vision-language models while supporting gestures underrepresented in traditional datasets. For example, this includes gestures from popular culture, such as the “Vulcan salute” from Star Trek, without any additional pretraining, prompt engineering, etc. this flexibility enhances the naturalness and inclusivity of robot control, making interactions more intuitive and user-friendly. GestLLM provides a significant step forward in gesture-based interaction, enabling robots to understand and respond to a wide variety of hand gestures effectively. this paper outlines its design, implementation, and evaluation, demonstrating its potential applications in advanced human-robot collaboration, assistive robotics, and interactive entertainment.
this research paper proposes a curriculum for a six-year academic program with a bachelor’s degree (honors) in intelligent systems engineering and a bachelor’s degree (honors) in computer engineering. this program i...
详细信息
Bed-to-wheelchair transferring is a ubiquitous activity of daily living (ADL), but especially challenging for caregiving robots with limited payloads. We develop a novel algorithm that leverages the presence of other ...
详细信息
ISBN:
(数字)9798350378931
ISBN:
(纸本)9798350378948
Bed-to-wheelchair transferring is a ubiquitous activity of daily living (ADL), but especially challenging for caregiving robots with limited payloads. We develop a novel algorithm that leverages the presence of other assistive devices: a Hoyer sling and a wheelchair for coarse manipulation of heavy loads, alongside a robot arm for fine-grained manipulation of deformable objects (Hoyer sling straps). We instrument the Hoyer sling and wheelchair with actuators and sensors so that they can become intelligent agents in the algorithm. We then focus on one subtask of the transferring ADL-tying Hoyer sling straps to the sling bar-that exemplifies the challenges of transfer: multi-agent planning, deformable object manipulation, and generalization to varying hook shapes, sling materials, and care recipient bodies. To address these challenges, we propose CART-MPC, a novel algorithm based on turn-taking multi-agent model predictive controlthat uses a learned neural dynamics model for a keypoint-based representation of the deformable Hoyer sling strap, and a novel cost function that leverages linking numbers from knot theory and neural amortization to accelerate inference. We validate it in both RCareWorld [1] simulation and real-world environments. In simulation, CART-MPC successfully generalizes across diverse hook designs, sling materials, and care recipient body shapes. In the real world, we show zero-shot sim-to-real generalization capabilities to tie deformable Hoyer sling straps on a sling bar towards transferring a manikin from a hospital bed to a wheelchair. See our websitefor supplementary materials: https://***/cart-mpc/.
this paper describes the implementation of a surveillance, monitoring and teleconference system used by the TELEDIM telemedicine system. Windows tablets and smart phones are used to capture audio and video data and se...
详细信息
ISBN:
(纸本)9781479917808
this paper describes the implementation of a surveillance, monitoring and teleconference system used by the TELEDIM telemedicine system. Windows tablets and smart phones are used to capture audio and video data and send them through an ad-hoc wireless internet network to surveillance servers.
the paper intends to define the future agricultural enterprise as a complex system, based on the sustainability concept, and to propose a control approach ensuring its proactivity versus environmental and market chang...
详细信息
ISBN:
(纸本)9781479917808
the paper intends to define the future agricultural enterprise as a complex system, based on the sustainability concept, and to propose a control approach ensuring its proactivity versus environmental and market changes, based on agent-oriented behavior and Cyber-Physical systems.
Accessibility removes barriers in the workplace, with game design processes being enhanced by better development tools, improved recruitment procedures, and an increased awareness of inclusive practices. this position...
详细信息
ISBN:
(纸本)9798400718564
Accessibility removes barriers in the workplace, with game design processes being enhanced by better development tools, improved recruitment procedures, and an increased awareness of inclusive practices. this position paper describes accessibility within the field of digital games – with a special focus on game developers with disabilities – based on challenges and opportunities at workplaces described in a previously available summary of an industry roundtable in 2024. the aim is to find ways forward by raising awareness about issues of inclusion and accessibility based on views from people in the game industry and related research. the paper presents seven thematic concepts and related principles: 1) proactive, inclusive leadership; 2) better structure at workplaces; 3) adaptation with remote work; 4) normalise and facilitate adaptations; 5) inclusive employment processes; 6) sustainable advocacy; 7) accessible tools for inclusive game design. this paper also presents a tentative model where the needs of employees are the input while policy, methods, tools, advocacy and stakeholders provide support, and accountability provides control, which combined may lead to proactive inclusion. Our position is that while game accessibility has advanced significantly in the industry in the last decade, there is a need for more research about inclusion and accessibility in game design processes within game companies.
the article presents a multi-agent system used for automated negotiation. Different bargaining strategies are used by agents. Machine learning techniques enhance the agents' behavior during negotiation. the negoti...
详细信息
ISBN:
(纸本)9781479917808
the article presents a multi-agent system used for automated negotiation. Different bargaining strategies are used by agents. Machine learning techniques enhance the agents' behavior during negotiation. the negotiation model, based on the BDI paradigm, is tested in a business scenario involving a car dealer.
We develop mathematical models of linear discrete optimal and Stackelberg processes with echoes and retroactive future as an extensions and development of Pareto-Nash-Stackelberg control [10]. Investigated problems ar...
详细信息
ISBN:
(纸本)9781479917808
We develop mathematical models of linear discrete optimal and Stackelberg processes with echoes and retroactive future as an extensions and development of Pareto-Nash-Stackelberg control [10]. Investigated problems are solved by straightforward method and Pontryagin's principle. Wolfram Mathematica applications illustrate the value of the obtained results.
For the discrete linear time-varying systemsthe necessary and sufficient conditions to being kinematically similar to a system with block-triangular or constant coefficients are presented. In particular, conditions f...
详细信息
ISBN:
(纸本)9781479917808
For the discrete linear time-varying systemsthe necessary and sufficient conditions to being kinematically similar to a system with block-triangular or constant coefficients are presented. In particular, conditions for the system to be kinematically similar to a system with identity matrices coefficients are provided.
this paper presents different approaches for developing a speaker recognition system to be used in a voice control interface for an assistive domotic system. Experimental research has been carried out in Matlab, using...
详细信息
ISBN:
(纸本)9781479917808
this paper presents different approaches for developing a speaker recognition system to be used in a voice control interface for an assistive domotic system. Experimental research has been carried out in Matlab, using the Voicebox toolbox for data preparation and feature extraction and using libSVM for speaker recognition.
暂无评论