检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Song, Enxin Chai, Wenhao Ye, Tian Hwang, Jenq-Neng Li, Xi Wang, Gaoang Zhejiang University-University of Illinois at Urbana-Champaign Institute Zhejiang University China The Department of Electrical and Computer Engineering The University of Washington United States Robotics and Autonomous Systems Thrust Hong Kong University of Science and Technology Guangzhou China The College of Computer Science and Technology Zhejiang University China

Recently, integrating video foundation models and large language models to build a video understanding system can overcome the limitations of specific pre-defined vision tasks. Yet, existing methods either employ complex spatial-temporal modules or rely heavily on additional perception models to extract temporal features for video understanding, and they only perform well on short videos. For long videos, the computational complexity and memory costs associated with long-term temporal connections are significantly increased, posing additional challenges. Taking advantage of the Atkinson-Shiffrin memory model, with tokens in Transformers being employed as the carriers of memory in combination with our specially designed memory mechanism, we propose MovieChat to overcome these challenges. We lift pre-trained multi-modal large language models for understanding long videos without incorporating additional trainable temporal modules, employing a zero-shot approach. Additionally, in our new version, MovieChat+, we design an enhanced vision-question matching-based memory consolidation mechanism to more significantly anchor the predictions of the visual language models in the relevant visual content. MovieChat achieves state-of-the-art performance in long video understanding, along with the released MovieChat-1K benchmark with 1K long video, 2K temporal grounding labels, and 14K manual annotations for validation of the effectiveness of our method. The code along with the dataset can be accessed via the following link. © 2024, CC BY.

关键词： Zero-shot learning

来源：评论

学校读者我要写书评

暂无评论

Decentralized Acceleration-Based Bird-Inspired Flocking

Decentralized Acceleration-Based Bird-Inspired Flocking

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Luca Iacone Erwin Lejeune Tiziano Manoni Sabato Manfredi Dario Albani Autonomous Robotics Research Center Technology Innovation Institute Abu Dhabi UAE Department of Computer Science Vrije Universiteit Amsterdam The Netherlands Department Electrical Engineering and Information Technology Federico II University Naples Italy

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

In the following, we analyze and discuss the implementation of a novel approach for distributed flocking behavior applied to a group of Uncrewed Aerial Vehicle (UAV)s, also referred to as drones. Inspired by natural flocking phenomena observed in birds, which demonstrate coordinated movement in response to internal and external stimuli, we tackle the problem of robust and dynamic aerial motion for robots and design a control law based on a novel physical model. In contrast to previous works that rely on velocity or position-based references, this approach leverages an acceleration-based law to describe the collective dynamics of many interacting particles. As observed in the following, a third-order control possesses several advantages compared to first or second-order control, such as smoother transitions, better force balancing, and more responsive and dynamic behaviors. These advantages are thoroughly analyzed in the following, thanks to physics-based realistic simulations and field experiments with medium-sized UAVs in an unstructured outdoor environment.

关键词： Navigation Robot kinematics Perturbation methods Dynamics Life estimation autonomous aerial vehicles Trajectory Vehicle dynamics Drones Testing

来源：评论

学校读者我要写书评

暂无评论

Natural Language and LLMs in Human-Robot Interaction: Performance and Challenges in a Simulated Setting

Natural Language and LLMs in Human-Robot Interaction: Perfor...

引用

Human-computer Interaction, Optimization and Robotic Applications (HORA), International Congress on

作者： Kelvin Olaiya Giovanni Delnevo Chiara Ceccarini Chan-Tong Lam Giovanni Pau Paola Salomoni Dept. of Computer Science and Engineering University of Bologna Italy Faculty of Applied Sciences Macao Polytechnic University Macao SAR China Autonomous Robotics Research Center Technology Innovation Institute Abu Dhabi United Arab Emirates

ISBN: (数字)9798331510886

ISBN: (纸本)9798331510893

Natural language provides an intuitive and accessible way for humans to communicate with robots, fostering more natural and flexible interaction across a range of tasks. This study investigates how effectively users can command a robot using natural language within a simulated environment. By employing Gemini Flash 2.0 as the underlying Large Language Model (LLM) to interpret and translate user prompts into executable plans, we explore both the strengths and limitations of this approach. The experiments evaluated user-generated prompts across multiple predefined tasks, revealing a spectrum of outcomes — from successful task completions to errors such as misinterpretations, spatial failures, and hallucinated behaviors where the robot acted on non-existent information. The results highlight how different communication strategies, combining directive and conversational phrasing, influenced task performance. This work contributes to advancing Human-Robot Interaction (HRI) design by emphasizing the potential of LLM-powered systems while addressing the challenges of ambiguity and error resilience in user-driven command structures.

关键词： Human computer interaction Translation Large language models Zero shot learning Human-robot interaction Robots Optimization Resilience

来源：评论

学校读者我要写书评

暂无评论

Detecting spatio-temporal Relations by Combining a Semantic Map with a Stream Processing Engine

Detecting spatio-temporal Relations by Combining a Semantic ...

引用

IEEE International Conference on robotics and Automation (ICRA)

作者： Lennart Niecksch Henning Deeken Thomas Wiemann German Research Center for Artificial Intelligence (DFKI) DFKI Niedersachsen Plan-based Robot Control Group Osnabrück Germany Knowledge Based Systems and Autonomous Robotics groups Institute of Computer Science Osnabrück University Osnabrück Germany

Changes in topological spatial relations of objects are often strong indicators for state transitions in the underlying processes they are involved in. While various aspects of semantic mapping have been extensively researched, the reasoning about the temporal development of spatial relations of instances is often neglected. This paper presents a concept to combine a semantic map with a stream processing framework for live analysis of the spatio-temporal relation of objects, based on the map and information inferred from sensors streams. To demonstrate the functionality of our concept, we implemented a proof-of-concept system to track everyday events in an office environment. The presented application scenario clearly demonstrates the benefits of the proposed architecture for detecting and handling complex spatio-temporal events.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Toward Fine Contact Interactions: Learning to Control Normal Contact Force with Limited Information

Toward Fine Contact Interactions: Learning to Control Normal...

引用

IEEE International Conference on robotics and Automation (ICRA)

作者： Jinda Cui Jiawei Xu David Saldana Jeff Trinkle Lehigh AIRLab Honda Research Institute USA San Jose CA USA Department of Computer Science and Engineering Autonomous and Intelligent Robotics Laboratory (AIRLab) Lehigh University Bethleham PA USA

Dexterous manipulation of objects through fine control of physical contacts is essential for many important tasks of daily living. A fundamental ability underlying fine contact control is compliant control, i.e., controlling the contact forces while moving. For robots, the most widely explored approaches heavily depend on models of manipulated objects and expensive sensors to gather contact location and force information needed for real-time control. The models are difficult to obtain, and the sensors are costly, hindering personal robots' adoption in our homes and businesses. This study performs model-free reinforcement learning of a normal contact force controller on a robotic manipulation system built with a low-cost, information-poor tactile sensor. Despite the limited sensing capability, our force controller can be combined with a motion controller to enable fine contact interactions during object manipulation. Promising results are demonstrated in non-prehensile, dexterous manipulation experiments.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Impact Evaluation of Driving Style on Electric Vehicle Battery based on Field Testing Result

Impact Evaluation of Driving Style on Electric Vehicle Batte...

引用

Consumer Communications and Networking Conference, CCNC IEEE

作者： Ka Seng Chou Davide Aguiari Rita Tse Su-Kit Tang Giovanni Pau Faculty of Applied Sciences Macao Polytechnic University Macao SAR China Department of Computer Science and Engineering Alma Mater Studiorum University of Bologna Bologna IT Autonomous Robotics Research Center Technology Innovation Institute UCLA Samueli Computer Science University of California Los Angeles

Monitoring electric vehicles' battery status and forecasting their state of health is still an open challenge. To determine how and why a battery degrades over time, we have extensively monitored a Nissan Leaf's battery pack for more than one year. Collecting more than 4.5 million samples via a custom monitoring connected device to investigate how different driving behaviors affect battery aging. In addition, the best driving behaviors based on the battery's optimal temperature are revealed, including speed, acceleration and brake pedal pressure, and horsepower.

关键词： Temperature sensors Temperature measurement Aging Electric vehicles Batteries Behavioral sciences Brakes

来源：评论

学校读者我要写书评

暂无评论

Accurate Prior-centric Monocular Positioning with Offline LiDAR Fusion

Accurate Prior-centric Monocular Positioning with Offline Li...

引用

IEEE International Conference on robotics and Automation (ICRA)

作者： Jinhao He Huaiyang Huang Shuyang Zhang Jianhao Jiao Chengju Liu Ming Liu Thrust of Robotics and Autonomous Systems The Hong Kong University of Science and Technology (Guangzhou) Guangzhou China Baidu Autonomous Driving Technology Department (ADT) Department of Electronic and Computer Engineering The Hong Kong University of Science and Technology Clear Water Bay Kowloon Hong Kong Department of Computer Science University College London London UK School of Electronics and Information Engineering Tongji University Shanghai China HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute Shenzhen China

ISBN: (数字)9798350384574

ISBN: (纸本)9798350384581

Unmanned vehicles usually rely on Global Positioning System (GPS) and Light Detection and Ranging (LiDAR) sensors to achieve high-precision localization results for navigation purpose. However, this combination with their associated costs and infrastructure demands, poses challenges for widespread adoption in mass-market applications. In this paper, we aim to use only a monocular camera to achieve comparable onboard localization performance by tracking deep-learning visual features on a LiDAR-enhanced visual prior map. Experiments show that the proposed algorithm can provide centimeter-level global positioning results with scale, which is effortlessly integrated and favorable for low-cost robot system deployment in real-world applications.

关键词： Location awareness Visualization Laser radar Robot vision systems Cameras Sensor systems Robustness

来源：评论

学校读者我要写书评

暂无评论

Improving autonomous Driving Safety with POP: A Framework for Accurate Partially Observed Trajectory Predictions

Improving Autonomous Driving Safety with POP: A Framework fo...

引用

IEEE International Conference on robotics and Automation (ICRA)

作者： Sheng Wang Yingbing Chen Jie Cheng Xiaodong Mei Ren Xin Yongkang Song Ming Liu Robotics and Autonomous Systems Division of Emerging Interdisciplinary Areas (EMIA) Under Interdisciplinary Programs Office (IPO) The Hong Kong University of Science and Technology Hong Kong SAR China Electronic and Computer Engineering The Hong Kong University of Science and Technology Hong Kong SAR China Computer Science The Hong Kong University of Science and Technology Hong Kong SAR China Lotus Technology Ltd China Robotics and Autonomous Systems Thrust The Hong Kong University of Science and Technology (Guangzhou) Guangzhou China HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute Shenzhen China

ISBN: (数字)9798350384574

ISBN: (纸本)9798350384581

Accurate trajectory prediction is crucial for safe and efficient autonomous driving, but handling partial observations presents significant challenges. To address this, we propose a novel trajectory prediction framework called Partial Observations Prediction (POP) for congested urban road scenarios. The framework consists of two key stages: self-supervised learning (SSL) and feature distillation. POP first employs SLL to help the model learn to reconstruct history representations, and then utilizes feature distillation as the fine-tuning task to transfer knowledge from the teacher model, which has been pre-trained with complete observations, to the student model, which has only few observations. POP achieves comparable results to topperforming methods in open-loop experiments and outperforms the baseline method in closed-loop simulations, including safety metrics. Qualitative results illustrate the superiority of POP in providing reasonable and safe trajectory predictions. Demo videos and code are available at https://***/POP/.

关键词： Accuracy Roads Self-supervised learning Predictive models Trajectory History Task analysis

来源：评论

学校读者我要写书评

暂无评论

vPlanSim: An Open Source Graphical Interface for the Visualisation and Simulation of AI Systems 31

vPlanSim: An Open Source Graphical Interface for the Visuali...

引用

31st International Conference on Automated Planning and Scheduling, ICAPS 2021

作者： Roberts, Jamie O. Mastorakis, Georgios Lazaruk, Brad Franco, Santiago Stokes, Adam A. Bernardini, Sara School of Engineering Institute for Integrated Micro and Nano Systems University of Edinburgh United Kingdom EPSRC CDT in Robotics and Autonomous Systems Edinburgh Centre for Robotics United Kingdom Department of Computer Science Royal Holloway University of London United Kingdom

ISBN: (纸本)9781713832317

We introduce vPlanSim, an open source tool to aid in AI PDDL development. This tool is primarily aimed at researchers and developers who need a visual representation of their planning problem so that they can make useful insights into the performance of their system, and also to naturally convey their system to others. It is an open-source tool which allows a user to quickly and easily visualise a target environment to generate the problem files and also to visualise a plan. It is particularly well suited to spatial planning problems. This paper will demonstrate vPlanSim on 2D and 3D planning problems. vPlanSim is based on a small and carefully considered set of dependencies such as VTK and PyQt. It can be set up on different platforms and compiled from source with minimal effort. The code is and maintained via a clear code review mechanism. We welcome contributions from the open-source community. Copyright © 2021, Proceedings of the 31st International Conference on Automated Planning and Scheduling. All rights reserved.

关键词： Open systems

来源：评论

学校读者我要写书评

暂无评论

autonomous Building of Structures in Unstructured Environments via AI Planning 31

Autonomous Building of Structures in Unstructured Environmen...

引用

31st International Conference on Automated Planning and Scheduling, ICAPS 2021

作者： Roberts, Jamie O. Franco, Santiago Stokes, Adam A. Bernardini, Sara School of Engineering Institute for Integrated Micro and Nano Systems University of Edinburgh United Kingdom EPSRC CDT in Robotics and Autonomous Systems Edinburgh Centre for Robotics United Kingdom Department of Computer Science Royal Holloway University of London United Kingdom

ISBN: (纸本)9781713832317

In this paper, we offer a novel AI planning representation, based on a Cartesian coordinate system, for enabling the autonomous operations of Multi-Robot Systems in 3D environments. Each robot in the system has to conform to unique actuation and connection constraints that create a complex set of valid configurations. Our approach allows Multi-Robot Systems to self-assemble themselves into larger structures via AI planning, with the overarching goal of providing structural capabilities in harsh and uncertain environments. In comparing four different PDDL (Planning Domain Definition Language) domain representations, we show that our novel formulation satisfies the practical requirements emerging from robot deployment in the real world, resulting in an AI planning system that is accurate and efficient. We scale up performance by implementing direct FDR (Finite Domain Representation) generation based on the best performing PDDL model, bypassing the PDDL-to-FDR translation used by the majority of modern planners. The proposed approach is general and can be applied to a broad range of AI problems involving reasoning in 3D spaces. Copyright © 2021, Proceedings of the 31st International Conference on Automated Planning and Scheduling. All rights reserved.

关键词： Multipurpose robots

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：