检索结果-内蒙古大学图书馆

AirShot: Efficient Few-Shot Detection for Autonomous Exploration

学校读者我要写书评

暂无评论

AirShot: Efficient Few-Shot Detection for Autonomous Explora...

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Zihan Wang Bowen Li Chen Wang Sebastian Scherer Institute for Imaging Data and Communications School of Engineering The University of Edinburgh UK AirLab Robotics Institute Carnegie Mellon University Pittsburgh PA USA Department of Computer Science and Engineering Spatial AI & Robotics (SAIR) Lab Institute for Artificial Intelligence and Data Science University at Buffalo NY USA

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Few-shot object detection has drawn increasing attention in the field of robotic exploration, where robots are required to find unseen objects with a few online provided examples. Despite recent efforts have been made to yield online processing capabilities, slow inference speeds of low-powered robots fail to meet the demands of real-time detection-making them impractical for autonomous exploration. Existing methods still face performance and efficiency challenges, mainly due to unreliable features and exhaustive class loops. In this work, we propose a new paradigm AirShot, and discover that, by fully exploiting the valuable correlation map, AirShot can result in a more robust and faster few-shot object detection system, which is more applicable to robotics community. The core module Top Prediction Filter (TPF) can operate on multi-scale correlation maps in both the training and inference stages. During training, TPF supervises the generation of a more representative correlation map, while during inference, it reduces looping iterations by selecting top-ranked classes, thus cutting down on computational costs with better performance. Surprisingly, this dual functionality exhibits general effectiveness and efficiency on various off-the-shelf models. Exhaustive experiments on COCO2017, VOC2014, and SubT datasets demonstrate that TPF can significantly boost the efficacy and efficiency of most off-the-shelf models, achieving up to 36.4% precision improvements along with 56.3% faster inference speed. Code and Data are at: https://***/ImNotPrepared/AirShot.

关键词： Training Correlation Codes Computational modeling Atmospheric modeling Object detection Real-time systems Computational efficiency Intelligent robots Faces

Robots Taking Initiative in Collaborative Object Manipulation: Lessons from Physical Human-Human Interaction

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Rysbek, Zhanibek Oh, Ki Hwan Shervedani, Afagh Mehri Klemenčič, Timotej Žefran, Miloš Di Eugenio, Barbara Robotics Lab Department of Electrical and Computer Engineering The University of Illinois at Chicago ChicagoIL60607 United States Laboratory of Robotics Faculty of Electrical Engineering University of Ljubljana Slovenia Natural Language Processing Lab Department of Computer Science The University of Illinois at Chicago ChicagoIL60607 United States

Physical Human-Human Interaction (pHHI) involves the use of multiple sensory modalities. Studies of communication through spoken utterances and gestures are well established, but communication through force signals is not well understood. In this paper, we focus on investigating the mechanisms employed by humans during the negotiation through force signals, and how the robot can communicate task goals, comprehend human intent, and take the lead as needed. To achieve this, we formulate a task that requires active force communication and propose a taxonomy that extends existing literature. Also, we conducted a study to observe how humans behave during collaborative manipulation tasks. An important contribution of this work is the novel features based on force-kinematic signals that demonstrate predictive power to recognize symbolic human intent. Further, we show the feasibility of developing a real-time intent classifier based on the novel features and speculate the role it plays in high-level robot controllers for physical Human-Robot Interaction (pHRI). This work provides important steps to achieve more human-like fluid interaction in physical co-manipulation tasks that are applicable and not limited to humanoid, assistive robots, and human-in-the-loop automation. Copyright © 2023, The Authors. All rights reserved.

关键词： Human robot interaction

Deep learning for brain age estimation: A systematic review

学校读者我要写书评

暂无评论

Information Fusion 2023年 96卷 130-143页

作者： Tanveer, M. Ganaie, M.A. Beheshti, Iman Goel, Tripti Ahmad, Nehal Lai, Kuan-Ting Huang, Kaizhu Zhang, Yu-Dong Del Ser, Javier Lin, Chin-Teng Department of Mathematics Indian Institute of Technology Indore Simrol Indore453552 India Department of Robotics University of Michigan Ann ArborMI48109 United States Department of Human Anatomy and Cell Science Rady Faculty of Health Sciences Max Rady College of Medicine University of Manitoba WinnipegMB Canada Biomedical Imaging Lab National Institute of Technology Silchar Assam 788010 India Department of Electrical Engineering and Computer Science National Taipei University of Technology Taipei Taiwan Department of Electronic Engineering National Taipei University of Technology Taipei Taiwan Data Science Research Center Duke Kunshan University China School of Computing and Mathematical Sciences University of Leicester LeicesterLE1 7RH United Kingdom Derio48160 Spain Bilbao48013 Spain School of Computer Science Faculty of Engineering and Information Technology University of Technology Sydney Sydney Australia

Over the years, Machine Learning models have been successfully employed on neuroimaging data for accurately predicting brain age. Deviations from the healthy brain aging pattern are associated with the accelerated brain aging and brain abnormalities. Hence, efficient and accurate diagnosis techniques are required to elicit accurate brain age estimations. Several contributions have been reported in the past for this purpose, resorting to different data-driven modeling methods. Recently, deep neural networks (also referred to as deep learning) have become prevalent in manifold neuroimaging studies, including brain age estimation. In this review, we offer a comprehensive analysis of the literature related to the adoption of deep learning for brain age estimation with neuroimaging data. We detail and analyze different deep learning architectures used for this application, pausing at research works published to date quantitatively exploring their application. We also examine different brain age estimation frameworks, comparatively exposing their advantages and weaknesses. Finally, the review concludes with an outlook towards future directions that should be followed by prospective studies. The ultimate goal of this paper is to establish a common and informed reference for newcomers and experienced researchers willing to approach brain age estimation by using deep learning models. © 2023 Elsevier B.V.

关键词： Deep neural networks

A Real- Time Multi-Camera Auto-Adjustment Framework for Infrastructure Inspections

学校读者我要写书评

暂无评论

A Real- Time Multi-Camera Auto-Adjustment Framework for Infr...

IEEE/SICE International Symposium on System Integration

作者： Chuong Phuoc Le Charles Ellison Steven Bunkley Hung La Anton Netchaev Department of Computer Science and Engineering Advanced Robotics and Automation (ARA) Lab University of Nevada Reno NV USA USACE Engineer Research and Development Center (ERDC) Information Technology Lab Vicksburg MS USA

In this paper, we proposed a novel multi-camera auto-adjustment framework for infrastructure inspections, specifically 3D point cloud mapping via lidar-camera fusion. Our method uses a single controller for consensus target brightness and adaptive lighting. In addition, a vignette correction filter was created to apply to images outputted from cameras to avoid dark strips on the point cloud data. This approach is designed to be a versatile, real-time friendly, and platform agnostic software stack.

关键词：

PhysORD: A Neuro-Symbolic Approach for Physics-infused Motion Prediction in Off-road Driving

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhao, Zhipeng Li, Bowen Du, Yi Fu, Taimeng Wang, Chen Lab Institute for Artificial Intelligence and Data Science Department of Computer Science and Engineering University at Buffalo BuffaloNY14260 United States Robotics Institute Carnegie Mellon University PittsburghPA15213 United States

Motion prediction is critical for autonomous off-road driving, however, it presents significantly more challenges than on-road driving because of the complex interaction between the vehicle and the terrain. Traditional physics-based approaches encounter difficulties in accurately modeling dynamic systems and external disturbance. In contrast, data-driven neural networks require extensive datasets and struggle with explicitly capturing the fundamental physical laws, which can easily lead to poor generalization. By merging the advantages of both methods, neuro-symbolic approaches present a promising direction. These methods embed physical laws into neural models, potentially significantly improving generalization capabilities. However, no prior works were evaluated in real-world settings for off-road driving. To bridge this gap, we present PhysORD, a neural-symbolic approach integrating the conservation law, i.e., the Euler-Lagrange equation, into data-driven neural models for motion prediction in off-road driving. Our experiments showed that PhysORD can accurately predict vehicle motion and tolerate external disturbance by modeling uncertainties. The learned dynamics model achieves 46.7% higher accuracy using only 3.1% of the parameters compared to data-driven methods, demonstrating the data efficiency and superior generalization ability of our neural-symbolic method. Copyright © 2024, The Authors. All rights reserved.

关键词： Off road vehicles

Flickr30K-CFQ: A Compact and Fragmented Query Dataset for Text-image Retrieval

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Haoyu Song, Yaoxian Wang, Xuwu Zhu, Xiangru Li, Zhixu Song, Wei Li, Tiefeng Research Center for Intelligent Robotics Zhejiang Lab China Department of Engineering Mechanics Center for X-Mechanics Zhejiang University China Shanghai Key Laboratory of Data Science School of Computer Science Fudan University China

With the explosive growth of multi-modal information on the Internet, unimodal search cannot satisfy the requirement of Internet applications. Text-image retrieval research is needed to realize high-quality and efficient retrieval between different modalities. Existing text-image retrieval research is mostly based on general vision-language datasets (e.g. MS-COCO, Flickr30K), in which the query utterance is rigid and unnatural (i.e. verbosity and formality). To overcome the shortcoming, we construct a new Compact and Fragmented Query challenge dataset (named Flickr30K-CFQ) to model text-image retrieval task considering multiple query content and style, including compact and fine-grained entity-relation corpus. We propose a novel LLM-based Query-enhanced method using prompt engineering based on LLM. Experiments show that our proposed Flickr30-CFQ reveals the insufficiency of existing vision-language datasets in realistic text-image tasks. Our LLM-based Query-enhanced method applied on different existing text-image retrieval models improves query understanding performance both on public dataset and our challenge set Flickr30-CFQ with over 0.9% and 2.4% respectively. Our project can be available anonymously in https://***/view/Flickr30K-cfq. Copyright © 2024, The Authors. All rights reserved.

关键词： Image enhancement

An Efficient Scene Coordinate Encoding and Relocalization Method

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Xu, Kuan Jiang, Zeyu Cao, Haozhi Yuan, Shenghai Wang, Chen Xie, Lihua School of Electrical and Electronic Engineering Nanyang Technological University 50 Nanyang Avenue 639798 Singapore Spatial AI & Robotics Lab Department of Computer Science and Engineering University at Buffalo BuffaloNY14260 United States

Scene Coordinate Regression (SCR) is a visual localization technique that utilizes deep neural networks (DNN) to directly regress 2D-3D correspondences for camera pose estimation. However, current SCR methods often face challenges in handling repetitive textures and meaningless areas due to their reliance on implicit triangulation. In this paper, we propose an efficient scene coordinate encoding and relocalization method. Compared with the existing SCR methods, we design a unified architecture for both scene encoding and salient keypoint detection, enabling our system to focus on encoding informative regions, thereby significantly enhancing efficiency. Additionally, we introduce a mechanism that leverages sequential information during both map encoding and relocalization, which strengthens implicit triangulation, particularly in repetitive texture environments. Comprehensive experiments conducted across indoor and outdoor datasets demonstrate that the proposed system outperforms other state-of-the-art (SOTA) SCR methods. Our single-frame relocalization mode improves the recall rate of our baseline by 6.4% and increases the running speed from 56Hz to 90Hz. Furthermore, our sequence-based mode increases the recall rate by 11% while maintaining the original efficiency. Copyright © 2024, The Authors. All rights reserved.

关键词： Triangulation

A Hybrid EEG-EMG Framework for Humanoid Control using Deep Learning Transformers

学校读者我要写书评

暂无评论

A Hybrid EEG-EMG Framework for Humanoid Control using Deep L...

IEEE International Conference on robotics and Biomimetics

作者： Parthan Olikkal Branesh M. Pillai Jackrit Suthakorn Habib Ali Ramana Vinjamuri Department of Computer Science and Electrical Engineering Vinjamuri lab University of Maryland Baltimore County Baltimore MD USA Center for Biomedical and Robotics Technology Mahidol University Salaya Nakorm Pathom Thailand

ISBN: (数字)9798331509644

ISBN: (纸本)9798331509651

Brain-computer interfaces (BCIs) offer promising solutions for upper limb rehabilitation. Despite advancements in deep learning, traditional models for motor rehabilitation using electroencephalography (EEG) or electromyography (EMG) to control assistive devices require enhancement. This study aims to enhance motor control capabilities by integrating EEG and EMG signals using a Transformer-based deep learning model. Ten able-bodies subjects performed center-out tasks on a low-cost upper limb rehabilitation table, capturing 2D kinematic data, EEG, and EMG signals simultaneously. The tasks varied in complexity across four levels. Preprocessed EEG and EMG signals were fused and given as input to the proposed model, which was evaluated using three performance metrics. Results showed that the EEG-EMG combined model achieved 87.27% accuracy across all the four levels. Furthermore, the model's output successfully controlled a humanoid robot to replicate similar movements. These findings highlight the efficacy of combined EEG-EMG data in improving accuracy and performance in BCI applications, advancing assistive technologies and neurorehabilitation interventions.

关键词： Deep learning Accuracy Humanoid robots Brain modeling Transformers Motors Electromyography Electroencephalography Data models Brain-computer interfaces

Long-Term Invariant Local Features via Implicit Cross-Domain Correspondences

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Pataki, Zador Altillawi, Mohammad Kanakis, Menelaos Pautrat, Rémi Shen, Fengyi Liu, Ziyuan Van Gool, Luc Pollefeys, Marc The Computer Vision and Geometry Lab Department of Computer Science ETH Zurich Switzerland The Computer Vision Center CVC-Barcelona The Intelligent Robotics Cloud Technology lab of Huawei-Munich Germany The Computer Vision Lab Department Electrical Engineering ETH Zurich Switzerland The Intelligent Robotics Cloud Technology lab of Huawei-Munich Germany The Intelligent Robotics Cloud Technology lab of Huawei-Munich Germany The Center for Processing Speech and Images KU Leuven The Computer Vision Lab ETH Zurich Switzerland

Modern learning-based visual feature extraction networks perform well in intra-domain localization, however, their performance significantly declines when image pairs are captured across long-term visual domain variations, such as different seasonal and daytime variations. In this paper, our first contribution is a benchmark to investigate the performance impact of long-term variations on visual localization. We conduct a thorough analysis of the performance of current state-of-the-art feature extraction networks under various domain changes and find a significant performance gap between intra- and cross-domain localization. We investigate different methods to close this gap by improving the supervision of modern feature extractor networks. We propose a novel data-centric method, Implicit Cross-Domain Correspondences (iCDC). iCDC represents the same environment with multiple Neural Radiance Fields, each fitting the scene under individual visual domains. It utilizes the underlying 3D representations to generate accurate correspondences across different long-term visual conditions. Our proposed method enhances cross-domain localization performance, significantly reducing the performance gap. When evaluated on popular long-term localization benchmarks, our trained networks consistently outperform existing methods. This work serves as a substantial stride toward more robust visual localization pipelines for long-term deployments, and opens up research avenues in the development of long-term invariant descriptors. Copyright © 2023, The Authors. All rights reserved.

关键词： Feature extraction