检索结果-内蒙古大学图书馆

Pseudo-LiDAR for Visual Odometry

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Deng, Huiying Wang, Guangming Feng, Zhiheng Jiang, Chaokang Wu, Xinrui Miao, Yanzi Wang, Hesheng Advanced Robotics Research Center AI Research Institute School of Information and Control Engineering China University of Mining and Technology Xuzhou221116 China Department of Automation Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Engineering Research Center of Intelligent Control and Management Shanghai Jiao Tong University Shanghai200240 China

As one of the important tasks in the field of robotics and machine vision, LiDAR/visual odometry provides tremendous help for various applications such as navigation, location, etc. In the existing methods, LiDAR odometry shows superior performance, but visual odometry is still widely used for its price advantage. Conventionally, the task of visual odometry mainly rely on the input of continuous images. However, it is very complicated for the odometry network to learn the epipolar geometry information provided by the images. In this paper, the concept of pseudo-LiDAR is introduced into the odometry to solve this problem. The pseudo-LiDAR point cloud back-projects the depth map generated by the image into the 3D point cloud, which changes the way of image representation. Compared with the stereo images, the pseudo-LiDAR point cloud generated by the stereo matching network can get the explicit 3D coordinates. Since the 6 Degrees of Freedom (DoF) pose transformation occurs in 3D space, the 3D structure information provided by the pseudo-LiDAR point cloud is more direct than the image. Compared with sparse LiDAR, the pseudo-LiDAR has a denser point cloud. In order to make full use of the rich point cloud information provided by the pseudo-LiDAR, a projection-aware dense odometry pipeline is adopted. Most previous LiDAR-based algorithms sampled 8192 points from the point cloud as input to the odometry network. The projection-aware dense odometry pipeline takes all the pseudo-LiDAR point clouds generated from the images except for the error points as the input to the network. While making full use of the 3D geometric information in the images, the semantic information in the images is also used in the odometry task. The fusion of 2D-3D is achieved in an image-only based odometry. Experiments on the KITTI dataset prove the effectiveness of our method. To the best of our knowledge, this is the first visual odometry method using pseudo-LiDAR. Copyright © 2022, The Authors. A

关键词： Pipelines

Knowledge-aware Graph Transformer for Pedestrian Trajectory Prediction

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Yu Zhang, Yuexin Li, Kunming Qiao, Yongliang Worrall, Stewart Li, You-Fu Kong, He Shenzhen518055 China Department of Mechanical Engineering City University of Hong Kong Hong Kong School of Automation Guangdong Polytechnic Normal University Guangzhou510665 China Australian Centre for Field Robotics The University of Sydney NSW2006 Australia Australian Institute for Machine Learning The University of Adelaide SA5005 Australia Shenzhen Key Laboratory of Control Theory and Intelligent Systems SUSTech Shenzhen518055 China Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities SUSTech Shenzhen518055 China

Predicting pedestrian motion trajectories is crucial for path planning and motion control of autonomous vehicles. Accurately forecasting crowd trajectories is challenging due to the uncertain nature of human motions in different environments. For training, recent deep learning-based prediction approaches mainly utilize information like trajectory history and interactions between pedestrians, among others. This can limit the prediction performance across various scenarios since the discrepancies between training datasets have not been properly incorporated. To overcome this limitation, this paper proposes a graph transformer structure to improve prediction performance, capturing the differences between the various sites and scenarios contained in the datasets. In particular, a self-attention mechanism and a domain adaption module have been designed to improve the generalization ability of the model. Moreover, an additional metric considering crossdataset sequences is introduced for training and performance evaluation purposes. The proposed framework is validated and compared against existing methods using popular public datasets, i.e., ETH and UCY. Experimental results demonstrate the improved performance of our proposed scheme. © 2024, CC BY.

关键词： Trajectories

Sim4EndoR: A Reinforcement Learning Centered Simulation Platform for Task Automation of Endovascular robotics

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Yao, Tianliang Ban, Madaoji Lu, Bo Pei, Zhiqiang Qi, Peng Department of Control Science and Engineering College of Electronics and Information Engineering Shanghai Institute of Intelligent Science and Technology Tongji University Shanghai200092 China Department of Electrical and Electronic Engineering Faculty of Engineering The University of Hong Kong 999077 Hong Kong Robotics and Microsystems Center School of Mechanical and Electric Engineering Soochow University Jiangsu Suzhou China School of Oriental Pan-Vascular Devices Innovation College University of Shanghai for Science and Technology 516 Jungong Road Shanghai200093 China State Key Laboratory of Cardiovascular Diseases Medical Innovation Center Shanghai East Hospital School of Medicine Tongji University Shanghai200092 China

Robotic-assisted percutaneous coronary intervention (PCI) holds considerable promise for elevating precision and safety in cardiovascular procedures. Nevertheless, current systems heavily depend on human operators, resulting in variability and the potential for human error. To tackle these challenges, Sim4EndoR, an innovative reinforcement learning (RL) based simulation environment, is first introduced to bolster task-level autonomy in PCI. This platform offers a comprehensive and risk-free environment for the development, evaluation, and refinement of potential autonomous systems, enhancing data collection efficiency and minimizing the need for costly hardware trials. A notable aspect of the groundbreaking Sim4EndoR is its reward function, which takes into account the anatomical constraints of the vascular environment, utilizing the geometric characteristics of vessels to steer the learning process. By seamlessly integrating advanced physical simulations with neural network-driven policy learning, Sim4EndoR fosters efficient sim-to-real translation, paving the way for safer, more consistent robotic interventions in clinical practice, ultimately improving patient outcomes. © 2025, CC BY.

关键词： Reinforcement learning

EEG-GNet: GCN-Based EEG Signal Fatigue Detection Network for Edge Devices

学校读者我要写书评

暂无评论

EEG-GNet: GCN-Based EEG Signal Fatigue Detection Network for...

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Fuquan Zhang Yu Wu Xinxin Xu Chuansheng Wang Minjia Ma Antoni Grau Jiayan Huang School of Computer and Big Data Minjiang University Fujian Provincial Key Laboratory of Information Processing and Intelligent Control Minjiang University Fuzhou China College of New Engineering Industry Putian University Putian China Department of Automatic Control Polytechnic University of Catalonia Barcelona Spain School of Robotics Xi’an Jiaotong-Liverpool University Suzhou China College of New Engineering Industry Putian University Fujian Ruituo Information Technology Limited Company Putian China

ISBN: (数字)9798350386226

ISBN: (纸本)9798350386233

Fatigue driving is a common potential traffic safety hazard. To detect and analysis the driver Fatigue degree in real-time, more attention have been increasing paid to application research of EEG fatigue detection device. However, existing methods suffer from complex model structure or large-scale model parameters. In the other words, they requires high computational consumption and large memory footprint, which creates a contradiction between model and portable EEG machine with limited hardware resources. In this work, we take both time and frequency domains of EEG signal into account and design an lightweight and efficient driver fatigue detection network based on GCN (EEG-GNet), which is available edge-end device application. Experiments on 4th Raspberry Pi on a public baseline dataset show that our EEG-GNet outperforms the state-of-the-art methods and takes good tradeoff between detection accuracy and resource consumption. Our EEG-GNet provides a new potential opportunity for future applications in practical portable/wearable (P/W) devices.

关键词： Accuracy Computational modeling Image edge detection Frequency-domain analysis Fatigue Brain modeling Feature extraction Electroencephalography Real-time systems Time-domain analysis

Distributed Finite-Time Cooperative Localization for Three-Dimensional Sensor Networks

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Wu, Jinze Zino, Lorenzo Lin, Zhiyun Rizzo, Alessandro The Department of Electronics and Telecommunications Politecnico di Torino Torino Italy Shenzhen Key Laboratory of Control Theory and Intelligent Systems School of System Design and Intelligent Manufacturing Southern University of Science and Technology Shenzhen China Peng Cheng Laboratory Shenzhen China The Institute for Invention Innovation and Entrepreneurship New York University Tandon School of Engineering BrooklynNY United States

This paper addresses the distributed localization problem for a network of sensors placed in a three-dimensional space, in which sensors are able to perform range measurements, i.e., measure the relative distance between them, and exchange information on a network structure. First, we derive a necessary and sufficient condition for node localizability using barycentric coordinates. Then, building on this theoretical result, we design a distributed localizability verification algorithm, in which we propose and employ a novel distributed finite-time algorithm for sum consensus. Finally, we develop a distributed localization algorithm based on conjugate gradient method, and we derive a theoretical guarantee on its performance, which ensures finite-time convergence to the exact position for all localizable nodes. The efficiency of our algorithm compared to the existing ones from the state-of-the-art literature is further demonstrated through numerical simulations. © 2023, CC BY.

关键词： Conjugate gradient method

SLAM-Based Joint Calibration of Differential RSS Sensor Array and Source Localization

学校读者我要写书评

暂无评论

SLAM-Based Joint Calibration of Differential RSS Sensor Arra...

Annual Conference of Industrial electronics Society

作者： Linya Fu Xu Qiao Shoudong Huang Guoqiang Mao Zhiyun Lin Youfu Li He Kong Shenzhen Key Laboratory of Control Theory and Intelligent Systems Southern Uni. of Sci. and Tech. Shenzhen China Robotics Institute Uni. of Technology Sydney Sydney Australia State Key Laboratory of Integrated Services Networks Xidian University China Department of Mechanical Engineering City University of Hong Kong China Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities Southern Uni. of Sci. and Tech. Shenzhen China

Sensor arrays generating differential received signal strength (DRSS) measurements have found many applications in robotics. However, accurate calibration of these sensor arrays remains a challenge. Most existing methods are impractical in that they assume to know signal source positions or certain parameters (i.e., path loss exponent), and try to estimate the others. In this paper, we adopt graph simultaneous localization and mapping (SLAM) as a general framework for jointly estimating the source positions and parameters of the DRSS sensor array. Our contributions are twofold. On the one hand, by using a Fisher information matrix approach, we conduct a systematic observability analysis of the corresponding SLAM setup for the calibration problem. On the other hand, we propose an effective procedure to select the initial value which is fed to Levenberg-Marquardt iterations for further improving optimization accuracy and convergence. Extensive simulation and hardware experiments show that the proposed method renders high-quality calibration results. All the codes and data are publicly available at https://***/SUSTech2022/DRSS-sensor-array-calibration.

关键词：

Fault Diagnostic Opportunities for Electromagnetic Coils of Active Magnetic Bearings using Physics-of-Failure Analysis

学校读者我要写书评

暂无评论

Fault Diagnostic Opportunities for Electromagnetic Coils of ...

System Reliability and Safety engineering (SRSE), International Conference on

作者： Ruiqi Li Kai Wang Peng Zeng Jiwei Cao State Key Laboratory of Robotics Shenyang Institute of Automation Chinese Academy of Sciences Shenyang China Key Laboratory of Networked Control Systems Chinese Academy of Sciences Shenyang China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Shenyang China University of Chinese Academy of Sciences Beijing China Shenyang Institute of Automation Chinese Academy of Sciences Shenyang China Department of Electrical Engineering Harbin Institute of Technology China

Active magnetic bearings (AMBs) have many advantages over traditional oil bearings due to their non-contact characteristics. They are environmentally friendly solution and have been proven to be highly reliable and available. Electromagnetic coils are vital components of AMB and they are failure prone. In this paper, the failure mode of magnetic bearing coil and its corresponding failure mechanism are reviewed by FMMEA method, and the existing coil fault diagnosis methods are introduced. Future directions for coil insulation health monitoring aiming at the application characteristics of AMBs are also discussed.

关键词：

Pedestrian Simulation by Learning from Online Human Demonstration with VR Headset

学校读者我要写书评

暂无评论

Pedestrian Simulation by Learning from Online Human Demonstr...

International Conference on intelligent Transportation

作者： Feiyang Yu Tingting Long Zhichao Cui Linhai Xu Li Li Chi Zhang National Key Laboratory of Human-Machine Hybrid Augmented Intelligence National Engineering Research Center for Visual Information and Applications Institute of Artificial Intelligence and Robotics Xi'an Jiaotong University Xi'an Shaanxi China Department of Automation BNRist Tsinghua University Beijing China School of Electronics and Control Engineering Chang'an University.

Pedestrian simulation is essential for verifying the safety of autonomous vehicles in simulators. The goal of pedes-trian simulation is to create realistic virtual representations of the pedestrian. However, current simulations lack empirical knowledge about real pedestrian behavior. In this paper, we propose a virtual reality (VR)-based method that enables real-time interaction between an individual and a simulated traffic environment. Our human-in-the-loop approach incorporates the empirical knowledge of a VR user into the simulator. The user can view the traffic simulation by wearing a VR device, which includes a head-mounted display and two controllers and provides sparse sensor data about their position and rotation. We combine representation learning techniques to develop a full-body motion-tracking agent that takes in sparse signals from the VR device and simulates full-body motions. This agent can estimate the full-body pose and visualize a pedestrian avatar in a traffic simulation scene. To validate our method, we constructed a VR traffic simulation environment and demonstrated that our approach can produce a pedestrian avatar whose behavior closely resembles that of the real VR user.

关键词：

Joint Routing and Charging Problem of Electric Vehicles with Incentive-Aware Customers Considering Spatio-Temporal Charging Prices

学校读者我要写书评

暂无评论

SSRN

SSRN 2022年

作者： Yao, Canqi Chen, Shibo Salazar, Mauro Yang, Zaiyue School of Mechatronics Engineering Harbin Institute of Technology Harbin150000 China Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems Department of Mechanical and Energy Engineering The Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities Southern University of Science and Technology Shenzhen518055 China Control Systems Technology Group Department of Mechanical Engineering Eindhoven University of Technology EindhovenMB 5600 Netherlands

This paper investigates the scheduling problem of a fleet of electric vehicles, providing mobility as a service to a set of time-specified customers, where the operator needs to solve the routing and charging problem jointly for each EV. Hereby we consider incentive-aware customers and propose that the operator offers monetary incentives to customers in exchange for time flexibility. In this way, the fleet operator can achieve a routing and charging schedule with lower costs, whilst the customers receive monetary compensation for their flexibility. Specifically, we first propose a bi-level optimization model whereby the fleet operator optimizes the routing and charging schedule accounting for the spatio-temporal varying charging price, jointly with a monetary incentive to reimburse the delivery time flexibility experienced by the customers. Concurrently the customers choose their own time flexibility by minimizing their own cost. Second, we cope with the computational burden coming from this nonlinear bi-level optimization model with an accurate reformulation approach consisting of the KKT optimality conditions, a Big-M-based linearization method, and the zero duality gap of convex optimization problems. This way, we convert the proposed problem into a single-level optimization problem, which can be solved by a strengthened generalized Benders decomposition method holding a faster convergence rate than the generalized Benders decomposition method. To evaluate the effectiveness of the proposed mathematical model, we carry out numerous simulation experiments by using the VRP-REP data of Belgium. The numerical results showcase that the proposed mathematical model can reduce the delivery fees for the customers together with the cost of operation incurred by the fleet operator. © 2022, The Authors. All rights reserved.

关键词： Sales