Visual place recognition has gained popularity in recent years. Mainstream convolutional neural network-based methods formulate it as a ranking task and optimize it in the paradigm of deep metric learning, however, th...
详细信息
Visual place recognition has gained popularity in recent years. Mainstream convolutional neural network-based methods formulate it as a ranking task and optimize it in the paradigm of deep metric learning, however, the ranking-motivated losses concern only the ranking relationship for each query image and the compactness of intraplace feature distribution is seldom considered. It is still challenging due to varying viewpoints, illuminations, and even dynamic objects. In this article, a novel multitask learning framework is proposed, which combines the existing triplet ranking task and our designed binary classification task to jointly optimize the network for better generalization capability. Specifically, a binary classification network with the corresponding binary cross-entropy loss is designed in the classification task. In this way, the intraplace feature compactness and interplace feature separability are reinforced. At the testing stage, this classification network is discarded without increasing the computation cost. Furthermore, an attention module is presented to promote the network to concentrate on the salient regions by assigning different importance to each spatial position. Our method achieves the top-10 recalls of 97.27%, 94.6%, and 96.93% on Pitts250k-test, Tokyo 24/7, and TokyoTM-val data sets, respectively. Extensive experiments prove that the proposed network can learn discriminative global features with better robustness to viewpoints and environmental variations.
作者:
Li, XuanWang, Fei-YuePeng Cheng Lab
Dept Math & Theories Shenzhen 518055 Peoples R China Chinese Acad Sci
Inst Automation State Key Lab Management & Control Complex Syst Beijing 100190 Peoples R China
The first journal impact factor (IF) of IEEE TIV is 5.009 with a CiteScore = 10.9 in 2022, signifying a promising start for our periodical. By April 2023, our real-time IF stands at 7.03 according to Web of Science, a...
The first journal impact factor (IF) of IEEE TIV is 5.009 with a CiteScore = 10.9 in 2022, signifying a promising start for our periodical. By April 2023, our real-time IF stands at 7.03 according to Web of Science, and CiteScore from Elsevier is 11.6. These numbers indicate that IEEE TIV is among the top-tier publications in the related fields.
The emergence of intelligent vehicles brings unique opportunities for the service industry. This study introduces the concept of autonomous services, a new service paradigm, and autonomous services systems, in which i...
详细信息
The emergence of intelligent vehicles brings unique opportunities for the service industry. This study introduces the concept of autonomous services, a new service paradigm, and autonomous services systems, in which intelligent vehicles are vital enabling technology. Specifically, autonomous services aim to minimize unnecessary human participation and effort in the service process by leveraging intelligence for service delivery, rather than relying on simple stimulus-response or rule-based program behavior. This letter reports on the first Decentralized and Hybrid Workshop (DHW) on autonomous services, aiming to reduce the cost of human labor and improve the quality and efficiency of service while tackling the challenges posed by a shrinking workforce. The introduction of intelligent vehicles enhances the capability of the service systems, while also significantly increasing complexity. To address the challenges associated with complexity, the systems Engineering (SE) approach is indispensable. The Requirements-Functional-Logical-Physical (RFLP) framework can implement Model-Based System Engineering (MBSE) and help researchers and managers to understand the autonomous services system more comprehensively, so as to better operate and manage it. We substitute "Implementation" for "Physical" in this research to define and elaborate on the autonomous services system. Finally, we outline the potential research opportunities within the autonomous services system.
In recent years,the introduction of Siamese network has brought new vitality to the object tracking ***,high-performance Siamese trackers cannot run at a real-time speed on mobile devices due to their complex and huge...
详细信息
ISBN:
(数字)9789887581536
ISBN:
(纸本)9781665482561
In recent years,the introduction of Siamese network has brought new vitality to the object tracking ***,high-performance Siamese trackers cannot run at a real-time speed on mobile devices due to their complex and huge *** distillation is a common and effective model compression method,but it is difficult to be applied to the challenging task like object *** find out the fundamental cause is that the imbalance between the foreground and background in the object tracking task,which aggravates the problem of insufficient feature extraction ability of small ***,we propose the attention mask distillation(AMD) to help the student tracker focus on the foreground area faster and more *** attention mask can be easily obtained from the feature maps and brings fine-granularity to the traditional binary *** experimental results on OTB100 and VOT2018 show that our method enables the student tracker perform as well as the teacher *** the same time,it's able to run on the CPU at a hyper-real-time of 66 fps and achieves nearly 9 times model compression *** low computational and storage costs make it possible to deploy high-performance trackers on resource-constrained platforms.
The logistics and transportation industry has made significant progress in improving sustainability, efficiency, and accessibility, primarily due to the continuous development of technologies, including clean energy, ...
详细信息
The logistics and transportation industry has made significant progress in improving sustainability, efficiency, and accessibility, primarily due to the continuous development of technologies, including clean energy, advanced algorithms, unmanned vehicles, and privacy-enhancing techniques. Along with these advancements, the Mobility 5.0 paradigm has been proposed in the ITSS Intelligent Vehicle 5.0 project meeting. This letter discusses the changes in the supply and demand of mobility resources and looks at the basic components on which the implementation of the Mobility 5.0 relies on. By integrating emerging technologies into Cyber-Physical-Social systems (CPSS), we believe that Mobility 5.0 has tremendous potential in shaping a new era of intelligent logistics and transportation services and will bring significant benefits to individuals, businesses, the government, and the entire society.
The rapid and orderly evacuation of passengers at the railway hub station in case of emergencies is an important issue for railway safety and efficiency. In this paper, a robot-guided passenger evacuation method is pr...
详细信息
The rapid and orderly evacuation of passengers at the railway hub station in case of emergencies is an important issue for railway safety and efficiency. In this paper, a robot-guided passenger evacuation method is proposed to help passengers search evacuation paths and avoid potential risks. The number and initial positions of robots are determined by using a k-means clustering approach. The exit assignment and evacuation paths of robots are calculated by using a hybrid bi-level optimization approach taking into account the cooperative mechanism between robots. Then, a robot-guided crowd evacuation dynamical model is built based on a modified social force model, in which a navigation force is introduced to influence the speed and direction of evacuees. A case study of a typical railway hub station is used to demonstrate the effectiveness of the proposed approach. The scenarios of the mall and platform are designed to verify the evacuation efficiency under different robot distribution schemes. The experimental results prove that setting up robots can effectively reduce evacuation time, and the utilization of exits is more balanced. The proposed optimal scheme shows the best performance in evacuation efficiency, including evacuation time and exit utilization rate, compared to the uniform distribution scheme and no robot scheme.
This paper studies the finite-time filter design of semi-Markov jump system by Takagi-Sugeno (T-S) fuzzy rules. Asynchronous mode-dependent delays are concerned to describe more practical random features, which implie...
详细信息
This paper studies the finite-time filter design of semi-Markov jump system by Takagi-Sugeno (T-S) fuzzy rules. Asynchronous mode-dependent delays are concerned to describe more practical random features, which implies that the semi-Markov process of system state is different from another semiMarkov process of mode-dependent time-varying delays. With the help of model transformation as well as mode-dependent Lyapunov-Krasovskii function method, sufficient criteria are first established for maintaining finite-time passivity performance of filtering errors. Then, the matrix technique is employed to synthesize the filter gain design. In the end, the applicableness and effectiveness of our developed results are confirmed by an illustrative example. (c) 2021 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.
The model predictive control (MPC) can provide the benefit of optimality (sub-optimality, exactly speaking) and explicitly treat hard constraints in both states and inputs, which makes it an attractive approach in the...
详细信息
The model predictive control (MPC) can provide the benefit of optimality (sub-optimality, exactly speaking) and explicitly treat hard constraints in both states and inputs, which makes it an attractive approach in the fields of robotics. However, the performance of this approach heavily depends on the system model and it is computationally intensive, which hinders its application in the real-time control of robotic systems with fast dynamics, such as the robotic manipulators. Data-driven modeling approaches based on the Koopman operator have the potential to remove the barriers to adopting the MPC in robotics, through learning a globally linear model. In this letter, we propose a novel Koopman model-the structured deep Koopman model, which can improve the accuracy of the learned linear model and reduce the number of states in the lifted space, through exploiting the deep Lipschitz neural network and making the lifted dynamics structured. We also prove the rationality of the presented method and provide a new perspective on Koopman operator-based models, which brings the local and global linearization methods under the same umbrella. The effectiveness of the presented method has been verified by simulations and a real-world robotic experiment.
This article introduces a flexible hand-eye calibration technique for a 3-D sensor from a reconstruction perspective, with no need for a specialized and accurate calibration rig. Our intention is to find the hand-eye ...
详细信息
This article introduces a flexible hand-eye calibration technique for a 3-D sensor from a reconstruction perspective, with no need for a specialized and accurate calibration rig. Our intention is to find the hand-eye relation that simultaneously aligns multiview point clouds of a common scene into the robot base frame, namely simultaneous calibration and reconstruction. To achieve this goal, a novel variant of iterative closest point (ICP) algorithm based on the Gauss-Newton method and Lie algebra is proposed, which iteratively transforms multiview point clouds into the robot base frame, estimates point-to-point correspondences between point clouds then refines the hand-eye relation to minimize the Euclidean distance between corresponding points. In addition to the calibration result, it returns a preliminary reconstruction as a byproduct. Cases of degeneracy and applicable conditions are given and proved. Using arbitrary daily objects with no prior information and a real robotic eye-in-hand system, we verify our method feasible and effective.
LIDAR point clouds are less affected by the weather and possess more depth of field than 2D images. However, sparsity and disorder of point clouds bring challenges for 3D object tracking due to the difficulty in detec...
详细信息
LIDAR point clouds are less affected by the weather and possess more depth of field than 2D images. However, sparsity and disorder of point clouds bring challenges for 3D object tracking due to the difficulty in detecting and encoding. In addition, ineffective candidate proposals increase the phenomenon of the loss of target tracking or wrong target tracking. In this paper, we propose an Orientation-variant Siamese 3D object tracking network that utilizes a Detection based Sampling module to generate candidate proposals (OS-DS tracker). The Detection based Sampling module is used to cut the excessive and useless proposals. And the multivariate Gaussian sampling generates the candidate proposals when the objects are not detected. Concretely, we first pre-train PointRCNN Network to globally detect objects from LIDAR point clouds. Then the 3D detected objects are refined by Candidate Regions Sampling to generate candidate proposals. Meanwhile, to make the feature vectors more discriminative, we design an Orientation-variant Siamese Auto-encoder, i.e., tracking loss regress to the intersection over union (IOU) of the template box and the candidate region boxes. Our method is tested on the KITTI dataset and the SHIP Tracking dataset. Compared with the previous state-of-the-arts, the proposed method outperforms in vessel tracking with 5.2%/2.1% improvement in Success and Precision.
暂无评论