检索结果-内蒙古大学图书馆

DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Construction

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Siyu Lin, Jiacheng Shi, Hao Zhang, Jiaming Wang, Song Yao, You Li, Zhiyong Yang, Kailun The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China The College of Computer Science and Electronic Engineering Hunan University Changsha410082 China The State Key Laboratory of Extreme Photonics and Instrumentation The National Engineering Research Center of Optical Instrumentation Zhejiang University Hangzhou310027 China The Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Karlsruhe76131 Germany The College of Computer Science Zhejiang University Hangzhou310027 China The USC Viterbi School of Engineering The University of Southern California Los AngelesCA90089 United States

Temporal information plays a pivotal role in Bird’s-Eye-View (BEV) driving scene understanding, which can alleviate the visual information sparsity. However, the indiscriminate temporal fusion method will cause the barrier of feature redundancy when constructing vectorized High-Definition (HD) maps. In this paper, we revisit the temporal fusion of vectorized HD maps, focusing on temporal instance consistency and temporal map consistency learning. To improve the representation of instances in single-frame maps, we introduce a novel method, DTCLMapper. This approach uses a dual-stream temporal consistency learning module that combines instance embedding with geometry maps. In the instance embedding component, our approach integrates temporal Instance Consistency Learning (ICL), ensuring consistency from vector points and instance features aggregated from points. A vectorized points pre-selection module is employed to enhance the regression efficiency of vector points from each instance. Then aggregated instance features obtained from the vectorized points preselection module are grounded in contrastive learning to realize temporal consistency, where positive and negative samples are selected based on position and semantic information. The geometry mapping component introduces Map Consistency Learning (MCL) designed with self-supervised learning. The MCL enhances the generalization capability of our consistent learning approach by concentrating on the global location and distribution constraints of the instances. Extensive experiments on well-recognized benchmarks indicate that the proposed DTCLMapper achieves state-of-the-art performance in vectorized mapping tasks, reaching 61.9% and 65.1% mAP scores on the nuScenes and Argoverse datasets, respectively. The source code is available at https://***/lynn-yu/DTCLMapper. Copyright © 2024, The Authors. All rights reserved.

关键词： Contrastive Learning

Quantum machine learning for multiclass classification beyond kernel methods

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Ding, Chao Wang, Shi Wang, Yaonan Gao, Weibo College of Electrical and Information Engineering Hunan University Changsha410082 China Division of Physics and Applied Physics School of Physical and Mathematical Sciences Nanyang Technological University Singapore637371 Singapore National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China Centre for Quantum Technologies National University of Singapore Singapore117543 Singapore The Photonics Institute Centre for Disruptive Photonic Technologies Nanyang Technological University Singapore637371 Singapore

Quantum machine learning is considered one of the current research fields with great potential. In recent years, Havlíček et al. [Nature 567, 209-212 (2019)] have proposed a quantum machine learning algorithm with quantum-enhanced feature spaces, which effectively addressed a binary classification problem on a superconducting processor and offered a potential pathway to achieving quantum advantage. However, a straightforward binary classification algorithm falls short in solving multiclass classification problems. In this paper, we propose a quantum algorithm that rigorously demonstrates that quantum kernel methods enhance the efficiency of multiclass classification in real-world applications, providing quantum advantage. To demonstrate quantum advantage, we design six distinct quantum kernels within the quantum algorithm to map input data into quantum state spaces and estimate the corresponding quantum kernel matrices. The results from quantum simulations reveal that the quantum algorithm outperforms its classical counterpart in handling six real-world multiclass classification problems. Furthermore, we leverage a variety of performance metrics to comprehensively evaluate the classification and generalization performance of the quantum algorithm. The results demonstrate that the quantum algorithm achieves superior classification and better generalization performance relative to classical counterparts. Copyright © 2024, The Authors. All rights reserved.

关键词： Quantum efficiency

TokenHPE: Learning Orientation Tokens for Efficient Head Pose Estimation via Transformers

学校读者我要写书评

暂无评论

TokenHPE: Learning Orientation Tokens for Efficient Head Pos...

Conference on Computer vision and Pattern Recognition (CVPR)

作者： Cheng Zhang Hai Liu Yongjian Deng Bochen Xie Youfu Li National Engineering Research Center for E-Learning Central China Normal University Wuhan China College of Computer Science Beijing University of Technology Beijing China Engineering Research Center of Intelligence Perception and Autonomous Control Ministry of Education Beijing China Department of Mechanical Engineering City University of Hong Kong Kowloon Hong Kong China

Head pose estimation (HPE) has been widely used in the fields of human machine interaction, self-driving, and attention estimation. However, existing methods cannot deal with extreme head pose randomness and serious occlusions. To address these challenges, we identify three cues from head images, namely, neighborhood similarities, significant facial changes, and critical minority relationships. To leverage the observed findings, we propose a novel critical minority relationship-aware method based on the Transformer architecture in which the facial part relationships can be learned. Specifically, we design several orientation tokens to explicitly encode the basic orientation regions. Meanwhile, a novel token guide multiloss function is designed to guide the orientation tokens as they learn the desired regional similarities and relationships. We evaluate the proposed method on three challenging benchmark HPE datasets. Experiments show that our method achieves better performance compared with state-of-the-art methods. Our code is publicly available at https://***/zc2023/TokenHPE.

关键词：

GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Siyu Yang, Kailun Shi, Hao Wang, Song Yao, You Li, Zhiyong The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China The State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China The College of Computer Science Zhejiang University Hangzhou310027 China Shanghai Supremind Technology Company Ltd. Shanghai201210 China The USC Viterbi School of Engineering The University of Southern California Los AngelesCA90089 United States

Online High-Definition (HD) maps have emerged as the preferred option for autonomous driving, overshadowing the counterpart offline HD maps due to flexible update capability and lower maintenance costs. However, contemporary online HD map models embed parameters of visual sensors into training, resulting in a significant decrease in generalization performance when applied to visual sensors with different parameters. Inspired by the inherent potential of Inverse Perspective Mapping (IPM), where camera parameters are decoupled from the training process, we have designed a universal map generation framework, GenMapping. The framework is established with a triadic synergy architecture, including principal and dual auxiliary branches. When faced with a coarse road image with local distortion translated via IPM, the principal branch learns robust global features under the state space models. The two auxiliary branches are a dense perspective branch and a sparse prior branch. The former exploits the correlation information between static and moving objects, whereas the latter introduces the prior knowledge of OpenStreetMap (OSM). The triple-enhanced merging module is crafted to synergistically integrate the unique spatial features from all three branches. To further improve generalization capabilities, a Cross-View Map Learning (CVML) scheme is leveraged to realize joint learning within the common space. Additionally, a Bidirectional Data Augmentation (BiDA) module is introduced to mitigate reliance on datasets concurrently. A thorough array of experimental results shows that the proposed model surpasses current state-of-the-art methods in both semantic mapping and vectorized mapping, while also maintaining a rapid inference speed. Moreover, in cross-dataset experiments, the generalization of semantic mapping is improved by 17.3% in mIoU, while vectorized mapping is improved by 12.1% in mAP. The source code will be publicly available at https://***/lynn-yu/GenMappin

关键词： Photomapping

Container Detection System Using CNN Based Object Detectors 7

学校读者我要写书评

暂无评论

Container Detection System Using CNN Based Object Detectors

7th International Conference on Instrumentation, control, and Automation, ICA 2021

作者： Bandong, Steven Nazaruddin, Yul Yunazwin Joelianto, Endra Institut Teknologi Bandung Engineering Physics Doctoral Program Faculty of Industrial Technology Bandung Indonesia National Center for Sustainable Transportation Technology CRCS Instrumentation and Control Research Group Department of Engineering Physics Bandung Indonesia University Center of Excellence on Artificial Intelligence for Vision NLP and Big Data Analytics Institut Teknologi Bandung Instrumentation and Control Research Group Department of Engineering Physics Bandung Indonesia

ISBN: (纸本)9781665432955

The increase in free trade will also amplify the exchange of goods between countries and islands, especially in the seaports. The manual operation of the gantry-crane at the seaports has a risk due to human negligence. For that reason, automation is strongly needed in the loading and unloading of the container. Camera-based object detection is implemented to achieve this goal. In the recent years, CNN gives better accuracy in term of image classification, recognition and detection compared to the traditional method that use handcrafted features. In this paper, several advanced detection methods using CNN-based object detection, namely MobileNet, ResNet, and Faster RCNN are compared to detect and track the movement of containers. The results of the experiment show that the SSD ResNet and Faster RCNN methods are superior in terms of detection accuracy based on the Precision, Recall, Average Precision, and IoU values. MobileNet v3 excels in speed detection compared to the other methods. © 2021 IEEE.

关键词： Containers

A High-Speed Stable Polarization Encoder for Quantum Key Distribution

学校读者我要写书评

暂无评论

A High-Speed Stable Polarization Encoder for Quantum Key Dis...

Pacific Rim Conference on Lasers and Electro-Optics (CLEO/Pacific Rim)

作者： Ju Li Zexu Wang Changlei Wang Feifei Yin Kun Xu Huaxing Xu Yitang Dai State Key Laboratory of Information Photonics and Optical Communications Beijing University of Posts and Telecommunications Beijing China National Engineering Research Center for Public Safety Risk Perception and Control by Big Data China Academy of Electronics and Information Technology Beijing China CETC Academy of Electronics and Information Technology Group Co. Ltd. Beijing China

We report a high-speed polarization encoder which can be applied for quantum key distribution, resulting in an average bit error rate (BER) below 0.1% at a repetition frequency of 10 GHz under interference-free measur... 详细信息

ISBN: (数字)9798350372076

ISBN: (纸本)9798350372083

关键词： Frequency modulation Satellites Protocols Bit error rate Measurement uncertainty Sagnac interferometers Lasers and electrooptics

Computational Imaging for Machine perception: Transferring Semantic Segmentation beyond Aberrations

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Jiang, Qi Shi, Hao Gao, Shaohua Zhang, Jiaming Yang, Kailun Sun, Lei Ni, Huajian Wang, Kaiwei The State Key Laboratory of Extreme Photonics and Instrumentation The National Engineering Research Center of Optical Instrumentation Zhejiang University Hangzhou310027 China The Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Karlsruhe76131 Germany The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China Shanghai SUPREMIND Technology Company Ltd Shanghai201210 China

Semantic scene understanding with Minimalist Optical Systems (MOS) in mobile and wearable applications remains a challenge due to the corrupted imaging quality induced by optical aberrations. However, previous works only focus on improving the subjective imaging quality through the Computational Imaging (CI) technique, ignoring the feasibility of advancing semantic segmentation. In this paper, we pioneer the investigation of Semantic Segmentation under Optical Aberrations (SSOA) with MOS. To benchmark SSOA, we construct Virtual Prototype Lens (VPL) groups through optical simulation, generating Cityscapes-ab and KITTI-360-ab datasets under different behaviors and levels of aberrations. We look into SSOA via an unsupervised domain adaptation perspective to address the scarcity of labeled aberration data in real-world scenarios. Further, we propose Computational Imaging Assisted Domain Adaptation (CIADA) to leverage prior knowledge of CI for robust performance in SSOA. Based on our benchmark, we conduct experiments on the robustness of classical segmenters against aberrations. In addition, extensive evaluations of possible solutions to SSOA reveal that CIADA achieves superior performance under all aberration distributions, bridging the gap between computational imaging and downstream applications for MOS. The project page is at https://***/zju-jiangqi/CIADA. Copyright © 2022, The Authors. All rights reserved.

关键词： Aberrations

LF-VISLAM: A SLAM Framework for Large Field-of-View Cameras with Negative Imaging Plane on Mobile Agents

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wang, Ze Yang, Kailun Shi, Hao Li, Peng Gao, Fei Bai, Jian Wang, Kaiwei State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University China School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China State Key Laboratory of Industrial Control Technology Zhejiang University China Huzhou Institute of Zhejiang University Zhejiang University China

Simultaneous Localization And Mapping (SLAM) has become a crucial aspect in the fields of autonomous driving and robotics. One crucial component of visual SLAM is the Field-of-View (FoV) of the camera, as a larger FoV allows for a wider range of surrounding elements and features to be perceived. However, when the FoV of the camera reaches the negative half-plane, traditional methods for representing image feature points using (u, v, 1)T become ineffective. While the panoramic FoV is advantageous for loop closure, its benefits are not easily realized under large-attitude-angle differences where loop-closure frames cannot be easily matched by existing methods. As loop closure on wide-FoV panoramic data further comes with a large number of outliers, traditional outlier rejection methods are not directly applicable. To address these issues, we propose LF-VISLAM, a Visual Inertial SLAM framework for cameras with extremely Large FoV with loop closure. A three-dimensional vector with unit length is introduced to effectively represent feature points even on the negative half-plane. The attitude information of the SLAM system is leveraged to guide the feature point detection of the loop closure. Additionally, a new outlier rejection method Copyright © 2022, The Authors. All rights reserved.

关键词： Cameras

Globally-Optimal Event Camera Motion Estimation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Peng, Xin Wang, Yifu Gao, Ling Kneip, Laurent Mobile Perception Lab SIST ShanghaiTech University China Shanghai Institute Of Microsystems And Information Technology Chinese Academy Of Sciences China Australian National University Australia Shanghai Engineering Research Center Of Intelligent Vision And Imaging China

Event cameras are bio-inspired sensors that perform well in HDR conditions and have high temporal resolution. However, different from traditional frame-based cameras, event cameras measure asynchronous pixel-level brightness changes and return them in a highly discretised format, hence new algorithms are needed. The present paper looks at fronto-parallel motion estimation of an event camera. The flow of the events is modeled by a general homographic warping in a space-time volume, and the objective is formulated as a maximisation of contrast within the image of unwarped events. However, in stark contrast to prior art, we derive a globally optimal solution to this generally non-convex problem, and thus remove the dependency on a good initial guess. Our algorithm relies on branch-and-bound optimisation for which we derive novel, recursive upper and lower bounds for six different contrast estimation functions. The practical validity of our approach is supported by a highly successful application to AGV motion estimation with a downward facing event camera, a challenging scenario in which the sensor experiences fronto-parallel motion in front of noisy, fast moving textures. Copyright © 2022, The Authors. All rights reserved.

关键词： Cameras