检索结果-内蒙古大学图书馆

MC-NeRF: Multi-Camera Neural Radiance Fields for Multi-Camera Image Acquisition systems

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Gao, Yu Su, Lutong Liang, Hao Yue, Yufeng Yang, Yi Fu, Mengyin School of Automation Beijing Institute of Technology Beijing China State Key Laboratory of Intelligent Control and Decision of Complex System Beijing Institute of Technology Beijing China

Neural Radiance Fields (NeRF) use multi-view images for 3D scene representation, demonstrating remarkable performance. As one of the primary sources of multi-view images, multi-camera systems encounter challenges such as varying intrinsic parameters and frequent pose changes. Most previous NeRF-based methods assume a unique camera and rarely consider multi-camera scenarios. Besides, some NeRF methods that can optimize intrinsic and extrinsic parameters still remain susceptible to suboptimal solutions when these parameters are poor initialized. In this paper, we propose MC-NeRF, a method that enables joint optimization of both intrinsic and extrinsic parameters alongside NeRF. The method also supports each image corresponding to independent camera parameters. First, we tackle coupling issue and the degenerate case that arise from the joint optimization between intrinsic and extrinsic parameters. Second, based on the proposed solutions, we introduce an efficient calibration image acquisition scheme for multi-camera systems, including the design of calibration object. Finally, we present an end-to-end network with training sequence that enables the estimation of intrinsic and extrinsic parameters, along with the rendering network. Furthermore, recognizing that most existing datasets are designed for a unique camera, we construct a real multi-camera image acquisition system and create a corresponding new dataset, which includes both simulated data and real-world captured images. Experiments confirm the effectiveness of our method when each image corresponds to different camera parameters. Specifically, we use multi-cameras, each with different intrinsic and extrinsic parameters in real-world system, to achieve 3D scene representation without providing initial poses. The Code and supplementary materials are available at https://***/MC-NeRF Copyright © 2023, The Authors. All rights reserved.

关键词： Parameter estimation

DR-WLC: Dimensionality Reduction cognition for object detection and pose estimation by Watching, Learning and Checking

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Gao, Yu Xu, Xi Jiang, Tianji Chen, Siyuan Yang, Yi Yue, Yufeng Fu, Mengyin School of Automation Beijing Institute of Technology Beijing China State Key Laboratory of Intelligent Control and Decision of Complex System Beijing Institute of Technology Beijing China

Object detection and pose estimation are difficult tasks in robotics and autonomous driving. Existing object detection and pose estimation methods mostly adopt the same-dimensional data for training. For example, 2D object detection usually requires a large amount of 2D annotation data with high cost. Using high-dimensional information to supervise lower-dimensional tasks is a feasible way to reduce datasets size. In this work, the DR-WLC, a dimensionality reduction cognitive model, which can perform both object detection and pose estimation tasks at the same time is proposed. The model only requires 3D model of objects and unlabeled environment images (with or without objects) to finish the training. In addition, a bounding boxes generation strategy is also proposed to build the relationship between 3D model and 2D object detection task. Experiments show that our method can qualify the work without any manual annotations and it is easy to deploy for practical applications. Source code is at https: //***/IN2-ViAUn/DR-WLC. Copyright © 2023, The Authors. All rights reserved.

关键词： Object detection

Sector Patch Embedding: An Embedding Module Conforming to The Distortion Pattern of Fisheye Image

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Yang, Dianyi Tang, Jiadong Gao, Yu Yang, Yi Fu, Mengyin School of Automation Beijing Institute of Technology Beijing China State Key Laboratory of Intelligent Control and Decision of Complex System Beijing Institute of Technology Beijing China

Fisheye cameras suffer from image distortion while having a large field of view(LFOV). And this fact leads to poor performance on some fisheye vision tasks. One of the solutions is to optimize the current vision algorithm for fisheye images. However, most of the CNN-based methods and the Transformer-based methods lack the capability of leveraging distortion information efficiently. In this work, we propose a novel patch embedding method called Sector Patch Embedding(SPE), conforming to the distortion pattern of the fisheye image. Furthermore, we put forward a synthetic fisheye dataset based on the ImageNet-1K and explore the performance of several Transformer models on the dataset. The classification top-1 accuracy of ViT and PVT is improved by 0.75% and 2.8% with SPE respectively. The experiments show that the proposed sector patch embedding method can better perceive distortion and extract features on the fisheye images. Our method can be easily adopted to other Transformer-based models. Source code is at https://***/IN2-ViAUn/Sector-Patch-Embedding. Copyright © 2023, The Authors. All rights reserved.

关键词： Embeddings

CRRS: Concentric Rectangles Regression Strategy for Multi-point Representation on Fisheye Images

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Wang, Xihan Xu, Xi Gao, Yu Yang, Yi Yue, Yufeng Fu, Mengyin School of Automation Beijing Institute of Technology Beijing China State Key Laboratory of Intelligent Control and Decision of Complex System Beijing Institute of Technology Beijing China

Modern object detectors take advantage of rectangular bounding boxes as a conventional way to represent objects. When it comes to fisheye images, rectangular boxes involve more background noise rather than semantic information. Although multi-point representation has been proposed, both the regression accuracy and convergence still perform inferior to the widely used rectangular boxes. In order to further exploit the advantages of multi-point representation for distorted images, Concentric Rectangles Regression Strategy(CRRS) is proposed in this work. We adopt smoother mean loss to allocate weights and discuss the effect of hyper-parameter to prediction results. Moreover, an accurate pixel-level method is designed to obtain irregular IoU for estimating detector performance. Compared with the previous work for muti-point representation, the experiments show that CRRS can improve the training performance both in accurate and stability. We also prove that multi-task weighting strategy facilitates regression process in this design. Source code is at https://***/IN2-ViAUn/Concentric-Rectangles-Loss. Copyright © 2023, The Authors. All rights reserved.

关键词： Semantics

Real-time terrain assessment and Bayesian-based path planning for off-road navigation

学校读者我要写书评

暂无评论

Real-time terrain assessment and Bayesian-based path plannin...

IEEE/RSJ International Conference on intelligent Robots and systems (IROS)

作者： Tianwei Niu Shuwei Yu Liang Wang Haoyu Yuan Shoukun Wang Junzheng Wang Localization and Motion Planning School of Automation Beijing Institute of Technology Beijing China State Key Laboratory of Intelligent Control and Decision of Complex System School of Automation Beijing Institute of Technology Beijing China

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

In the context of unstructured and unknown environment, the autonomous navigation still faces many challenges, such as assessing rough terrain and deciding how to safely navigate complex terrain. In this work, we propose a robust and practical off-road navigation framework that has been successfully deployed on a vibroseis truck for land exploration. First, in degraded wild scenes, a tightly coupled lidar-GNSS-inertial fusion odometry and mapping framework is adopted to construct a local point cloud map around the vehicle in real-time and provide precise localization. Then, based on amplitude-frequency characteristic analysis and point cloud PCA, a multi-layer terrain assessment map containing terrain roughness, obstacles and slope information is obtained. Finally, combining Gaussian distribution based adaptive sampler and Bayesian sequentially updated proposal distribution, a local graph is efficiently built to obtain multiple path solutions under constrained conditions. Both simulations and field experiments show that the proposed navigation framework can decide how to travel on a flat road even in harsh terrain conditions, naturally suppressing frequent attitude angle changes and preventing vehicle accidents.

关键词： Point cloud compression Location awareness Adaptation models Navigation Roads Gaussian distribution Real-time systems Bayes methods Proposals Principal component analysis

An IMU Error Correction Method Based on Multithreshold ZV Detection and SRCKF

学校读者我要写书评

暂无评论

An IMU Error Correction Method Based on Multithreshold ZV De...

2023 International Conference on Cyber-Physical Social Intelligence, ICCSI 2023

作者： Luo, Jialiang Chen, Shichao Lv, Yisheng Sun, Wenqiao Yang, Fan Xu, Ruijie Institute of Automation Chinese Academy of Sciences School of Information Engineering China University of Geosciences Beijing The State Key Laboratory for Management and Control of Complex System State Key Laboratory of Multimodal Artificial Intelligence Systems China Institute of Automation Chinese Academy of Sciences The Center of National Railway Intelligent Transportation System Engineering and Technology China Academy of Railway Sciences Corporation Limited The State Key Laboratory of Multimodal Artificial Intelligence Systems Beijing China Institute of Automation Chinese Academy of Sciences The State Key Laboratory of Multimodal Artificial Intelligence Systems Beijing China Transportation and Economics Research Institute Center of National Railway Intelligent Transportation System Engineering and Technology China Academy of Railway Sciences Corporation Limited China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation Chinese Academy of Sciences College of Rail Transit Shan Dong JiaoTong University The State Key Laboratory for Management and Control of Complex System Jinan China The Hong Kong Polytechnic University Department of Aeronautical and Aviation Engineering Hong Kong Hong Kong

ISBN: (纸本)9798350312492

With the rapid development and widespread application of Inertial Measurement Units (IMUs), IMU-based human localization has become critically important in environments lacking Global Navigation Satellite systems (GNSS) signals. Methods such as UWB/WIFI and other anchor-based localization have been employed to enhance the positioning accuracy. However, these methods are susceptible to the environmental interference and increased costs. In contrast, SINS-based localization methods eliminate reliance on the external data. However, this method can suffer from drift errors due to cumulative integration errors. Inertial navigation error correction techniques like Zero Detection Update Technology (ZUPT) provide potential solutions to address drift errors. This paper proposes an error correction method based on the multithreshold zero-velocity detection and Square Root Cubature Kalman Filter (SRCKF) updates. Compared to the single fixed threshold detection, the multi-threshold zero-velocity detection reduces the likelihood of missed zero velocity detection and false alarms, providing accurate time intervals for error correction. Experimental results demonstrate that the SRCKF-based algorithm reduces position deviation to approximately 0.3146 meters, corresponding to an error ratio of1.14%. The proposed method enables cost-effective and accurate pedestrian localization, driving advancements in the field. © 2023 IEEE.

关键词： Cost effectiveness

Steps Toward Industry 5.0:Building“6S”Parallel Industries With Cyber-Physical-Social Intelligence

学校读者我要写书评

暂无评论

IEEE/CAA Journal of Automatica Sinica 2023年第8期10卷 1692-1703页

作者： Xingxia Wang Jing Yang Yutong Wang Qinghai Miao Fei-Yue Wang Aijun Zhao Jian-Ling Deng Lingxi Li Xiaoxiang Na Ljubo Vlacic School of Artificial Intelligence University of Chinese Academy of SciencesBeijing 100049China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of AutomationChinese Academy of SciencesBeijing 100190China IEEE Macao University of Science and Technology Macao 999078China Beijing Engineering Research Center of Intelligent Systems and Technology Chinese Academy of SciencesBeijing 100098 State Key Laboratory for Management and Control of Complex Systems Chinese Academy of SciencesBeijing 100190China North Automatic Control Technology Institute Taiyuan 030006China China Huaneng Group Co. Ltd.Beijing 100031China Department of Electrical and Computer Engineering Indiana University-Purdue University Indianapolis(IUPUI)IndianapolisIN 46202 USA Department of Engineering University of CambridgeCambridgeCB21PZUK School of Engineering and Built Environment Griffith UniversityGold CoastQLD 4222Australia

Very recently,intensive discussions and studies on Industry 5.0 have sprung up and caused the attention of researchers,entrepreneurs,and policymakers from various sectors around the ***,there is no consensus on why and what is Industry 5.0 *** this paper,we define Industry 5.0from its philosophical and historical origin and evolution,emphasize its new thinking on virtual-real duality and human-machine interaction,and introduce its new theory and technology based on parallel intelligence(PI),artificial societies,computational experiments,and parallel execution(the ACP method),and cyber-physical-social systems(CPSS).Case studies and applications of Industry 5.0 over the last decade have been briefly summarized and analyzed with suggestions for its future *** believe that Industry 5.0 of virtual-real interactive parallel industries has great potentials and is critical for building smart *** are outlined to ensure a roadmap that would lead to a smooth transition from CPS-based Industry 4.0 to CPSS-based Industry 5.0 for a better world which is Safe in physical spaces,S ecure in cyberspaces,Sustainable in ecology,Sensitive in individual privacy and rights,Service for all,and Smartness of all.

关键词： ACP artificial intelligence CPS CPSS Industry 4.0 Industry 5.0 parallel industries parallel intelligence

Full Attention Tracker: A Good Combination of Pixel-Level and Region-Level Cross-Correlation

学校读者我要写书评

暂无评论

Full Attention Tracker: A Good Combination of Pixel-Level an...

Chinese control Conference (CCC)

作者： Yuxuan Wang Liping Yan Zihang Feng Yuanqing Xia Bo Xiao Key Laboratory of Intelligent Control and Decision of Complex Systems School of Automation Beijing Institute of Technology Beijing China School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China

The tracker based on Siamese neural network is currently a technical method with high accuracy in the tracking field. With the introduction of transformer in the visual tracking field, the attention mechanism has gradually emerged in tracking tasks. However, due to the characteristics of attention operation, Transformer usually has slow convergence speed, and its pixel-level correlation discrimination in tracking is more likely to lead to overfitting, which is not conducive to long-term tracking. A brand new framework FAT was designed, which is the improvement of MixFormer. The operation for simultaneous feature extraction and target information integration in MixFormer is retained, and the Mixing block is introduced to suppress the background as much as possible before the information interaction. In addition, a new operation is designed: the result of region-level cross-correlation is used as a guidance to help the learning of pixel-level cross-correlation in attention, thereby accelerating the model convergence speed and enhancing the model generalization. Finally, a joint loss function is designed to further improve the accuracy of the model. Experiments show that the presented tracker achieves excellent performance on five benchmark datasets.

关键词：

Open-/Closed-loop Active Learning for Data-driven Predictive control

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Feng, Shilun Shi, Dawei Shi, Yang Zheng, Kaikai The State Key Laboratory of Intelligent Control and Decision of Complex Systems MIIT Key Laboratory of Servo Motion System Drive and Control School of Automation Beijing Institute of Technology Beijing100081 China The Department of Mechanical Engineering Faculty of Engineering University of Victoria VictoriaBCV8N 3P6 Canada

An important question in data-driven control is how to obtain an informative dataset. In this work, we consider the problem of effective data acquisition of an unknown linear system with bounded disturbance for both open-loop and closed-loop stages. The learning objective is to minimize the volume of the set of admissible systems. First, a performance measure based on historical data and the input sequence is introduced to characterize the upper bound of the volume of the set of admissible systems. On the basis of this performance measure, an open-loop active learning strategy is proposed to minimize the volume by actively designing inputs during the open-loop stage. For the closed-loop stage, an closed-loop active learning strategy is designed to select and learn from informative closed-loop data. The efficiency of the proposed closed-loop active learning strategy is proved by showing that the unselected data cannot benefit the learning performance. Furthermore, an adaptive predictive controller is designed in accordance with the proposed data acquisition approach. The recursive feasibility and the stability of the controller are proved by analyzing the effect of the closed-loop active learning strategy. Finally, numerical examples and comparisons illustrate the effectiveness of the proposed data acquisition strategy. Copyright © 2024, The Authors. All rights reserved.

关键词： Active learning