检索结果-内蒙古大学图书馆

Interactive Multi-scale Fusion of 2D and 3D Features for Multi-object Tracking

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wang, Guangming Peng, Chensheng Zhang, Jinpeng Wang, Hesheng Department of Automation Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Engineering Research Center of Intelligent Control and Management Shanghai Jiao Tong University Shanghai 200240 China XLAB The Second Academy of China Aerospace Science And Industry Corporation Beijing100854 China

Multiple object tracking (MOT) is a significant task in achieving autonomous driving. Traditional works attempt to complete this task, either based on point clouds (PC) collected by LiDAR, or based on images captured from cameras. However, relying on one single sensor is not robust enough, because it might fail during the tracking process. On the other hand, feature fusion from multiple modalities contributes to the improvement of accuracy. As a result, new techniques based on different sensors integrating features from multiple modalities are being developed. Texture information from RGB cameras and 3D structure information from Lidar have respective advantages under different circumstances. However, it’s not easy to achieve effective feature fusion because of completely distinct information modalities. Previous fusion methods usually fuse the top-level features after the backbones extract the features from different modalities. In this paper, we first introduce PointNet++ to obtain multi-scale deep representations of point cloud to make it adaptive to our proposed Interactive Feature Fusion between multi-scale features of images and point clouds. Specifically, through multi-scale interactive query and fusion between pixel-level and point-level features, our method, can obtain more distinguishing features to improve the performance of multiple object tracking. Besides, we explore the effectiveness of pre-training on each single modality and fine-tuning on the fusion-based model. The experimental results demonstrate that our method can achieve good performance on the KITTI benchmark and outperform other approaches without using multi-scale feature fusion. Moreover, the ablation studies indicates the effectiveness of multi-scale feature fusion and pre-training on single modality. Copyright © 2022, The Authors. All rights reserved.

关键词： Computer vision

Incremental Online Learning of Randomized Neural Network with Forward Regularization

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Junda Hu, Minghui Li, Ning Al-Ali, Abdulaziz Suganthan, Ponnuthurai Nagaratnam The Key Laboratory of System Control and Information Processing Ministry of Education of China China The Department of Automation Shanghai Jiao Tong University Shanghai200240 China The Shanghai Engineering Research Center of Intelligent Control and Management Shanghai200240 China The School of Electrical and Electronic Nanyang Technological University Singapore The KINDI Computing Research Center College of Engineering Qatar University Qatar

Online learning of deep neural networks suffers from challenges such as hysteretic non-incremental updating, increasing memory usage, past retrospective retraining, and catastrophic forgetting. To alleviate these drawbacks and achieve progressive immediate decision-making, we propose a novel Incremental Online Learning (IOL) process of Randomized Neural Networks (Randomized NN), a framework facilitating continuous improvements to Randomized NN performance in restrictive online scenarios. Within the framework, we further introduce IOL with ridge regularization (-R) and IOL with forward regularization (-F). -R generates stepwise incremental updates without retrospective retraining and avoids catastrophic forgetting. Moreover, we substituted -R with -F as it enhanced precognition learning ability using semi-supervision and realized better online regrets to offline global experts compared to -R during IOL. The algorithms of IOL for Randomized NN with -R/-F on non-stationary batch stream were derived respectively, featuring recursive weight updates and variable learning rates. Additionally, we conducted a detailed analysis and theoretically derived relative cumulative regret bounds of the Randomized NN learners with -R/-F in IOL under adversarial assumptions using a novel methodology and presented several corollaries, from which we observed the superiority on online learning acceleration and regret bounds of employing -F in IOL. Finally, our proposed methods were rigorously examined across regression and classification tasks on diverse datasets, which distinctly validated the efficacy of IOL frameworks of Randomized NN and the advantages of forward regularization. Copyright © 2024, The Authors. All rights reserved.

关键词：

Robust recognition of truck license plate in mine environment

学校读者我要写书评

暂无评论

Robust recognition of truck license plate in mine environmen...

2020 International Conference on Computer Engineering and intelligent control, ICCEIC 2020

作者： Shi, Siqi Li, Nanting Ma, Yanjun Zheng, Liping Xi'An University of Technology Key Laboratory of Shaanxi Province for Complex System Control and Intelligent Information Processing Xian China Xi'An University of Technology School of Electrical Engineering Xian China Xi'An University of Technology School of Automatic and Information Engineering Xian China

ISBN: (数字)9781728185736

ISBN: (纸本)9781728185736

To improve the decreased recognition performance for truck license plate in complex mine environment, which is caused by such factors as polluted, damaged, a robust license plate recognition method is proposed. Firstly, several candidate locations of license plate in the truck image are obtained by utilizing features of both edge and color. Furthermore, the parameter of license plate area intersection ratio is defined to find the precise localization among those above candidates. Then, a character segmentation scheme based on the gray projection method and morphological operator is used to remove those interference factors, such as frame, rivet and stain and uneven illumination. Finally, to increase the robustness of characters recognition by CNN, a self-built license plate character dataset is constructed, which contains various polluted samples obtained by manual simulation. As shown by the experimental results, the proposed method has higher accuracy in license plate location, and obtains an improvement on character recognition accuracy by 4% compared to other existed methods. © 2020 IEEE.

关键词： License plates (automobile)

Pseudo-LiDAR for Visual Odometry

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Deng, Huiying Wang, Guangming Feng, Zhiheng Jiang, Chaokang Wu, Xinrui Miao, Yanzi Wang, Hesheng Advanced Robotics Research Center AI Research Institute School of Information and Control Engineering China University of Mining and Technology Xuzhou221116 China Department of Automation Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Engineering Research Center of Intelligent Control and Management Shanghai Jiao Tong University Shanghai200240 China

As one of the important tasks in the field of robotics and machine vision, LiDAR/visual odometry provides tremendous help for various applications such as navigation, location, etc. In the existing methods, LiDAR odometry shows superior performance, but visual odometry is still widely used for its price advantage. Conventionally, the task of visual odometry mainly rely on the input of continuous images. However, it is very complicated for the odometry network to learn the epipolar geometry information provided by the images. In this paper, the concept of pseudo-LiDAR is introduced into the odometry to solve this problem. The pseudo-LiDAR point cloud back-projects the depth map generated by the image into the 3D point cloud, which changes the way of image representation. Compared with the stereo images, the pseudo-LiDAR point cloud generated by the stereo matching network can get the explicit 3D coordinates. Since the 6 Degrees of Freedom (DoF) pose transformation occurs in 3D space, the 3D structure information provided by the pseudo-LiDAR point cloud is more direct than the image. Compared with sparse LiDAR, the pseudo-LiDAR has a denser point cloud. In order to make full use of the rich point cloud information provided by the pseudo-LiDAR, a projection-aware dense odometry pipeline is adopted. Most previous LiDAR-based algorithms sampled 8192 points from the point cloud as input to the odometry network. The projection-aware dense odometry pipeline takes all the pseudo-LiDAR point clouds generated from the images except for the error points as the input to the network. While making full use of the 3D geometric information in the images, the semantic information in the images is also used in the odometry task. The fusion of 2D-3D is achieved in an image-only based odometry. Experiments on the KITTI dataset prove the effectiveness of our method. To the best of our knowledge, this is the first visual odometry method using pseudo-LiDAR. Copyright © 2022, The Authors. A

关键词： Pipelines

What Matters for 3D Scene Flow Network

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wang, Guangming Hu, Yunzhe Liu, Zhe Zhou, Yiyang Tomizuka, Masayoshi Zhan, Wei Wang, Hesheng Department of Automation Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Jiao Tong University China MoE Key Lab of Artificial Intelligence Shanghai Jiao Tong University China Mechanical Systems Control Laboratory University of California Berkeley United States

3D scene flow estimation from point clouds is a low-level 3D motion perception task in computer vision. Flow embedding is a commonly used technique in scene flow estimation, and it encodes the point motion between two consecutive frames. Thus, it is critical for the flow embeddings to capture the correct overall direction of the motion. However, previous works only search locally to determine a soft correspondence, ignoring the distant points that turn out to be the actual matching ones. In addition, the estimated correspondence is usually from the forward direction of the adjacent point clouds, and may not be consistent with the estimated correspondence acquired from the backward direction. To tackle these problems, we propose a novel all-to-all flow embedding layer with backward reliability validation during the initial scene flow estimation. Besides, we investigate and compare several design choices in key components of the 3D scene flow network, including the point similarity calculation, input elements of predictor, and predictor & refinement level design. After carefully choosing the most effective designs, we are able to present a model that achieves the state-of-the-art performance on FlyingThings3D and KITTI Scene Flow datasets. Our proposed model surpasses all existing methods by at least 38.2% on FlyingThings3D dataset and 24.7% on KITTI Scene Flow dataset for EPE3D metric. We release our codes at https://***/IRMVLab/3DFlow. Copyright © 2022, The Authors. All rights reserved.

关键词： Embeddings

Non-Fourier Heat Conduction based on Self-Adaptive Weight Physics-Informed Neural Networks

学校读者我要写书评

暂无评论

Non-Fourier Heat Conduction based on Self-Adaptive Weight Ph...

第40届中国控制会议

作者： Shuyan Shi Ding Liu Zhongdan Zhao National & Local Joint Engineering Research Center of Crystal Growth Equipment and System Integration Xi'an University of Technology Shananxi Key Laboratory of Complex System Control and Intelligent Information Processing

This paper establishes the non-Fourier heat conduction model to describe the heat transfer process of mono-crystalline silicon under the condition of unstable thermal field and thermal shock in the Czochralski method.A novel differential equations solver called Physics-Informed Neural Networks（PINN） algorithm was *** with finite element method（FEM）,this method has some advantages like no grid requirement and easily *** order to deal with the unbalance of constraint condition and speed up the convergence,we propose a novel method called Self-Adaptive Weight Physics-Informed Neural Networks（SWPINN）.The comparison of the experimental results of SWPINN and COMSOL verifies the effectiveness of *** modifying the parameter of non-Fourier heat conduction model,this paper obtains the temperature distribution under different heat relaxation ***,comparison between SWPINN and PINN shows that the proposed method has faster convergence speed and higher accuracy.

关键词： Non-Fourier Heat Conduction Physics-Informed Neural Networks Partial Differential Equation Monocrystalline Silicon Czochralski Method

Opportunistic Wireless control Over State-Dependent Fading Channels*

学校读者我要写书评

暂无评论

Opportunistic Wireless Control Over State-Dependent Fading C...

IEEE Conference on Decision and control

作者： Shuling Wang Peizhe Li Shanying Zhu Cailian Chen Department of Automation Shanghai Jiao Tong University Shanghai China Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai China Shanghai Engineering Research Center of Intelligent Control and Management Shanghai China

ISBN: (数字)9781665467612

ISBN: (纸本)9781665467629

The heterogeneous system consisting of the wireless control system (WCS) and mobile agent system (MAS) is ubiquitous in Industrial Internet of Things (IIoT) systems. Within this system, the positions of mobile agents may lead to shadow fading on the wireless channel that the WCS is controlled over and can significantly compromise the WCS’s performance. This paper focuses on the controller design for the MAS to ensure the performance of WCS in the presence of WCS and MAS coupling. Firstly, the constrained finite field network (FFN) with profile-dependent switching topology is adopted to proceed the operational control for the MAS. By virtue of the algebraic state space representation (ASSR) method, an equivalent form is obtained for the WCS and MAS coupling. A necessary and sufficient condition in terms of constrained set stabilization is then established to ensure the Lyapunov-like performance with expected decay rate. Finally, a graphical method together with the breath-first searching is provided to design state feedback controllers for the MAS. With this method, it is easy to check the constrained set stabilization of MAS and to ensure the performance requirements of WCS in the presence of WCS and MAS coupling. The study of an illustrative example shows the effectiveness of the proposed method.

关键词： Couplings Wireless communication Fading channels State feedback Mobile agents Optical wavelength conversion Switches

A Model-free False Data Injection Attack Strategy in Networked control systems

学校读者我要写书评

暂无评论

A Model-free False Data Injection Attack Strategy in Network...

IEEE Conference on Decision and control

作者： Xiaoyu Luo Chongrong Fang Chengcheng Zhao Jianping He The Department of Automation Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China and Shanghai Engineering Research Center of Intelligent Control and Management Shanghai China The State Key Laboratory of Industrial Control Technology and Institute of Cyberspace Research Zhejiang University China

ISBN: (数字)9781665467612

ISBN: (纸本)9781665467629

The data-driven attack strategies recently have received much attention when the full knowledge of the system model is unknown or difficult to be obtained for the adversary. Note that despite the critical parameters of the system model being unavailable for the adversary, the existing data-driven attack methods still depend on the linearity of the unknown system model. In this paper, we design a completely model-free attack strategy where the adversary with limited capability aims to compromise state variables such that the output value follows the expected trajectory. Specifically, we first construct a zeroth-order feedback optimization framework and uninterruptedly use probing signals for real-time measurements. Then, we iteratively update the attack signals along the composite direction of the gradient estimates of the objective function evaluations and the projected gradients. These objective function evaluations can be obtained only by real-time measurements. Furthermore, we characterize the optimality of these solutions via the optimality gap, which is affected by the dimensions of the attack signal, the iterations of solutions, and the convergence rate of the system. Extensive simulations are conducted to show the effectiveness of the proposed attack strategy.

关键词： Networked control systems Computational modeling Current measurement Linear programming Real-time systems Data models Time measurement

Building Temperature and Humidity Adaptive control for a Multi-Zone HVAC system Using Hybrid Modeling Method

学校读者我要写书评

暂无评论

Building Temperature and Humidity Adaptive Control for a Mul...

IEEE International Conference on Industrial Technology (ICIT)

作者： Yuliang Jiang Shanying Zhu Qimin Xu Bo Yang Xinping Guan Department of Automation Shanghai Jiao Tong University Shanghai China Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai China Shanghai Engineering Research Center of Intelligent Control and Management Shanghai China

ISBN: (纸本)9781728119496

In this paper, the heating, ventilation and air conditioning (HVAC) system as the contributor of building climate management is studied on multi-zone climate dynamics modelling and control for occupancy comfort. The first-principles model together with data-driven model as the hybrid model is proposed for comprehensive multi-zone hygro-thermal dynamics. The unmodeled climate dynamics such as unknown nonlinearity and uncertainty is modeled in a linear form based on the compact form dynamic linearization (CFDL) method. Then model free adaptive control (MFAC) scheme including controller design and parameter estimation is proposed to realize multi-zone climate control and occupancy comfort. The dynamic response performance of the hybrid model-based adaptive control and the first-principles model-based adaptive control has been tested in a multi-zone building with four different zones. The results show that the proposed hybrid model-based adaptive control scheme can achieve obvious performance improvement in minimizing steady-state error.

关键词： Adaptation models HVAC Parameter estimation Uncertainty Atmospheric modeling Buildings Ventilation