检索结果-内蒙古大学图书馆

End-to-end Automatic Targetless Calibration between Low-resolution LiDARs and Cameras based on Cross-modal Attention

学校读者我要写书评

暂无评论

End-to-end Automatic Targetless Calibration between Low-reso...

Chinese control and Decision Conference, CCDC

作者： Tianyang Huang Jun-Guo Lu Ming Wei Qing-Hao Zhang Department of Automation Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai Engineering Research Center of Intelligent Control and Management Shanghai China

ISBN: (数字)9798350387780

ISBN: (纸本)9798350387797

LiDARs and cameras, commonly used sensors on autonomous vehicles and robots, require precise calibration for accurate joint environmental perception. Current calibration methods, capable of adjusting both intrinsic and extrinsic parameters, often depend on physical targets or human intervention, making them unsuitable for automatic online calibration. Moreover, these methods are primarily optimized for dense point clouds, as they are often tuned on open datasets featuring high-quality point cloud data. However, low-resolution LiDARs, preferred for their cost-effectiveness, are prevalent in practical applications. To automate the calibration process while maintaining high precision on sparse point clouds, multi-modal image registration techniques are leveraged to develop an end-to-end, cross-attention-based neural network for automatic calibration of low-resolution LiDARs and Cameras. Specifically, given an initial perturbation on point clouds, our network is capable of recovering the true extrinsic parameters without manual intervention. Additionally, specialized input preprocessing and training strategies are incorporated to enhance performance with sparse point clouds. Promising results are achieved on both open datasets and custom sensor acquisitions, highlighting the effectiveness and adaptability of our network to diverse scenarios.

关键词： Point cloud compression Training image registration Visualization Laser radar Perturbation methods Neural networks

CSP-Net: Common Spatial Pattern Empowered Neural Networks for EEG-Based Motor imagery Classification

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Jiang, Xue Meng, Lubin Chen, Xinru Xu, Yifan Wu, Dongrui Key Laboratory of The Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Shenzhen Huazhong University of Science and Technology Research Institute Shenzhen518063 China

Electroencephalogram-based motor imagery (MI) classification is an important paradigm of non-invasive brain-computer interfaces. Common spatial pattern (CSP), which exploits different energy distributions on the scalp while performing different MI tasks, is very popular in MI classification. Convolutional neural networks (CNNs) have also achieved great success, due to their powerful learning capabilities. This paper proposes two CSP-empowered neural networks (CSP-Nets), which integrate knowledge-driven CSP filters with data-driven CNNs to enhance the performance in MI classification. CSP-Net-1 directly adds a CSP layer before a CNN to improve the input discriminability. CSP-Net-2 replaces a convolutional layer in CNN with a CSP layer. The CSP layer parameters in both CSP-Nets are initialized with CSP filters designed from the training data. During training, they can either be kept fixed or optimized using gradient descent. Experiments on four public MI datasets demonstrated that the two CSP-Nets consistently improved over their CNN backbones, in both within-subject and cross-subject classifications. They are particularly useful when the number of training samples is very small. Our work demonstrates the advantage of integrating knowledge-driven traditional machine learning with data-driven deep learning in EEG-based brain-computer interfaces. © 2024, CC BY.

关键词： Convolutional neural networks

Csp-Net: Common Spatial Pattern Empowered Neural Networks for Eeg-Based Motor imagery Classification

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Jiang, Xue Meng, Lubin Chen, Xinru Xu, Yifan Wu, Dongrui Key Laboratory of the Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Shenzhen Huazhong University of Science and Technology Research Institute Shenzhen518063 China

关键词： Electroencephalography

Evolutionary Dynamics of Cooperation on Coupled Networks

学校读者我要写书评

暂无评论

Evolutionary Dynamics of Cooperation on Coupled Networks

control Theory and Applications (ICoCTA), International Conference on

作者： Zhenyu Shi Qi Su Department of Automation Ministry of Education of China Key Laboratory of System Control and Information Processing Shanghai Engineering Research Center of Intelligent Control and Management Shanghai Jiao Tong University Shanghai China

ISBN: (数字)9798331506155

ISBN: (纸本)9798331506162

Network reciprocity has been recognized as a crucial mechanism for promoting the evolution of cooperation. However, prior studies on network reciprocity have predominantly focused on isolated networks, neglecting the interconnected nature of real-world systems. In reality, many large-scale systems are closely coupled, where the interaction patterns between systems differ significantly from those within individual networks. Motivated by this observation, we construct a strategy evolution model on coupled networks to explore the effects of such interconnections. Our findings reveal that coupled networks foster cooperation more effectively than isolated networks. This advantage persists across various network structures, suggesting the universality of this phenomenon. Interestingly, we discover that the strength of the coupling plays a pivotal role: weaker coupling between networks is more conducive to the emergence and stability of cooperation compared to stronger coupling. These results high-light the importance of considering cross-system interactions in understanding and designing mechanisms to enhance cooperative behavior.

关键词： Couplings Stability analysis Large-scale systems control theory Game theory

Complementary Learning Subnetworks for Parameter-Efficient Class-Incremental Learning

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Li, Depeng Zeng, Zhigang The School of Artificial Intelligence and Automation The Institute of Artificial Intelligence Huazhong University of Science and Technology China The Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Wuhan430074 China

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the well-known catastrophic forgetting phenomenon. Typical methods such as rehearsal-based ones rely on storing exemplars of old classes to mitigate catastrophic forgetting, which limits real-world applications considering memory resources and privacy issues. In this paper, we propose a novel rehearsal-free CIL approach that learns continually via the synergy between two Complementary Learning Subnetworks. Our approach involves jointly optimizing a plastic CNN feature extractor and an analytical feed-forward classifier. The inaccessibility of historical data is tackled by holistically controlling the parameters of a well-trained model, ensuring that the decision boundary learned fits new classes while retaining recognition of previously learned classes. Specifically, the trainable CNN feature extractor provides task-dependent knowledge separately without interference;and the final classifier integrates task-specific knowledge incrementally for decision-making without forgetting. In each CIL session, it accommodates new tasks by attaching a tiny set of declarative parameters to its backbone, in which only one matrix per task or one vector per class is kept for knowledge retention. Extensive experiments on a variety of task sequences show that our method achieves competitive results against state-of-the-art methods, especially in accuracy gain, memory cost, training efficiency, and task-order robustness. Furthermore, to make the non-growing backbone (i.e., a model with limited network capacity) suffice to train on more incoming tasks, a graceful forgetting implementation on previously learned trivial tasks is empirically investigated. Copyright © 2023, The Authors. All rights reserved.

关键词： Decision making

Cluster Consensus Problem on Time-varying Higher-Order Interaction Networks

学校读者我要写书评

暂无评论

Cluster Consensus Problem on Time-varying Higher-Order Inter...

IEEE Conference on Decision and control

作者： Haoyu Wei Lulu Pan Haibin Shao Dewei Li Wenbin Yu Department of Automation Shanghai Jiao Tong University and Key Laboratory of System Control and Information Processing Ministry of Education of China and Shanghai Engineering Research Center of Intelligent Control and Management Shanghai China

ISBN: (数字)9798350316339

ISBN: (纸本)9798350316346

This paper examines the cluster consensus problem of higher-order interaction networks on switching networks. The matrix-valued inter-agent coupling mechanism is employed to capture the higher-order interactions amongst neighboring agents. Specifically, for a higher-order interaction network with both positive definite and positive semi-definite coupling matrices, we examine the scenario in which the nullspace of positive semi-definite coupling matrices is constructed by a set of orthogonal basis vectors. From the perspective of the lower-order component graph -the projection of network structure onto the direction of each orthogonal basis–results on the explicit characterization of cluster consensus of higher-order interaction networks are provided. Moreover, for time-varying higher-order interaction networks, necessary and sufficient conditions are provided to ensure that a time-varying network shares the same steady-state values as the integral time-invariant network. Simulation results are provided to demonstrate the theory.

关键词： Couplings Sufficient conditions Network topology Simulation Switches Vectors Topology Steady-state Matrix decomposition Convergence

A2J-Transformer: Anchor-to-Joint Transformer Network for 3D Interacting Hand Pose Estimation from a Single RGB image

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Jiang, Changlong Xiao, Yang Wu, Cunlin Zhang, Mingyang Zheng, Jinghong Cao, Zhiguo Zhou, Joey Tianyi Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Alibaba Group China Singapore Singapore

3D interacting hand pose estimation from a single RGB image is a challenging task, due to serious self-occlusion and inter-occlusion towards hands, confusing similar appearance patterns between 2 hands, ill-posed joint position mapping from 2D to 3D, etc.. To address these, we propose to extend A2J-the state-of-the-art depth-based 3D single hand pose estimation method-to RGB domain under interacting hand condition. Our key idea is to equip A2J with strong local-global aware ability to well capture interacting hands’ local fine details and global articulated clues among joints jointly. To this end, A2J is evolved under Transformer’s non-local encoding-decoding framework to build A2J-Transformer. It holds 3 main advantages over A2J. First, self-attention across local anchor points is built to make them global spatial context aware to better capture joints’ articulation clues for resisting occlusion. Secondly, each anchor point is regarded as learnable query with adaptive feature learning for facilitating pattern fitting capacity, instead of having the same local representation with the others. Last but not least, anchor point locates in 3D space instead of 2D as in A2J, to leverage 3D pose prediction. Experiments on challenging InterHand 2.6M demonstrate that, A2J-Transformer can achieve state-of-the-art model-free performance (3.38mm MPJPE advancement in 2-hand case) and can also be applied to depth domain with strong generalization. The code is avaliable at https://***/ChanglongJiangGit/A2J-Transformer. Copyright © 2023, The Authors. All rights reserved.

关键词： Machine learning

Switched High-Gain Based Interval Observer Design for Harmonic Oscillator System 42

学校读者我要写书评

暂无评论

Switched High-Gain Based Interval Observer Design for Harmon...

42nd Chinese control Conference, CCC 2023

作者： Ming, Tianhang Wang, Xiaoling Liu, Bo Su, Housheng College of Automation & Ai Nanjing University of Posts and Telecommunications Nanjing210023 China Nanjing210023 China College of Information Engineering Minzu University of China Beijing100081 China Huazhong University of Science and Technology Key Laboratory of Image Processing and Intelligence Control of Ministry of Education Wuhan430074 China

ISBN: (纸本)9789887581543

In this paper, we revisit the interval observer design problem of harmonic oscillator system with unknown but bounded external disturbance and measurement noise. With the bounding information of the external disturbance and measurement noise, a high-gain interval observer is firstly defined and constructed for the harmonic oscillator system to realize the interval estimation on the state and the robust control of the system. Then, a switched high-gain interval observer is proposed to reduce the influence of the measurement noise for a tighter interval width on the state estimation. Finally, some numerical simulations are given to verify the theoretical results. © 2023 Technical Committee on control Theory, Chinese Association of Automation.

关键词： Robust control

MPIB: An MPI-Based Bokeh Rendering Framework for Realistic Partial Occlusion Effects

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Peng, Juewen Zhang, Jianming Luo, Xianrui Lu, Hao Xian, Ke Cao, Zhiguo Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of AIA Huazhong University of Science and Technology China Adobe Research

Partial occlusion effects are a phenomenon that blurry objects near a camera are semi-transparent, resulting in partial appearance of occluded background. However, it is challenging for existing bokeh rendering methods to simulate realistic partial occlusion effects due to the missing information of the occluded area in an all-in-focus image. Inspired by the learnable 3D scene representation, Multiplane image (MPI), we attempt to address the partial occlusion by introducing a novel MPI-based high-resolution bokeh rendering framework, termed MPIB. To this end, we first present an analysis on how to apply the MPI representation to bokeh rendering. Based on this analysis, we propose an MPI representation module combined with a background inpainting module to implement high-resolution scene representation. This representation can then be reused to render various bokeh effects according to the controlling parameters. To train and test our model, we also design a ray-tracing-based bokeh generator for data generation. Extensive experiments on synthesized and real-world images validate the effectiveness and flexibility of this framework. Copyright © 2022, The Authors. All rights reserved.

关键词： Rendering (computer graphics)