检索结果-内蒙古大学图书馆

A2J-Transformer: Anchor-to-Joint Transformer Network for 3D Interacting Hand Pose Estimation from a Single RGB image

学校读者我要写书评

暂无评论

A2J-Transformer: Anchor-to-Joint Transformer Network for 3D ...

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Changlong Jiang Yang Xiao Cunlin Wu Mingyang Zhang Jinghong Zheng Zhiguo Cao Joey Tianyi Zhou Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Alibaba Group Centre for Frontier AI Research Agency for Science Technology and Research (A*STAR) Singapore Institute of High Performance Computing Agency for Science Technology and Research (A*STAR) Singapore

3D interacting hand pose estimation from a single RGB image is a challenging task, due to serious self-occlusion and inter-occlusion towards hands, confusing similar appearance patterns between 2 hands, ill-posed joint position mapping from 2D to 3D, etc.. To address these, we propose to extend A2J-the state-of-the-art depth-based 3D single hand pose estimation method-to RGB domain under interacting hand condition. Our key idea is to equip A2J with strong local-global aware ability to well capture interacting hands' local fine details and global articulated clues among joints jointly. To this end, A2J is evolved under Transformer's non-local encoding-decoding framework to build A2J- Transformer. It holds 3 main advantages over A2J. First, self-attention across local anchor points is built to make them global spatial context aware to better capture joints' articulation clues for resisting occlusion. Secondly, each anchor point is regarded as learnable query with adaptive feature learning for facilitating pattern fitting capacity, instead of having the same local representation with the others. Last but not least, anchor point locates in 3D space instead of 2D as in A2J, to leverage 3D pose prediction. Experiments on challenging InterHand 2.6M demonstrate that, A2J-Transformer can achieve state-of-the-art model-free performance (3.38mm MPJPE advancement in 2-hand case) and can also be applied to depth domain with strong generalization. The code is avaliable at https://***/ChanglongJiangGit/A2J-Transformer.

关键词：

SMTC-CL: Continuous Learning via Selective Multi-Task Coordination for Adaptive Signal Classification

学校读者我要写书评

暂无评论

IEEE Transactions on Cognitive Communications and Networking 2024年

作者： Hao, Xiaoyang Yang, Shuyuan Liu, Ruoyu Feng, Zhixi Peng, Tongqing Huang, Bincheng Xidian University Key Laboratory of Intelligent Perception and Image Understanding Ministry of Education School of Artificial Intelligence Xi'an710071 China Avic Xi'an Flight Automatic Control Research Institute China MeiTuan China China Electronics Technology Group Corporation Institute of Information Science and Technology China

Continuously adaptive signal classification in complex electromagnetic environments is a desired property of realistic intelligent systems. However, the limitation of most existing signal processing tasks and methods lies in their assumption of fixed categories and invariant distributions. In contrast, humans naturally acquire knowledge continuously from data streams, enhancing their capabilities through cross-task knowledge integration and learning from the past. Inspired by this, we propose a continuous learning (CL) method based on selective multi-task coordination (SMTC) to deal with ever-changing task categories and distributions in practical electromagnetic environments (denoted as SMTC-CL). Firstly, we propose a signal task distribution comparison (TDC) method that leverages intra-domain density and inter-domain divergence. TDC selectively activates multiple old tasks to collaboration with the current incremental new task. Secondly, we propose the SMTC method. By revisiting potential collaborative tasks from the past using TDC and formulating different selection strategies based on the context, continuous learners can achieve mutual benefits between past and current tasks in SMTC learning. SMTC can partially alleviate catastrophic forgetting and enable continuous learners to adapt to the changing electromagnetic environment. Based on the signal automatic modulation classification (AMC) and real-world specific emitter identification (SEI) datasets, extensive experimental results validate the effectiveness of our proposed method on a variety of CL scenarios, including varying signal task categories, distributions, and their combinations. © 2015 IEEE.

关键词： Contrastive Learning

Decentralized coordination between economic dispatch and demand response in multi-energy systems

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Liu, Zishun Zhu, Shanying Xu, Jinming Chen, Cailian The Department of Automation Shanghai Jiaotong University Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai200240 China Shanghai Engineering Research Center of Intelligent Control and Management Shanghai200240 China College of Control Science and Engineering Zhejiang University HangzhouZhejiang310027 China

In this paper, we investigate the problem of coordination between economic dispatch (ED) and demand response (DR) in multi-energy systems (MESs), aiming to improve the economic utility and reduce the waste of energy in MESs. Since multiple energy sources are coupled through energy hubs (EHs), the supply-demand constraints are nonconvex. To deal with this issue, we propose a linearization method to transform the coordination problem to a convex social welfare optimization one. Then a decentralized algorithm based on parallel Alternating Direction Method of Multipliers (ADMM) and dynamic average tracking protocol is developed, where each agent could only make decisions based on information from their neighbors. Moreover, by using variational inequality and Lyapunov-based techniques, we show that our algorithm could always converge to the global optimal solution. Finally, a case study on the modified IEEE 14-bus network verifies the feasibility and effectiveness of our algorithm. Copyright © 2021, The Authors. All rights reserved.

关键词： Electric load dispatching

Watch the Speakers: A Hybrid Continuous Attribution Network for Emotion Recognition in Conversation With Emotion Disentanglement

学校读者我要写书评

暂无评论

Watch the Speakers: A Hybrid Continuous Attribution Network ...

International Conference on Tools for Artificial Intelligence (ICTAI)

作者： Shanglin Lei Xiaoping Wang Guanting Dong Jiang Li Yingjian Liu School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Wuhan China School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China Institute of Artificial Intelligence Huazhong University of Science and Technology (HUST) Wuhan China

Emotion Recognition in Conversation (ERC) has attracted widespread attention in the natural language processing field due to its enormous potential for practical applications. Existing ERC methods face challenges in achieving generalization to diverse scenarios due to insufficient modeling of context, ambiguous capture of dialogue relationships and overfitting in speaker modeling. In this work, we present a Hybrid Continuous Attributive Network (HCAN) to address these issues in the perspective of emotional continuation and emotional attribution. Specifically, HCAN adopts a hybrid recurrent and attention-based module to model global emotion continuity. Then a novel Emotional Attribution Encoding (EAE) is proposed to model intra- and inter-emotional attribution for each utterance. Moreover, aiming to enhance the robustness of the model in speaker modeling and improve its performance in different scenarios, A comprehensive loss function emotional cognitive loss $\mathcal{L}_{EC}$ is proposed to alleviate emotional drift and overcome the overfitting of the model to speaker modeling. Our model achieves state-of-the-art performance on three datasets, demonstrating the superiority of our work. Another extensive comparative experiments and ablation studies on three benchmarks are conducted to provided evidence to support the efficacy of each module. Further exploration of generalization ability experiments shows the plug-and-play nature of the EAE module in our method.

关键词：

Modelling brain based on canonical ensemble with functional MRI: A thermodynamic exploration on neural system

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Li, Wei Zhou, Chenxi Yang, Bin Fan, Wenliang Chen, Xi School of Artificial Intelligence and Automation Huazhong University of Science and Technology WuhanHubei430074 China Image Processing and Intelligent Control Key Laboratory of the Education Ministry of China WuhanHubei430074 China Department of Radiology Union Hospital Tongji Medical College Huazhong University of Science and Technology WuhanHubei430074 China

Objective. Modelling is an important way to study the working mechanism of brain. While the characterization and understanding of brain are still inadequate. This study tried to build a model of brain from the perspective of thermodynamics at system level, which brought a new thinking to brain modelling. Approach. Regarding brain regions as systems, voxels as particles, and intensity of signals as energy of particles, the thermodynamic model of brain was built based on canonical ensemble theory. Two pairs of activated regions and two pairs of inactivated brain regions were selected for comparison in this study, and the analysis on thermodynamic properties based on the model proposed were performed. In addition, the thermodynamic properties were also extracted as input features for the detection of Alzheimer's disease. Main results. The experiment results verified the assumption that the brain also follows the thermodynamic laws. It demonstrated the feasibility and rationality of brain thermodynamic modelling method proposed, indicating that thermodynamic parameters could be applied to describe the state of neural system. Meanwhile, the brain thermodynamic model achieved much better accuracy in detection of Alzheimer's disease, suggesting the potential application of thermodynamic model in auxiliary diagnosis. Significance. (1) Instead of applying some thermodynamic parameters to analyze neural system, a brain model at system level was proposed from perspective of thermodynamics for the first time in this study. (2) The study discovered that the neural system also follows the laws of thermodynamics, which leads to increased internal energy, increased free energy and decreased entropy when system is activated. (3) The detection of neural disease was demonstrated to be benefit from thermodynamic model, implying the immense potential of thermodynamics in auxiliary *** Codes 80-10, 82-10, 92B99 Copyright © 2021, The Authors. All rights reserved.

关键词： Brain

Hybrid Data-Free Knowledge Distillation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Tang, Jialiang Chen, Shuo Gong, Chen School of Computer Science and Engineering Nanjing University of Science and Technology China Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education China Jiangsu Key Laboratory of Image and Video Understanding for Social Security China Center for Advanced Intelligence Project RIKEN Japan Department of Automation Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University China

Data-free knowledge distillation aims to learn a compact student network from a pre-trained large teacher network without using the original training data of the teacher network. Existing collection-based and generation-based methods train student networks by collecting massive real examples and generating synthetic examples, respectively. However, they inevitably become weak in practical scenarios due to the difficulties in gathering or emulating sufficient real-world data. To solve this problem, we propose a novel method called Hybrid Data-Free Distillation (HiDFD), which leverages only a small amount of collected data as well as generates sufficient examples for training student networks. Our HiDFD comprises two primary modules, i.e., the teacher-guided generation and student distillation. The teacher-guided generation module guides a Generative Adversarial Network (GAN) by the teacher network to produce high-quality synthetic examples from very few real-world collected examples. Specifically, we design a feature integration mechanism to prevent the GAN from overfitting and facilitate the reliable representation learning from the teacher network. Meanwhile, we drive a category frequency smoothing technique via the teacher network to balance the generative training of each category. In the student distillation module, we explore a data inflation strategy to properly utilize a blend of real and synthetic data to train the student network via a classifier-sharing-based feature alignment technique. Intensive experiments across multiple benchmarks demonstrate that our HiDFD can achieve state-of-the-art performance using 120 times less collected data than existing methods. Code is available at https://***/tangjialiang97/HiDFD. Copyright © 2024, The Authors. All rights reserved.

关键词： Students

Robust Perturbed Output Regulation and Its Application to Synchronization of Nonlinear Heterogeneous Multi-Agents

学校读者我要写书评

暂无评论

Robust Perturbed Output Regulation and Its Application to Sy...

IEEE Annual Conference on Decision and control

作者： Xi Chen Zhiyong Chen Hai-Tao Zhang School of Electrical Engineering and Computer Science The University of Newcastle Callaghan NSW 2308 Australia Key Laboratory of Image Processing and Intelligent Control School of Automation and the State Key Laboratory of Digital Manufacturing Equipment and Technology Huazhong University of Science and Technology Wuhan 430074 P.R. China

ISBN: (纸本)9781467360890

The conventional output regulation problem aims to achieve reference tracking and disturbance rejection while references and disturbances are generated by an autonomous exosystem. When the exosystem is perturbed by an external event, a novel robust perturbed output regulation problem is formulated and solved in this paper. The formulation arises from a kind of synchronization problem of multiple agents. Hence, the proposed solution leads to a decentralized control algorithm for synchronization of multiple agents with nonlinear heterogeneous dynamics.

关键词： Output Regulation decentralized control algorithm Disturbance rejection external events Computer algorithms

Federated Motor imagery Classification for Privacy-Preserving Brain-Computer Interfaces

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Jia, Tianwang Meng, Lubin Li, Siyang Liu, Jiajing Wu, Dongrui The Key Laboratory The Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Shenzhen Huazhong University Science and Technology Research Institute Shenzhen518063 China The School of Civil and Hydraulic Engineering Huazhong University of Science and Technology Wuhan430074 China

Training an accurate classifier for EEG-based brain-computer interface (BCI) requires EEG data from a large number of users, whereas protecting their data privacy is a critical consideration. Federated learning (FL) is a promising solution to this challenge. This paper proposes Federated classification with local Batch-specific batch normalization and Sharpness-aware minimization (FedBS) for privacy protection in EEG-based motor imagery (MI) classification. FedBS utilizes local batch-specific batch normalization to reduce data discrepancies among different clients, and sharpness-aware minimization optimizer in local training to improve model generalization. Experiments on three public MI datasets using three popular deep learning models demonstrated that FedBS outperformed six state-of-the-art FL approaches. Remarkably, it also outperformed centralized training, which does not consider privacy protection at all. In summary, FedBS protects user EEG data privacy, enabling multiple BCI users to participate in large-scale machine learning model training, which in turn improves the BCI decoding accuracy. © 2024, CC BY.

关键词： Federated learning

A Visual Kinematics Calibration Method for Manipulator Based on Nonlinear Optimization

学校读者我要写书评

暂无评论

A Visual Kinematics Calibration Method for Manipulator Based...

Chinese Automation Congress (CAC)

作者： Gang Peng Zhihao Wang Shangbin Guan Zhang Deng Wentao Guo Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Beijing Railway Institute of Mechanical & Electrical Engineering Group Co. Ltd. Beijing China Wuhan Lisai Technology Co. Ltd. Wuhan China

The traditional kinematic calibration method for manipulators requires precise three-dimensional measuring instruments to measure the end pose, which is not only expensive due to the high cost of the measuring instruments but also not applicable to all manipulators. Another calibration method uses a camera, but the system error caused by the camera’s parameters affects the calibration accuracy of the kinematics of the robot arm. In order to solve this problem, this paper reduces the dimensionality of the experimental data and redesigns the objective function to be optimized. That is, the three-dimensional positions of the feature points of the calibration plate under each manipulator attitude corresponding to the actual kinematic model and the classic D-H kinematic model are mapped into the pixel coordinate system, and the sum of Euclidean distance errors of the pixel coordinates of the two is used as the objective function to be optimized. And then, nonlinear optimization and parameter compensation are performed. The experimental results show that the pixel deviation of the end pose corresponding to the optimized D-H kinematic model proposed in this paper and the end pose corresponding to the actual kinematic model in the pixel coordinate system is 0.99 pixels. Compared with the 7.9 deviation pixels between the pixel coordinates calculated by the classic D-H kinematic model and the actual pixel coordinates, the deviation is reduced by nearly 7 pixels for an 87% reduction in error. Therefore, the proposed method can effectively avoid system errors caused by camera parameters in visual calibration, can improve the absolute positioning accuracy of the end of the robotic arm, and has good economy and universality.

关键词： Visualization Robot kinematics Instruments Robot vision systems Kinematics Manipulators Cameras