检索结果-内蒙古大学图书馆

Incremental Online Learning of Randomized Neural Network with Forward Regularization

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Junda Hu, Minghui Li, Ning Al-Ali, Abdulaziz Suganthan, Ponnuthurai Nagaratnam The Key Laboratory of System Control and Information Processing Ministry of Education of China China The Department of Automation Shanghai Jiao Tong University Shanghai200240 China The Shanghai Engineering Research Center of Intelligent Control and Management Shanghai200240 China The School of Electrical and Electronic Nanyang Technological University Singapore The KINDI Computing Research Center College of Engineering Qatar University Qatar

Online learning of deep neural networks suffers from challenges such as hysteretic non-incremental updating, increasing memory usage, past retrospective retraining, and catastrophic forgetting. To alleviate these drawbacks and achieve progressive immediate decision-making, we propose a novel Incremental Online Learning (IOL) process of Randomized Neural Networks (Randomized NN), a framework facilitating continuous improvements to Randomized NN performance in restrictive online scenarios. Within the framework, we further introduce IOL with ridge regularization (-R) and IOL with forward regularization (-F). -R generates stepwise incremental updates without retrospective retraining and avoids catastrophic forgetting. Moreover, we substituted -R with -F as it enhanced precognition learning ability using semi-supervision and realized better online regrets to offline global experts compared to -R during IOL. The algorithms of IOL for Randomized NN with -R/-F on non-stationary batch stream were derived respectively, featuring recursive weight updates and variable learning rates. Additionally, we conducted a detailed analysis and theoretically derived relative cumulative regret bounds of the Randomized NN learners with -R/-F in IOL under adversarial assumptions using a novel methodology and presented several corollaries, from which we observed the superiority on online learning acceleration and regret bounds of employing -F in IOL. Finally, our proposed methods were rigorously examined across regression and classification tasks on diverse datasets, which distinctly validated the efficacy of IOL frameworks of Randomized NN and the advantages of forward regularization. Copyright © 2024, The Authors. All rights reserved.

关键词：

Transition in collective motion decision making

学校读者我要写书评

暂无评论

Physical Review E 2022年第1期106卷 014611-014611页

作者： Biao Wang Yue Wu Guangwei Wang Lan Liu Guanrong Chen Hai-Tao Zhang School of Artificial Intelligence and Automation Key Laboratory of Image Processing and Intelligent Control State Key Laboratory of Digital Manufacturing Equipment and Technology Huazhong University of Science and Technology Wuhan 430074 China National Engineering Laboratory for Educational Big Data Central China Normal University Wuhan 430079 China Department of Electrical Engineering City University of Hong Kong Hong Kong SAR China

Collective decision making in a biological motion group requires fast and robust transmission of information. Typically, directional switching information propagation across the whole group obeys a linear dispersion law. However, conventional dynamic collective motion models, such as the Vicsek model and the Couzin model did not take into account ultrafast directional synchronous motions. In the present paper, a multiparticle model is proposed based on inertial spin self-propel action, which can provide adequate description of such group motion. By considering both spin mechanism and collision avoidance, the proposed self-propelled particle spin model can nicely describe collective motion with fast directional switching. By analyzing the order parameter of the group-velocity synchronization, a mechanism of group decision making is revealed, which is based on the difference between two clusters of divergent leaders, showing a transition from the compromising phase (i.e., following the group average) to the preferred phase (i.e., aligning to a leader cluster). The finding provides new insight to the decision-making process of followers when they face with divergent leaders in group motion.

关键词： Collective behavior in networks Network phase transitions Pattern formation Self-organized systems

Watch the Speakers: A Hybrid Continuous Attribution Network for Emotion Recognition in Conversation With Emotion Disentanglement

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Lei, Shanglin Wang, Xiaoping Dong, Guanting Li, Jiang Liu, Yingjian School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Key Laboratory of Image Processing and Intelligent Control Education Ministry of China Wuhan430074 China Wuhan430074 China School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing100876 China

Emotion Recognition in Conversation (ERC) has attracted widespread attention in the natural language processing field due to its enormous potential for practical applications. Existing ERC methods face challenges in achieving generalization to diverse scenarios due to insufficient modeling of context, ambiguous capture of dialogue relationships and overfitting in speaker modeling. In this work, we present a Hybrid Continuous Attributive Network (HCAN) to address these issues in the perspective of emotional continuation and emotional attribution. Specifically, HCAN adopts a hybrid recurrent and attention-based module to model global emotion continuity. Then a novel Emotional Attribution Encoding (EAE) is proposed to model intra- and inter-emotional attribution for each utterance. Moreover, aiming to enhance the robustness of the model in speaker modeling and improve its performance in different scenarios, A comprehensive loss function emotional cognitive loss LEC is proposed to alleviate emotional drift and overcome the overfitting of the model to speaker modeling. Our model achieves state-of-the-art performance on three datasets, demonstrating the superiority of our work. Another extensive comparative experiments and ablation studies on three benchmarks are conducted to provided evidence to support the efficacy of each module. Further exploration of generalization ability experiments shows the plug- and-play nature of the EAE module in our method. © 2023, CC BY-SA.

关键词： Emotion Recognition

Cooperative Label-Free Moving Target Fencing for Second-Order Multi-Agent Systems with Rigid Formation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Hu, Bin-Bin Zhang, Hai-Tao Shi, Yang School of Artificial Intelligence Automation Key Laboratory of Image Processing Intelligent Control State Key Lab of Digital Manufacturing Equipment and Technology Huazhong University of Science and Technology Wuhan430074 China Department of Mechanical Engineering University of Victoria VictoriaBCV8W 2Y2 Canada

This paper proposes a label-free controller for a second-order multi-agent system to cooperatively fence a moving target of variational velocity into a convex hull formed by the agents whereas maintaining a rigid formation. Therein, no label is predetermined for a specified agent. To attain a rigid formation with guaranteed collision avoidance, each controller consists of two terms: a dynamic regulator with an internal model to drive agents towards the moving target merely by position information feedback, and a repulsive force between each pair of adjacent agents. Significantly, sufficient conditions are derived to guarantee the asymptotic stability of the closed-loop systems governed by the proposed fencing controller. Rigorous analysis is provided to eliminate the strong nonlinear couplings induced by the label-free property. Finally, the effectiveness of the controller is substantiated by numerical simulations. Copyright © 2023, The Authors. All rights reserved.

关键词： Multi agent systems

Distract Your Attention: Multi-head Cross Attention Network for Facial Expression Recognition

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Wen, Zhengyao Lin, Wenzhong Wang, Tao Xu, Ge Fujian Provincial Key Laboratory of Information Processing and Intelligent Control College of Computer and Control Engineering Minjiang University Fuzhou China

This paper presents a novel facial expression recognition network, called Distract your Attention Network (DAN). Our method is based on two key observations in biological visual perception. Firstly, multiple facial expression classes share inherently similar underlying facial appearance, and their differences could be subtle. Secondly, facial expressions simultaneously exhibit themselves through multiple facial regions, and for recognition, a holistic approach by encoding high-order interactions among local features is required. To address these issues, this work proposes DAN with three key components: Feature Clustering Network (FCN), Multi-head Attention Network (MAN), and Attention Fusion Network (AFN). Specifically, FCN extracts robust features by adopting a large-margin learning objective to maximize class separability. In addition, MAN instantiates a number of attention heads to simultaneously attend to multiple facial areas and build attention maps on these regions. Further, AFN distracts these attentions to multiple locations before fusing the feature maps to a comprehensive one. Extensive experiments on three public datasets (including AffectNet, RAF-DB, and SFEW 2.0) verified that the proposed method consistently achieves state-of-the-art facial expression recognition performance. The DAN code is publicly available. Copyright © 2021, The Authors. All rights reserved.

关键词： Face recognition

Size-invariance matters: rethinking metrics and losses for imbalanced multi-object salient object detection 24

学校读者我要写书评

暂无评论

Size-invariance matters: rethinking metrics and losses for i...

Proceedings of the 41st International Conference on Machine Learning

作者： Feiran Li Qianqian Xu Shilong Bao Zhiyong Yang Runmin Cong Xiaochun Cao Qingming Huang Institute of Information Engineering Chinese Academy of Sciences Beijing China and School of Cyber Security University of Chinese Academy of Sciences Beijing China Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing China School of Computer Science and Technology University of Chinese Academy of Sciences Beijing China Institute of Information Science Beijing Jiaotong University Beijing China and School of Control Science and Engineering Shandong University Jinan China and Key Laboratory of Machine Intelligence and System Control Ministry of Education Jinan China School of Cyber Science and Tech. Shenzhen Campus Sun Yat-sen University School of Computer Science and Technology University of Chinese Academy of Sciences Beijing China and Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing China and Key Laboratory of Big Data Mining and Knowledge Management Chinese Academy of Sciences Beijing China

This paper explores the size-invariance of evaluation metrics in Salient Object Detection (SOD), especially when multiple targets of diverse sizes co-exist in the same image. We observe that current metrics are size-sensitive, where larger objects are focused, and smaller ones tend to be ignored. We argue that the evaluation should be size-invariant because bias based on size is unjustified without additional semantic information. In pursuit of this, we propose a generic approach that evaluates each salient object separately and then combines the results, effectively alleviating the imbalance. We further develop an optimization framework tailored to this goal, achieving considerable improvements in detecting objects of different sizes. Theoretically, we provide evidence supporting the validity of our new metrics and present the generalization analysis of SOD. Extensive experiments demonstrate the effectiveness of our method. The code is available at https://***/Ferry-Li/SI-SOD.

关键词：

Fast Particle Swarm optimization for Balanced Clustering 11

学校读者我要写书评

暂无评论

Fast Particle Swarm optimization for Balanced Clustering

11th International Conference on intelligent control and information processing, ICICIP 2021

作者： Zhang, Meng Xiao, Yao Song, Xiaoling Dai, Xiangguang Zhang, Nian Chongqing Three Gorges University Key Laboratory of Intelligent Information Processing and Control of Chongqing Municipal Institutions of Higher Education Chongqing40044 China University of the District of Columbia Department of Electrical and Computer Engineering WashingtonDC20008 United States

ISBN: (纸本)9781665425155

There are balanced priorities in various engineering fields (e.g. medicine, statistics, artificial intelligence, and economics, etc.). Some clustering algorithms cannot maintain the natural balanced structure of data. This paper proposes a soft-balanced clustering framework, which can achieve a balanced clustering for each cluster. The model can be formulated d as a mixed-integer optimization problem. We transform the problem into several subproblems and utilize PSO to search the global solution. Experiments show that the proposed algorithm can achieve satisfactory clustering results than other clustering algorithms. © 2021 IEEE.

关键词： Clustering algorithms

3D Scene Flow Estimation on Pseudo-LiDAR: Bridging the Gap on Estimating Point Motion

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Jiang, Chaokang Wang, Guangming Miao, Yanzi Wang, Hesheng Engineering Research Center of Intelligent Control for Underground Space Ministry of Education School of Information and Control Engineering Advanced Robotics Research Center China University of Mining and Technology Xuzhou221116 China Department of Automation Key Laboratory of System Control and Information Processing Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Engineering Research Center of Intelligent Control and Management Shanghai Jiao Tong University Shanghai200240 China

3D scene flow characterizes how the points at the current time flow to the next time in the 3D Euclidean space, which possesses the capacity to infer autonomously the non-rigid motion of all objects in the scene. The previous methods for estimating scene flow from images have limitations, which split the holistic nature of 3D scene flow by estimating optical flow and disparity separately. Learning 3D scene flow from point clouds also faces the difficulties of the gap between synthesized and real data and the sparsity of LiDAR point clouds. In this paper, the generated dense depth map is utilized to obtain explicit 3D coordinates, which achieves direct learning of 3D scene flow from 2D images. The stability of the predicted scene flow is improved by introducing the dense nature of 2D pixels into the 3D space. Outliers in the generated 3D point cloud are removed by statistical methods to weaken the impact of noisy points on the 3D scene flow estimation task. Disparity consistency loss is proposed to achieve more effective unsupervised learning of 3D scene flow. The proposed method of self-supervised learning of 3D scene flow on real-world images is compared with a variety of methods for learning on the synthesized dataset and learning on LiDAR point clouds. The comparisons of multiple scene flow metrics are shown to demonstrate the effectiveness and superiority of introducing pseudo-LiDAR point cloud to scene flow estimation. © 2022, CC BY.

关键词： Three dimensional computer graphics

Acquisition and Analysis of Rotating Machinery Rotor Vibration Signal by Non-Contact Laser Sensing

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Yang, Shangjun Wu, Jiali Ke, Chenghu Zhang, Feng Zhu, Chunhua Ke, Xizheng Key Laboratory of Grain Information Processing and Control [Henan University of Technology Ministry of Education Zhengzhou China College of Information Science and Engineering Henan University of Technology Zhengzhou China Henan Engineering Laboratory of Grain Condition Intelligent Detection and Application Henan University of Technology Zhengzhou China School of Information Engineering Xi’an University Xi’an China School of Electronic Information Engineering Xi’an Technological University Xi’an China School of Automation and Information Engineering Xi’an University of Technology Xi’an China

Conventional high-speed rotating machinery uses a contact structure to realize data transmission between rotating parts and fixed parts. Mechanical wear and vibration noise can interfere with the subsequent processing and fault diagnosis of vibration signals. This paper designs a contactless vibration signal transmission system for rotating machinery using laser sensing. It analyzes the non-coincidence error between the optical axis and the rotating axis, which causes the effective photosensitive area and practical power of the detector to change periodically with the frequency of the rotational speed, resulting in the vibration signal presenting various harmonics with the rotational speed angular frequency as the fundamental wave. A convenient time-frequency joint analysis method is proposed using fractional Fourier transform in time-frequency domain projection localization. Using mixed programming techniques of C# and Matlab, an upper computer interface for data storage, processing, network publishing, is developed to form a complete vibration signal processing system. © 2024, The Authors. All rights reserved.

关键词： Rotating machinery