检索结果-内蒙古大学图书馆

Communication-Efficient Personalized Federated Learning for Green Communications in IoMT

学校读者我要写书评

暂无评论

Communication-Efficient Personalized Federated Learning for ...

IEEE International Conference on Communications (ICC)

作者： Ziqi Chen Jun Du Chunxiao Jiang Yunlong Lu Zhu Han Department of Electronic Engineering Tsinghua University Beijing China Beijing National Research Center for Information Science and Technology Tsinghua University Beijing China The State Key Laboratory of Rail Traffic Control and Safety Beijing Jiaotong University Beijing China Department of Electrical and Computer Engineering University of Houston Houston TX USA

ISBN: (数字)9781728190549

ISBN: (纸本)9781728190556

The rapid development of the Internet of Medical Things (IoMT) has brought about an enormous amount of healthcare data. Effectively and securely processing this sensitive data has become a significant challenge for green communication and privacy protection of the IoMT. As a decentralized learning framework, Federate learning (FL) enables model training without directly aggregating users' raw data, thus ensuring user privacy protection. Moreover, numerous studies have put forth various approaches to enhance the efficiency of FL by minimizing communication costs, yet they may not fully account for the unique characteristics of IoMT. Specifically, the efficiency and performance of model training are closely related to patient life and health. Meanwhile, existing research has indicated that reducing communication costs can result in a decline in training accuracy, which may be critical to patient health. Therefore, aimed at green communication and ensuring the model accuracy, we design a communication-efficient personalized federated learning framework, namely pFedCAS. Specifically, we introduce a control unit, which enables adaptive sparsity of local models, to reduce training costs. Furthermore, a selection unit based on communication quality is added into the global aggregation, which can select suitable clients for model updating. Simulation results validate that the proposed method can significantly reduce communication costs while ensuring the model accuracy. Additionally, The simulation results also validate the excellent robustness of our method to non-iid healthcare data.

关键词： Training Adaptation models Data privacy Costs Accuracy Federated learning Computational modeling

EDOLAB: An Open-Source Platform for Education and Experimentation with Evolutionary Dynamic Optimization Algorithms

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Peng, Mai Yazdani, Delaram She, Zeneng Yazdani, Danial Luo, Wenjian Li, Changhe Branke, Juergen Nguyen, Trung Thanh Gandomi, Amir H. Yang, Shengxiang Jin, Yaochu Yao, Xin School of Automation China University of Geosciences Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems Engineering Research Center of Intelligent Technology for Geo-Exploration Ministry of Education Wuhan China Research Institute Faculty of Engineering and Technology Liverpool John Moores University United Kingdom School of Computer Science and Technology Harbin Institute of Technology China Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies School of Computer Science and Technology Harbin Institute of Technology Peng Cheng Laboratory China School of Artificial Intelligence Anhui University of Sciences & Technology China Information Systems Management and Analytics in Warwick Business School University of Warwick United Kingdom Faculty of Engineering & Information Technology University of Technology Sydney Australia Obuda University Hungary School of Computer Science and Informatics De Montfort University United Kingdom Department of Artificial Intelligence School of Engineering Westlake University China School of Computer Science University of Birmingham United Kingdom

Many real-world optimization problems exhibit dynamic characteristics, posing significant challenges for traditional optimization techniques. Evolutionary Dynamic Optimization Algorithms (EDOAs) are designed to address these challenges effectively. However, in existing literature, the reported results for a given EDOA can vary significantly. This inconsistency often arises because the source codes for many EDOAs, which are typically complex, have not been made publicly available, leading to error-prone re-implementations. To support researchers in conducting experiments and comparing their algorithms with various EDOAs, we have developed an open-source MATLAB platform called the Evolutionary Dynamic Optimization laboratory (EDOLAB). This platform not only facilitates research but also includes an educational module designed for instructional purposes. The education module allows users to observe: a) a 2-dimensional problem space and its morphological changes following each environmental change, b) the behaviors of individuals over time, and c) how the EDOA responds to environmental changes and tracks the moving optimum. The current version of EDOLAB features 25 EDOAs and four fully parametric benchmark generators. © 2023, CC BY-NC-SA.

关键词： Optimization algorithms

Temporal Information Reconstruction and Non-Aligned Residual in Spiking Neural Networks for Speech Classification

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Qi Wang, Huamin Shen, Hangchi Duan, Shukai Wen, Shiping Huang, Tingwen College of Artificial Intelligence Southwest University Chongqing400715 China Chongqing Key Laboratory of Brain Inspired Computing and Intelligent Chips Chongqing400715 China College of Information Engineering University of Technology Sydney Australian Institute of Artificial Intelligence Sydney2007 Australia Faculty of Computer Science and Control Engineering Shenzhen University of Advanced Technology Shenzhen518055 China

Recently, it can be noticed that most models based on spiking neural networks (SNNs) only use a same level temporal resolution to deal with speech classification problems, which makes these models cannot learn the information of input data at different temporal scales. Additionally, owing to the different time lengths of the data before and after the sub-modules of many models, the effective residual connections cannot be applied to optimize the training processes of these models. To solve these problems, on the one hand, we reconstruct the temporal dimension of the audio spectrum to propose a novel method named as Temporal Reconstruction (TR) by referring the hierarchical processing process of the human brain for understanding speech. Then, the reconstructed SNN model with TR can learn the information of input data at different temporal scales and model more comprehensive semantic information from audio data because it enables the networks to learn the information of input data at different temporal resolutions. On the other hand, we propose the Non-Aligned Residual (NAR) method by analyzing the audio data, which allows the residual connection can be used in two audio data with different time lengths. We have conducted plentiful experiments on the Spiking Speech Commands (SSC), the Spiking Heidelberg Digits (SHD), and the Google Speech Commands v0.02 (GSC) datasets. According to the experiment results, we have achieved the state-of-the-art (SOTA) result 81.02% on SSC for the test classification accuracy of all SNN models, and we have obtained the SOTA result 96.04% on SHD for the classification accuracy of all models. Furthermore, on the non-spiking dataset GSC, we can achieve a test classification accuracy of 95.63%, which surpasses the original baseline SNN-Delays. Meanwhile, the method proposed in this paper can speed up the model’s processing speed and reduce its energy consumption. Copyright © 2024, The Authors. All rights reserved.

关键词： Spatio-temporal data

Adaptive Estimation for Environmental Monitoring Using an Autonomous Underwater Vehicle

学校读者我要写书评

暂无评论

Adaptive Estimation for Environmental Monitoring Using an Au...

IEEE Conference on Decision and control

作者： Ziwen Yang Joana Fonseca Shanying Zhu Cailian Chen Xinping Guan Karl H. Johansson Department of Automation Shanghai Jiao Tong University Shanghai China Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai China Shanghai Engineering Research Center of Intelligent Control and Management Shanghai China Division of Decision and Control Systems School of Electrical Engineering and Computer Science KTH Royal Institute of Technology Stockholm Sweden Digital Futures

This paper considers the problem of monitoring and adaptively estimating an environmental field, such as temperature or salinity, using an autonomous underwater vehicle (AUV). The AUV moves in the field and persistently measures environmental scalars and its position in its local coordinate frame. The environmental scalars are approximately linearly distributed over the region of interest, and an adaptive estimator is designed to estimate the gradient. By orthogonal decomposition of the velocity of the AUV, a linear time-varying system is equivalently constructed, and the sufficient conditions on the motion of the AUV are established, under which the global exponential stability of the estimation error system is rigorously proved. Furthermore, an estimate of the exponential convergence rate is given, and a reference trajectory that maximizes the estimate of the convergence rate is obtained for the AUV to track. Numerical examples verify the stability and efficiency of the system.

关键词：

Towards Efficient Modularity in Industrial Drying: A Combinatorial Optimization Viewpoint

学校读者我要写书评

暂无评论

Towards Efficient Modularity in Industrial Drying: A Combina...

American control Conference (ACC)

作者： Alisina Bayati Amber Srivastava Amir Malvandi Hao Feng Srinivasa M. Salapaka Department of Mechanical Science and Engineering University of Illinois at Urbana-Champaign IL USA Automatic Control Laboratory Swiss Federal Institute of Technology (ETH Zurich) Zurich Switzerland Department of Agriculture and Biological Engineering Sciences University of Illinois at Urbana-Champaign IL USA North Carolina Agricultural and Technical State University NC

The industrial drying process consumes approximately 12% of the total energy used in manufacturing, with the potential for a 40% reduction in energy usage through improved process controls and the development of new drying technologies. To achieve cost-efficient and high-performing drying, multiple drying technologies can be combined in a modular fashion with optimal sequencing and control parameters for each. This paper presents a mathematical formulation of this optimization problem and proposes a framework based on the Maximum Entropy Principle (MEP) to simultaneously solve for both optimal values of control parameters and optimal sequence. The proposed algorithm addresses the combinatorial optimization problem with a non-convex cost function riddled with multiple poor local minima. Simulation results on drying distillers dried grain (DDG) products show up to 12% improvement in energy consumption compared to the most efficient single-stage drying process. The proposed algorithm converges to local minima and is designed heuristically to reach the global minimum.

关键词：

Soft Masked Transformer for Point Cloud Processing with Skip Attention-Based Upsampling

学校读者我要写书评

暂无评论

arXiv 2024年

作者： He, Yong Yu, Hongshan Ibrahim, Muhammad Liu, Xiaoyan Chen, Tongjia Ulhaq, Anwaar Mian, Ajmal The National Engineering Laboratory for Robot Visual Perception and Control Technology College of Electrical and Information Engineering Hunan University Lushan South Rd. Yuelu Dist. Changsha410082 China The Department of Computer Science The University of Western Australia WA6009 Australia Central Queensland University Sydney Campus Australia

Point cloud processing methods leverage local and global point features to cater to downstream tasks, yet they often overlook the task-level context inherent in point clouds during the encoding stage. We argue that integrating task-level information into the encoding stage significantly enhances performance. To that end, we propose SMTransformer which incorporates task-level information into a vector-based transformer by utilizing a soft mask generated from task-level queries and keys to learn the attention weights. Additionally, to facilitate effective communication between features from the encoding and decoding layers in high-level tasks such as segmentation, we introduce a skip-attention-based up-sampling block. This block dynamically fuses features from various resolution points across the encoding and decoding layers. To mitigate the increase in network parameters and training time resulting from the complexity of the aforementioned blocks, we propose a novel shared position encoding strategy. This strategy allows various transformer blocks to share the same position information over the same resolution points, thereby reducing network parameters and training time without compromising accuracy. Experimental comparisons with existing methods on multiple datasets demonstrate the efficacy of SMTransformer and skip-attention-based up-sampling for point cloud processing tasks, including semantic segmentation and classification. In particular, we achieve state-of-the-art semantic segmentation results of 73.4% mIoU on S3DIS Area 5 and 62.4% mIoU on SWAN dataset. Copyright © 2024, The Authors. All rights reserved.

关键词： Decoding

Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging control

学校读者我要写书评

暂无评论

Federated Reinforcement Learning for Real-Time Electric Vehi...

IEEE Globecom Workshops

作者： Zixuan Zhang Yuning Jiang Yuanming Shi Ye Shi Wei Chen School of Information Science and Technology (SIST) ShanghaiTech University China Automatic Control Laboratory École Polytechnique Fédérale de Lausanne (EPFL) Switzerland Department of Electronic Engineering Tsinghua University China

ISBN: (纸本)9781665459761

With the recent advances in mobile energy storage technologies, electric vehicles (EVs) have become a crucial part of smart grids. When EVs participate in the demand response program, the charging cost can be significantly reduced by taking full advantage of the real-time pricing signals. However, many stochastic factors exist in the dynamic environment, bringing significant challenges to design an optimal charging/discharging control strategy. This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments to maximize EV users’ benefits. We first formulate this problem as a Markov decision process (MDP). Then we consider EV users with different behaviors as agents in different environments. Furthermore, a horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users’ behaviors and dynamic environments. This approach can learn an optimal charging/discharging control strategy without sharing users’ profiles. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various stochastic factors.

关键词： Simulation Reinforcement learning Pricing Markov processes Real-time systems Electric vehicle charging Behavioral sciences

Order-preserving pattern mining with forgetting mechanism

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Yan Ma, Chenyu Gao, Rong Wu, Youxi Li, Jinyan Wang, Wenjian Wu, Xindong School of Economics and Management Hebei University of Technology Tianjin300400 China School of Artificial Intelligence Hebei University of Technology Tianjin300400 China School of Computer Science and Control Engineering Shenzhen University of Advanced Technology Shenzhen518055 China Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China School of Computer and Information Technology Shanxi University Taiyuan237016 China Key Laboratory of Knowledge Engineering with Big Data The Ministry of Education of China Hefei University of Technology Hefei230009 China

Order-preserving pattern (OPP) mining is a type of sequential pattern mining method in which a group of ranks of time series is used to represent an OPP. This approach can discover frequent trends in time series. Existing OPP mining algorithms consider data points at different time to be equally important;however, newer data usually have a more significant impact, while older data have a weaker impact. We therefore introduce the forgetting mechanism into OPP mining to reduce the importance of older data. This paper explores the mining of OPPs with forgetting mechanism (OPF) and proposes an algorithm called OPF-Miner that can discover frequent OPFs. OPF-Miner performs two tasks, candidate pattern generation and support calculation. In candidate pattern generation, OPF-Miner employs a maximal support priority strategy and a group pattern fusion strategy to avoid redundant pattern fusions. For support calculation, we propose an algorithm called support calculation with forgetting mechanism, which uses prefix and suffix pattern pruning strategies to avoid redundant support calculations. The experiments are conducted on nine datasets and 12 alternative algorithms. The results verify that OPF-Miner is superior to other competitive algorithms. More importantly, OPF-Miner yields good clustering performance for time series, since the forgetting mechanism is employed. Copyright © 2024, The Authors. All rights reserved.

关键词： Miners

Social Force Embedded Mixed Graph Convolutional Network for Multi-class Trajectory Prediction

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Du, Quancheng Wang, Xiao Yin, Shouguo Li, Lingxi Ning, Huansheng The School of Computer and Communication Engineering University of Science and Technology Beijing Beijing100083 China The School of Artificial Intelligence Anhui University Hefei230031 China The State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing100190 China The School of Electrical and Computer Engineering Indiana University Purdue University IndianapolisIN46202 United States

Accurate prediction of agent motion trajectories is crucial for autonomous driving, contributing to the reduction of collision risks in human-vehicle interactions and ensuring ample response time for other traffic participants. Current research predominantly focuses on traditional deep learning methods, including convolutional neural networks (CNNs) and recurrent neural networks (RNNs). These methods leverage relative distances to forecast the motion trajectories of a single class of agents. However, in complex traffic scenarios, the motion patterns of various types of traffic participants exhibit inherent randomness and uncertainty. Relying solely on relative distances may not adequately capture the nuanced interaction patterns between different classes of road users. In this paper, we propose a novel multi-class trajectory prediction method named the social force embedded mixed graph convolutional network (SFEM-GCN). The primary goal is to extract social interactions among agents more accurately. SFEM-GCN comprises three graph topologies: the semantic graph (SG), position graph (PG), and velocity graph (VG). These graphs encode various of social force relationships among different classes of agents in complex scenes. Specifically, SG utilizes one-hot encoding of agent-class information to guide the construction of graph adjacency matrices based on semantic information. PG and VG create adjacency matrices to capture motion interaction relationships between different classes agents. These graph structures are then integrated into a mixed graph, where learning is conducted using a spatio-temporal graph convolutional neural network (ST-GCNN). To further enhance prediction performance, we adopt temporal convolutional networks (TCNs) to generate the predicted trajectory with fewer parameters. Experimental results on publicly available datasets demonstrate that SFEM-GCN surpasses state-of-the-art methods in terms of accuracy and robustness. Copyright © 2024, The Authors.

关键词： Forecasting