检索结果-内蒙古大学图书馆

Energy-Efficient Wireless Federated Learning via Doubly Adaptive Quantization

IEEE Transactions on Cognitive Communications and networking 2024年

作者： Han, Xuefeng Chen, Wen Li, Jun Ding, Ming Wu, Qingqing Wei, Kang Deng, Xiumei Mei, Zhen Shanghai Jiao Tong University Broadband Access Network Laboratory Minhang200240 China Southeast University School of Information Science and Engineering Nanjing210096 China CSIRO Data61 SydneyNSW2015 Australia Hong Kong Polytechnic University Department of Computing Hong Kong999077 Hong Kong Singapore China Ministry of Education School of Electrical and Optical Engineering Nanjing University of Science and Technology Nanjing210094 China

Federated learning (FL) has been recognized as a viable distributed learning paradigm for training a machine learning model across distributed clients without uploading raw data. However, FL in wireless networks still faces two major challenges, i.e., large communication overhead and high energy consumption, which are exacerbated by client heterogeneity in dataset sizes and wireless channels. While model quantization is effective for energy reduction, most works ignore adapting quantization to heterogeneous clients and the convergence in wireless FL. To address these challenges, this paper develops an energy optimization problem of jointly designing quantization levels, scheduling clients, allocating channels, and controlling computation frequencies (QCCF). Specifically, we derive an upper bound identifying the influence of client scheduling and quantization errors on FL convergence. Under the long-term convergence constraints and wireless constraints, the problem is formulated and transformed into an instantaneous problem, which is then decomposed into two subproblems to solve. The derived closed-form solution indicates that the doubly adaptive quantization level rises with the training process and negatively correlates with dataset sizes. Experiment results validate our theoretical results, showing that QCCF consumes less energy with faster convergence compared with state-of-the-art baselines. © 2024 IEEE.

关键词： Federated learning

来源：评论

学校读者我要写书评

暂无评论

SMGC-SBERT: A Multi-Feature Fusion Chinese Short Text Similarity Computation Model Based on Optimised SBERT

SMGC-SBERT: A Multi-Feature Fusion Chinese Short Text Simila...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Shuo Zhao Qiliang Gu Jianqiang Zhang Gongpeng Song Qin Lu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co. Jinan China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

Chinese short text similarity computation stands as a pivotal task within natural language processing, garnering significant attention. However, existing models grapple with limitations in handling intricate semantic relationships, such as the challenge of discerning subtle semantic nuances in text, inadequacies in effectively integrating diverse levels of semantic information, and the struggle to capture polysemous meanings accurately. In addressing these issues, this paper introduces an innovative Chinese short text similarity computation model, SMGC-SBERT. This model addresses shortcomings of the existing models by employing a multi-module fusion strategy, thereby enabling a more precise measurement of semantic similarity between texts. Primarily, the model incorporates SAT embedding to acquire phrase-level semantic information and leverages the MS-BERT model to encode text, improving the model's comprehension of textual polysemy and obtaining richer semantic representation. Then, the fusion of module features, including multi-branch convolutional networks and mix pooling, enables the extraction of textual features from varied levels, bolstering the model's representational capacity. Additionally, to further reduce overfitting risks while improving accuracy and other performance, a multi-layer feature adjustment network is utilized for short text similarity calculation. The final resultant experimental findings showcase the superiority of the SMGC-SBERT model over other neural network models, demonstrating significant advancements across both Chinese-SNLI and CCKS2018_Task3 Chinese short text datasets.

关键词： Deep learning Computational modeling Semantics Neural networks Feature extraction Natural language processing Multilingual Convolutional neural networks Cybernetics Overfitting

来源：评论

学校读者我要写书评

暂无评论

SCTAR: A Multi-Layer BiLSTM-Based Chinese Short Text Similarity Computation Model with Attention Mechanism

SCTAR: A Multi-Layer BiLSTM-Based Chinese Short Text Similar...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Shuo Zhao Yiyun Xing Jianqiang Zhang Gongpeng Song Qin Lu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co. Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

Text semantic similarity is a crucial research area in Natural Language Processing (NLP). However, traditional methods for calculating the similarity of short Chinese texts often fall short in accuracy and other crucial aspects. The Bidirectional Long Short-Term Memory network (BiLSTM) has demonstrated remarkable performance in computing the similarity of short Chinese texts by effectively capturing long-range dependencies and semantic information. Additionally, the multi-head attention mechanism considers the interaction between different text locations and semantic information, enhancing the model’s representative capacity. Building upon this foundation, our paper proposes an enhanced model known as SCTbilstmAttRdrop (SCTAR). This model is constructed based on a multilayer BiLSTM architecture and incorporates an SE-gated convolutional module and a convolutional multi-head attention-aware model. We conducted extensive evaluations using two Chinese short text datasets, Chinese-SNLI and CCKS2018_Task3. The experimental results unequivocally demonstrate that our SCTAR model surpasses other common methods in terms of accuracy, precision, recall, and F1 scores when tasked with computing the similarity of Chinese short texts.

关键词： Accuracy Attention mechanisms Computational modeling Semantics Bidirectional control Feature extraction Nonhomogeneous media

来源：评论

学校读者我要写书评

暂无评论

A novel method for ECG signal classification via one-dimensional convolutional neural network

A novel method for ECG signal classification via one-dimensi...

引用

作者： Hua, Xuan Han, Jungang Zhao, Chen Tang, Haipeng He, Zhuo Chen, Qinghui Tang, Shaojie Tang, Jinshan Zhou, Weihua College of Electronic Engineering Xi’an University of Posts and Telecommunications Xi’an710121 China Key Laboratory of Network Data Analysis and Intelligent Processing in Shaanxi Xi’an710121 China College of Computer Science and Technology Xi’an University of Posts and Telecommunications Xi’an710121 China College of Computing Michigan Technological University HoughtonMI49931 United States School of Computing University of Southern Mississippi Long Beach39560 United States Department of Kinesiology and Integrative Physiology Michigan Technological University HoughtonMI49931 United States School of Automation Xi’an University of Posts and Telecommunications Xi’an710121 China

This paper develops an end-to-end ECG signal classification algorithm based on a novel segmentation strategy and 1D Convolutional Neural networks (CNN) to aid the classification of ECG signals and alleviate the workload of physicians. The ECG segmentation strategy named R-R-R strategy (i.e., retaining ECG data between the R peaks just before and after the current R peak) is used for segmenting the original ECG data into segments to train and test the 1D CNN models. The novel strategy mimics physicians in scanning ECG to a greater extent, and maximizes the inherent information of ECG segments for diagnosis. The performance of the proposed end to end ECG signal classification algorithm was verified with the ECG signals from 48 records in the MIT-BIH arrhythmia database. When the heartbeat types were divided into the five classes recommended by clinicians, i.e., normal beat, left bundle branch block beat, right bundle branch block beat, premature ventricular contraction, and paced beat, the classification accuracy, the area under the curve (AUC), the sensitivity, and the F1-score achieved by the proposed model were 0.9924, 0.9994, 0.99 and 0.99, respectively. When the heartbeat types were divided into six classes recommended by clinicians, i.e., normal beat, left bundle branch block beat, right bundle branch block beat, premature ventricular contraction, paced beat and other beats, the beat classification accuracy, the AUC, the sensitivity, and the F1-score achieved by the model reached 0.9702, 0.9966, 0.97, and 0.97, respectively. When the heartbeat types were divided into five classes recommended by the Association for Advancement of Medical Instrumentation (AAMI), i.e., normal beat, supraventricular ectopic beat, ventricular ectopic beat, fusion beat, and unknown beat, the beat classification accuracy, the sensitivity, and the F1-score were 0.9745, 0.97, and 0.97, respectively. Experimental results show that the proposed method achieves better performance than the s

关键词： Electrocardiograms

来源：评论

学校读者我要写书评

暂无评论

FERI: Feature Enhancement and Relational Interaction for Image-text Matching

FERI: Feature Enhancement and Relational Interaction for Ima...

引用

International Conference on Parallel and Distributed Systems (ICPADS)

作者： Yu Zhang Jianqiang Zhang Gongpeng Song Qin Lu Shuo Zhao Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co. Jinan China

ISBN: (数字)9798331515966

ISBN: (纸本)9798331515973

Image-text matching is an important problem at the intersection of computer vision and natural language processing. It aims to establish the semantic link between image and text to achieve high-quality semantic alignment between the two modalities. However, the existing methods have the problem that the meaning expressed in the image or the complex narrative in the text cannot be fully understood due to insufficient feature extraction. Moreover, due to the essential modal differences between images and texts, how to effectively and accurately align the semantic contents in images and texts has become the key of research. In order to solve the above problems, this paper proposes a method based on feature enhancement and relationship interaction. When processing images, the proposed method fuses labeled features, region features and location features to represent images. When processing text, a combination of Bi-GRU and self-attention mechanism is used to represent the text. In order to further align the semantic content in images and texts accurately, this paper improves two relational interaction mechanisms by identifying connection relationships and learning association relationships. Thus, the relation enhanced embedding is obtained. Finally, it calculated the similarity of the enhanced embedding to judge the matching degree of the image and text. Extensive experiments on the public datasets Flickr30K and MSCOCO demonstrate the effectiveness of our method.

关键词： Computer vision Fuses Image matching Semantics Feature extraction Natural language processing

来源：评论

学校读者我要写书评

暂无评论

A Novel Text Matching Model Based on Multilayer Coding and Feature Enhancement

A Novel Text Matching Model Based on Multilayer Coding and F...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Yu Zhang Jianqiang Zhang Gongpeng Song Qin Lu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

With the rapid development of Natural Language Processing (NLP), text matching has become the basis of many downstream tasks in NLP, and the study of text matching is of great research significance for solving tasks such as question and answer and information retrieval in NLP. Most of the current text matching methods tend to have problems such as mismatch of grammatical structures and insufficient interaction information in sentences. In order to solve the problems of insufficient interaction information and lack of features and ability to capture keyword and sequence information in text matching, this paper proposes a text matching method based on multi-layer coding and soft attention mechanism. The method first embeds the text and sends it to a gating module for processing, then sends the processed result to a module containing a combination of multilayer coding and soft attention mechanism for further operations such as multiple alignment, and finally sends it to a classifier containing a three-layer fully-connected network for predicting whether the input text pairs match or not. The two modules proposed in this paper are practically feasible, and comparison and ablation experiments have been conducted on the publicly available datasets LCQMC dataset and BQ dataset, and the experimental results show that the two modules improve the accuracy of text matching by 2.44% and 1.02%, respectively.

关键词： Attention mechanisms Accuracy Computational modeling Impedance matching Nonhomogeneous media Information retrieval Encoding

来源：评论

学校读者我要写书评

暂无评论

Mixture Gaussian Distribution-Based Collaborative Reinforcement Learning for 3D UAV Localization Optimization Against Jamming Attacks

Mixture Gaussian Distribution-Based Collaborative Reinforcem...

引用

IEEE Conference on Global Communications (GLOBECOM)

作者： Yujiao Zhu Mingzhe Chen Sihua Wang Yuchen Liu Gaolei Li Changchuan Yin Tony Q.S. Quek Beijing Laboratory of Advanced Information Network Beijing University of Posts and Telecommunications Beijing China Information Systems Technology and Design Pillar Singapore University of Technology and Design Singapore Department of Electrical and Computer Engineering and Institute for Data Science and Computing University of Miami Coral Gables FL USA Department of Computer Science North Carolina State University Raleigh NC USA School of Electronic Information and Electrical Engineering Shanghai Jiao Tong University China

ISBN: (数字)9798350351255

ISBN: (纸本)9798350351262

In this paper, the optimization of unmanned aerial vehicle (UAV) localization under jamming attacks is studied. In the considered network, a base station (BS) collaborates with an active UAV to localize a target UAV. During this positioning process, a jamming UAV transmits discontinuous signals to passive UAVs to interfere the distance information measurement. To localize the target UAV under jamming attacks, the BS jointly use two localization methods: 1) generative adversarial network (GAN)-based positioning method and 2) time difference of arrival (TDOA)-based positioning method. Since GAN-based positioning method cannot defense in a strong jamming signal while TDOA-based positioning method may consume more energy and sacrifice localization accuracy, the BS must select an appropriate positioning method (GAN-based or TDOA-based methods) and four distance measurement information of passive UAVs to estimate the position of the target UAV. This problem is formulated as an optimization problem whose goal is to minimize the positioning error between the estimated and the ground truth positions of the target UAV while considering jamming attacks and the trajectory of passive UAVs. To solve this problem, we propose a mixture Gaussian distribution model-based collaborative reinforcement learning (RL) method which enables the active UAV to determine its transmit power and trajectory, and enables the BS to select the most appropriate subsets of distance measurement information and the optimal positioning method according to the movement of passive UAVs and the unknown jamming attack pattern of the jamming UAV. Simulation results show the proposed method can reduce the positioning error of the target UAV by up to 36.5% compared to the method that does not consider the GAN-based positioning method.

关键词： Location awareness Simulation Collaboration Reinforcement learning Gaussian distribution Autonomous aerial vehicles Distance measurement Trajectory Jamming Optimization

来源：评论

学校读者我要写书评

暂无评论

MFFLEN: Multi-Label Text Classification Based on Multi-Feature Fusion and Label Embedding

MFFLEN: Multi-Label Text Classification Based on Multi-Featu...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Qiliang Gu Shuo Zhao Jianqiang Zhang Gongpeng Song Qin Lu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Shandong Engineering Research Center of Big Data Applied Technology Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co. Jinan China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

To address the challenges associated with insufficiently extracting and utilizing features at different levels, overlooking the connection between label meanings and text, and facing problems of over-compression or information loss when extracting global information using recurrent neural networks in the field of multi-label text categorization, this paper introduces an innovative model known as MFFLEN (MultiFeature Fusion and Label Embedding Neural network). First, a back-translated enhanced label set is constructed by back-translated splicing enhancement of the original label set. This set, together with the text, is then input into the embedding layer, which consists of the pre-trained model of bert-baseChinese, thus establishing the initial connection between the text and the labels within the same vector space. Then, to comprehensively extract multi-level semantic features, the model uses a convolutional layer to extract local features and an embedding layer to extract sentence-level features. A bidirectional attention embedded GRU (BAE-GRU) layer is used to extract hybrid finegrained features, which are then fed into the attention layer to further extract hybrid labeled features based on labeling information. Finally, these three different types of features are fused and multi-label text classification results are obtained using a classifier. The experiments proved that the MFFLEN model achieved 73.82% and 88.44% macro-F1 and 88.00% and 88.86% micro-F1 on the two datasets CAIL 2018 Small and CAIL 2018 Split, respectively, which is better than other baseline models.

关键词： Measurement Recurrent neural networks Splicing Text categorization Semantics Multi label classification Logic gates Feature extraction Vectors data mining

来源：评论

学校读者我要写书评

暂无评论

Energy-Efficient Wireless Federated Learning via Doubly Adaptive Quantization

arXiv

引用

arXiv 2024年

作者： Han, Xuefeng Chen, Wen Li, Jun Ding, Ming Wu, Qingqing Wei, Kang Deng, Xiumei Mei, Zhen The Broadband Access Network Laboratory Shanghai Jiao Tong University Minhang200240 China School of Electrical and Optical Engineering Nanjing University of Science and Technology Ministry of Education Nanjing210094 China Data61 CSIRO SydneyNSW2015 Australia The Department of Computing Hong Kong Polytechnic University Hong Kong999077 Hong Kong

Federated learning (FL) has been recognized as a viable distributed learning paradigm for training a machine learning model across distributed clients without uploading raw data. However, FL in wireless networks still faces two major challenges, i.e., large communication overhead and high energy consumption, which are exacerbated by client heterogeneity in dataset sizes and wireless channels. While model quantization is effective for energy reduction, existing works ignore adapting quantization to heterogeneous clients and FL convergence. To address these challenges, this paper develops an energy optimization problem of jointly designing quantization levels, scheduling clients, allocating channels, and controlling computation frequencies (QCCF) in wireless FL. Specifically, we derive an upper bound identifying the influence of client scheduling and quantization errors on FL convergence. Under the long-term convergence constraints and wireless constraints, the problem is established and transformed into an instantaneous problem with Lyapunov optimization. Solving Karush-Kuhn-Tucker conditions, our closed-form solution indicates that the doubly adaptive quantization level rises with the training process and correlates negatively with dataset sizes. Experiment results validate our theoretical results, showing that QCCF consumes less energy with faster convergence compared with state-of-the-art baselines. Copyright © 2024, The Authors. All rights reserved.

关键词： Energy utilization

来源：评论

学校读者我要写书评

暂无评论

Biomass Energy May Mitigate Energy Shortages and Reduce Carbon Emissions in Asia

SSRN

引用

SSRN 2022年

作者： Li, Yong Wang, Zhaosheng Huang, Mei Gong, He Sun, Hongfu Zhu, Lin National Ecosystem Science Data Center Key Laboratory of Ecosystem Network Observation and Modeling Institute of Geographic Sciences and Natural Resources Research Chinese Academy of Sciences Beijing China College of Geoscience and Surveying Engineering China University of Mining and Technology Beijing100083 China National Satellite Meteorological Center China Meteorological Administration Beijing China

Biomass energy is a key component of renewable new energy, which is very important for energy security and environmental protection. Meanwhile, Asia is a region with intensive global energy consumption. It is of great significance to clarify its biomass energy potential and its role in energy and environment. So, we used MODIS NPP to evaluate potential biomass energy reserves and their temporal and spatial changes in Asia. The results show that the total potential biomass energy in Asia is 327.68 ± 11.11 EJ, which is approximately equal to the total energy use in all of Asia over the four years. In addition, we used the AHP and cluster analysis to investigate the degree of energy shortage in Asian *** supplying biomass energy for energy use in various countries, the number of countries with severe, moderate and mild energy shortages in Asia will decrease by 8.5%, 12.7% and 6.4% respectively. In addition, if 50% of conventional energy in Asia is replaced by biomass, its total carbon dioxide emissions will be reduced by 33% to 44%. Taken together, this shows that Asia's abundant biomass energy reserves can help alleviate energy shortages in various countries and reduce regional carbon dioxide emissions. © 2022, The Authors. All rights reserved.

关键词： Energy security

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：