检索结果-内蒙古大学图书馆

IEEE International Conference on Multimedia and Expo (ICME)

作者： Yixuan Guan Xuefeng Liu Tao Ren Jianwei Niu State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing China Zhongguancun Laboratory Beijing China State Key Laboratory of Intelligent Game Institute of Software Chinese Academy of Sciences Beijing China Zhengzhou University Research Institute of Industrial Technology School of Information Engineering Zhengzhou University Zhengzhou China

ISBN: (数字)9798350390155

ISBN: (纸本)9798350390162

Federated learning (FL) generally suffers significant communication overhead from high-traffic gradient synchronization. The majority of existing studies on this problem aim at compressing gradients under the premise of reliable transmission. While transmission reliability can be ensured via TCP by default, the notably increased latency and retransmitted packets are prohibitive for most clients in FL. To tackle this issue, we propose FedMDC, a retransmission-free compression framework for FL over packet lossy networks. Given clients’ limited resources, FedMDC adopts multiple description coding to encode gradients into redundant descriptions for erasure resilience simply through multiplying an overcomplete matrix; and then quantizes these descriptions for compression. To further reduce quantization distortion and computational overhead, a reduced decoding algorithm is developed by decoding the aggregation of all clients’ encodings in conjunction with a customized dither quantization design. Besides, FedMDC explicitly supports adaptive bitrates subject to clients’ heterogeneous communication budgets, which maximize resource utilization to facilitate distortion reduction and accelerate model convergence. Theoretical analysis and experimental results both demonstrate the effectiveness of our scheme.

关键词： Quantization (signal) Federated learning Distortion Propagation losses Encoding Decoding Reliability Synchronization Resource management Resilience

来源：评论

学校读者我要写书评

暂无评论

Heterogeneous Domain Adaptation Via Incremental Discriminative Knowledge Consistency

SSRN

引用

SSRN 2023年

作者： Lu, Yuwu Lin, Dewei Wen, Jiajun Shen, Linlin Li, Xuelong Wen, Zhenkun School of Software South China Normal University Foshan528225 China College of Computer Science and Software Engineering Shenzhen University Shenzhen518055 China Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518055 China Shenzhen University Shenzhen518055 China Northwestern Polytechnical University Xi’an710072 China

Heterogeneous domain adaptation is a challenging problem in transfer learning since samples from the source and target domains reside in different feature spaces with different feature dimensions. The key problem is how to minimize some gaps (e.g., data distribution mismatch) presented in two heterogeneous domains and produce highly discriminative representations for the target domain. In this paper, we attempt to address these challenges with the proposed incremental discriminative knowledge consistency (IDKC) method, which integrates cross-domain mapping, distribution matching, discriminative knowledge preservation, and domain-specific geometry structure consistency into a unified learning model. Specifically, we attempt to learn a domain-specific projection to project original samples into a common subspace in which the marginal distribution is well aligned and the discriminative knowledge consistency is preserved by leveraging the labeled samples from both domains. Moreover, domain-specific structure consistency is enforced to preserve the data manifold from the original space to the common feature space in each domain. Meanwhile, we further apply pseudo labeling to unlabeled target samples based on the feature correlation and retain pseudo labels with high feature correlation coefficients for the next iterative learning. Our pseudo-labeling strategy expands the number of labeled target samples in each category and thus enforces class-discriminative knowledge consistency to produce more discriminative feature representations for the target domain. Extensive experiments on several standard benchmarks for object recognition, cross-language text classification, and digit classification tasks verify the effectiveness of our method. © 2023, The Authors. All rights reserved.

关键词： Object recognition

来源：评论

学校读者我要写书评

暂无评论

Parallel cognition:hybrid intelligence for human-machine interaction and management

引用

Frontiers of Information Technology & Electronic engineering 2022年第12期23卷 1765-1779页

作者： Peijun YE Xiao WANG Wenbo ZHENG Qinglai WEI Fei-Yue WANG State Key Laboratory for Management and Control of Complea Systems Institute of AutomationChinese Academy of SciencesBeijing 100190China QingdaoAcademy of Intelligent Industries Qingdao 266109China School of Software Engineering Xi'an Jiaotong UniversityXi'an 710049China Macao Institute of System Engineering Macao University of Science and TechnologyMacao 999078China

As an interdisciplinary research approach,traditional cognitive science adopts mainly the experiment,induction,modeling,and validation *** models are sometimes not applicable in cyber-physical-socialsystems (CPSSs),where the large number of human users involves severe heterogeneity and *** reduce the decision-making conflicts between people and machines in human-centered systems,we propose a new research paradigm called parallel cognition that uses the system of intelligent techniques to investigate cognitive activities and functionals in three stages:descriptive cognition based on artificial cognitive systems (ACSs),predictive cognition with computational deliberation experiments,and prescriptive cognition via parallel behavioral *** make iteration of these stages constantly on-line,a hybrid learning method based on both a psychological model and user behavioral data is further proposed to adaptively learn an individual’s cognitive *** experiments on two representative scenarios,urban travel behavioral prescription and cognitive visual reasoning,indicate that our parallel cognition learning is effective and feasible for human behavioral prescription,and can thus facilitate human-machine cooperation in both complex engineering and social systems.

关键词： Cognitive learning Artificial intelligence Behavioral prescription

来源：评论

学校读者我要写书评

暂无评论

Embedding Representation of Academic Heterogeneous Information Networks Based on Federated Learning

Embedding Representation of Academic Heterogeneous Informati...

引用

IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS)

作者： Junfu Wang Yawen Li Meiyu Liang Ang Li Beijing Key Laboratory of Intelligent Communication Software and Multimedia School of Computer Science (National Pilot Software Engineering School) Beijing University of Posts and Telecommunications Beijing School of Economics and Management Beijing University of Posts and Telecommunications Beijing

ISBN: (纸本)9781665456579

Existing studies for representation learning of homogeneous information networks cannot be applicable to academic heterogeneous information networks (HINs) with multi-type nodes and multi-relationships because of the lack of ability to issue heterogeneity. Meanwhile, due to the closeness and blocking of businesses among different enterprises, there is a serious phenomenon of data islands. To solve the above challenges, we proposed an academic heterogeneous information network embedding representation learning method based on federated learning (FedAHE), which utilizes node attention and meta path attention mechanism to learn low-dimensional, dense and real-valued vector representations while preserving the rich topological information and meta-path-based semantic information of nodes in network. Moreover, we combined federated learning with the representation learning of academic HINs and put forward a federal training mechanism based on dynamic weighted aggregation of parameters (FedDWA) to optimize the node embeddings of HINs. Through sufficient experiments, the efficiency, accuracy and feasibility of our proposed framework are demonstrated.

关键词： Representation learning Training Cloud computing Federated learning Semantics intelligent systems Business

来源：评论

学校读者我要写书评

暂无评论

A Time-Efficient Distributed Constant Conditional Functional Dependency Discovery Algorithm for Data Consistency

A Time-Efficient Distributed Constant Conditional Functional...

引用

IEEE Annual International Computer software and Applications Conference (COMPSAC)

作者： Junchao Chen Jian-tao Zhou Xinyu Hao Inner Mongolia Engineering Laboratory for Cloud Computing and Service Software Inner Mongolia Key Laboratory of Social Computing and Data Processing Inner Mongolia Engineering Laboratory for Big Data Analysis Technology College of Computer Science Inner Mongolia University Engineering Research Center of Ecological Big Data Ministry of Education National & Local Joint Engineering Research Center of Intelligent Information Processing Technology for Mongolian Hohhot China

ISBN: (数字)9798350376968

ISBN: (纸本)9798350376975

The accuracy of data analysis depends on data quality, and addressing data consistency issues is a key challenge to improve it. Constant Conditional Functional Dependency (CCFD) is an effective approach that ensures data consistency by enforcing bindings of semantically related values, thus providing quality assurance for data analysis and decision-making processes. However, with the growth of data scale, especially the increasing number of data tuples and attributes, existing single-machine CCFD discovery algorithms face issues of low computational efficiency and lengthy computation time. This paper proposes a time-efficient distributed CCFD discovery algorithm (DCCFD). Through the optimization of data preprocessing and index mapping, the data organization structure is enhanced, laying the foundation for the discovery of CCFDs under distributed conditions. The Spark parallel computing framework is used to partition the dataset, which accelerates the parallel loading and processing of data. Additionally, this algorithm ensures accuracy and processing speed when discovering dependencies by efficiently generating frequent itemsets and verifying CCFDs in parallel. Experiments on multiple real datasets show that, especially with the complex Airline dataset, the DCCFD algorithm not only accurately discovers CCFDs, but also reduces the average running time by 75.64% compared with the preCFDMiner algorithm.

关键词： Accuracy Data preprocessing software algorithms Distributed databases Parallel processing software Partitioning algorithms

来源：评论

学校读者我要写书评

暂无评论

FedTC: Enabling Communication-Efficient Federated Learning via Transform Coding

FedTC: Enabling Communication-Efficient Federated Learning v...

引用

IEEE Annual Joint Conference: INFOCOM, IEEE Computer and Communications Societies

作者： Yixuan Guan Xuefeng Liu Jianwei Niu Tao Ren State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing China Zhongguancun Laboratory Beijing China Zhengzhou University Research Institute of Industrial Technology School of Information Engineering Zhengzhou University Zhengzhou China State Key Laboratory of Intelligent Game Institute of Software Chinese Academy of Sciences Beijing China

ISBN: (数字)9798350383508

ISBN: (纸本)9798350383515

Federated learning (FL) enables distributed training via periodically synchronizing model updates among participants. Communication overhead becomes a dominant constraint of FL since participating clients usually suffer from limited bandwidth. To tackle this issue, top-k based gradient compression techniques are broadly explored in FL context, manifesting powerful capabilities in reducing gradient volumes via picking significant entries. However, previous studies are primarily conducted on the raw gradients where massive spatial redundancies exist and positions of non-zero (top-k) entries vary greatly between gradients, which both impede the achievement of deeper compressions. Top-k may also degrade the performance of trained models due to biased gradient estimations. Targeting the above issues, we propose FedTC, a novel transform coding based compression framework. FedTC transforms gradients into a new domain with more compact energy distributions, which facilitates reducing spatial redundancies and biases in subsequent sparsification. Furthermore, non-zero entries across clients from different rounds become highly aligned in the transform domain, motivating us to partition the gradients into smaller entry blocks with various alignment levels to better exploit these alignments. Lastly, positions and values of non-zero entries are independently compressed in a block-wise manner with our customized designs, through which a higher compression ratio is achieved. Theoretical analysis and extensive experiments consistently demonstrate the effectiveness of our approach.

关键词： Training Quantization (signal) Costs Federated learning Redundancy Transform coding Estimation

来源：评论

学校读者我要写书评

暂无评论

M3OFF: Module-Compositional Model-Free Computation Offloading in Multi-Environment MEC

M3OFF: Module-Compositional Model-Free Computation Offloadin...

引用

IEEE Annual Joint Conference: INFOCOM, IEEE Computer and Communications Societies

作者： Tao Ren Zheyuan Hu Jianwei Niu Weikun Feng Hang He State Key Laboratory of Intelligent Game Institute of Software Chinese Academy of Sciences Beijing China State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing China Zhongguancun Laboratory Beijing China Zhengzhou University Research Institute of Industrial Technology School of Information Engineering Zhengzhou University Zhengzhou China

ISBN: (数字)9798350383508

ISBN: (纸本)9798350383515

Computation offloading is one of the key issues in mobile edge computing (MEC) that alleviates the tension between user equipment's limited capabilities and mobile application's high requirements. To achieve model-free computation offloading when reliable MEC dynamics are unavailable, deep reinforcement learning (DRL) has become a popular methodology. However, most existing DRL-based offloading approaches are developed for a single MEC environment, with invariant system bandwidth, edge capability, task types, etc., while realistic MEC scenarios tend to be of high diversity. Unfortunately, in multi-MEC environments, DRL-based offloading faces at least two challenges, learning inefficiency and interference of offloading experiences. To address the challenges, we propose a DRL-based Multi-environmental Module-compositional Modelfree computation OFFloading (M 3 OFF) framework. M 3 OFF generates offloading policies using module composition instead of a single DRL network so that learning efficiency could be improved by reusing the same modules and learning interference could be reduced by composing different modules. Furthermore, we design multiple module composition-specific training methods for M 3 OFF, including alternate modules-and-composer updates to improve training stability, loss-regularization to avoid module degeneration, and module-dropout to mitigate overfitting. Extensive experimental results on both simulation and testbed demonstrate that M 3 OFF outperforms the performances of most state-of-the-arts in multi-MEC and reaches close to single-MEC.

关键词： Training Visualization Multi-access edge computing Computational modeling Interference Bandwidth Stability analysis

来源：评论

学校读者我要写书评

暂无评论

Self-Supervised Entity Alignment Based on Multi-Modal Contrastive Learning

引用

IEEE/CAA Journal of Automatica Sinica 2022年第11期9卷 2031-2033页

作者： Bo Liu Ruoyi Song Yuejia Xiang Junbo Du Weijian Ruan Jinhui Hu the School of Software Engineering Xi’an Jiaotong UniversityXi’an 710000 the China Electronics Technology Group Corporation(CETC)Key Laboratory of Smart City Model Simulation and Intelligent Technology the Smart City Research Institute of CETC and National Center for Applied Mathematics Shenzhen(NCAMS)Shenzhen 518000China the Chinese University of Hong Kong Shenzhen 518000China Tencent Shenzhen 518000China the CETC Key Laboratory of Smart City Model Simulation and Intelligent Technology the Smart City Research Institute of CETC and National Center for Applied Mathematics Shenzhen(NCAMS)Shenzhen 518000China the Shenzhen Institute of Advanced Technology Chinese Academy of SciencesShenzhen 518055

Dear Editor,This letter proposes an unsupervised entity alignment method,which realizes integration of multiple multi-modal knowledge graphs *** recent years,Large-scale multi-modal knowledge graphs(LMKGs),containing text and image,have been widely applied in numerous knowledge-driven topics,such as question answering,entity linking,information extraction,reasoning and recommendation.

关键词： modal linking letter

来源：评论

学校读者我要写书评

暂无评论

FF-KGAT: Feature Fusion Based Knowledge Graph Attention Network for Recommendation 5

FF-KGAT: Feature Fusion Based Knowledge Graph Attention Netw...

引用

5th International Conference on Artificial Intelligence and Pattern Recognition, AIPR 2022

作者： Tao, Li Xiaoge, Li Chaodong, Wang Xianliang, Li Shuai, Gao Dan, Han Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing Xian University of Posts and Telecommunications Shaanxi Xi'an710121 China School of Computer Xian University of Posts and Telecommunications Shaanxi Xi'an710121 China Inspur Software Technology Co Ltd Software Development Project Management China Xian University of Posts and Telecommunications Shaanxi Xi'an710121 China School of Communication and Information Engineering Xian University of Posts and Telecommunications Shaanxi Xi'an710121 China

ISBN: (纸本)9781450396899

It is commonly agreed that a recommender system based on knowledge graph (KG) should not only use user-item interactions, but also take side information into account to deal with the problem of data sparsity. However, existing KG-based models present unique challenges that have the shortcoming of cold start and redundant iterations. To address the issue, we propose a Feature Fusion-based Knowledge Graph Attention Network (FF-KGAT) for the recommendation. FF-KGAT handles the cold-start problem through introducing user characteristics to fully explore the information of users. Additionally, FF-KGAT introduces the feature fusion graph, which removes slight nodes to obtain fewer iterations. Experimental results show that the proposed model significantly outperforms baseline methods. Particularly, the ndcg is increased by 9.83% and 10.25% on two public datasets, compared with the best performance of existing methods. © 2022 ACM.

关键词： Recommender systems

来源：评论

学校读者我要写书评

暂无评论

Personalized Federated Learning for Generative AI-Assisted Semantic Communications

arXiv

引用

arXiv 2024年

作者： Peng, Yubo Jiang, Feibo Dong, Li Wang, Kezhi Yang, Kun School of Intelligent Software and Engineering Nanjing University Suzhou China School of Information Science and Engineering Hunan Normal University Changsha China Changsha Social Laboratory of Artificial Intelligence Hunan University of Technology and Business Changsha China Department of Computer Science Brunel University London United Kingdom

Semantic Communication (SC) focuses on transmitting only the semantic information rather than the raw data. This approach offers an efficient solution to the issue of spectrum resource utilization caused by the various intelligent applications on Mobile Users (MUs). Generative Artificial Intelligence (GAI) models have recently exhibited remarkable content generation and signal processing capabilities, presenting new opportunities for enhancing SC. Therefore, we propose a GAI-assisted SC (GSC) model deployed between MUs and the Base Station (BS). Then, to train the GSC model using the local data of MUs while ensuring privacy and accommodating heterogeneous requirements of MUs, we introduce Personalized Semantic Federated Learning (PSFL). This approach incorporates a novel Personalized Local Distillation (PLD) and Adaptive Global Pruning (AGP). In PLD, each MU selects a personalized GSC model as a mentor tailored to its local resources and a unified Convolutional Neural Networks (CNN)-based SC (CSC) model as a student. This mentor model is then distilled into the student model for global aggregation. In AGP, we perform network pruning on the aggregated global model according to real-time communication environments, reducing communication energy. Finally, numerical results demonstrate the feasibility and efficiency of the proposed PSFL scheme. © 2024, CC BY-NC-ND.

关键词： Federated learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：