检索结果-内蒙古大学图书馆

Large Scale Model Enabled Semantic Communications Based on Robust Knowledge Distillation

学校读者我要写书评

暂无评论

Large Scale Model Enabled Semantic Communications Based on R...

IEEE Conference on Global Communications (GLOBECOM)

作者： Kuiyuan Ding Fangfang Liu Yang Yang Mingzhe Chen Caili Guo Beijing Key Laboratory of Network System Architecture and Convergence School of Information and Communication Engineering Beijing University of Posts and Telecommunications Beijing China Department of Electrical and Computer Engineering and the Institute for Data Science and Computing University of Miami Coral Gables FL USA Beijing Laboratory of Advanced Information Networks School of Information and Communication Engineering Beijing University of Posts and Telecommunications Beijing China

ISBN: (数字)9798350351255

ISBN: (纸本)9798350351262

Large scale artificial intelligence (AI) models possess excellent capabilities in semantic representation and understanding, making them particularly well-suited for semantic encoding and decoding. However, the substantial scale of these AI models imposes unacceptable computational resources and communication delays. To address this issue, we propose a semantic communication scheme based on robust knowledge distillation (RKD-SC) for large scale model enabled semantic communications. In the considered system, a transmitter extracts the features of the source image for robust transmission and accurate image classification at the receiver. To effectively utilize the superior capability of large scale model while make the cost affordable, we first transfer knowledge from a large scale model to a smaller scale model to serve as the semantic encoder. Then, to enhance the robustness of the system against channel noise, we propose a channel-aware autoencoder (CAA) based on the Transformer architecture. Experimental results show that the encoder of proposed RKD-SC system can achieve over 93.3% of the performance of a large scale model while compressing 96.67% number of parameters. Code: https://***/echojayne/RKD-SC.

关键词： Transmitters Computational modeling Noise Autoencoders Receivers Semantic communication Transformers Feature extraction Robustness Decoding

Deep Robust Reversible Watermarking

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Chen, Jiale Wang, Wei Shi, Chongyang Dong, Li Li, Yuanman Hu, Xiping School of Computer Science Beijing Institute of Technology Beijing100081 China Guangdong-Hong Kong-Macao Joint Laboratory for Emotional Intelligence and Pervasive Computing Artificial Intelligence Research Institute Shenzhen MSU-BIT University Shenzhen518172 China School of Medical Technology Beijing Institute of Technology Beijing100081 China College of Electronics and Information Engineering Shenzhen University Shenzhen518060 China Department of Computer Science Faculty of Electrical Engineering and Computer Science Ningbo University Ningbo315211 China

Robust Reversible Watermarking (RRW) enables perfect recovery of cover images and watermarks in lossless channels while ensuring robust watermark extraction under lossy channels. However, existing RRW methods, mostly non-deep learning-based, suffer from complex designs, high computational costs, and poor robustness limiting their practical applications. To address these issues, this paper proposes Deep Robust Reversible Watermarking (DRRW), a deep learning-based RRW scheme. DRRW introduces an Integer Invertible Watermark Network (iIWN) to achieve an invertible mapping between integer data distributions, fundamentally addressing the limitations of conventional RRW approaches. Unlike traditional RRW methods requiring task-specific designs for different distortions, DRRW adopts an encoder-noise layer-decoder framework, enabling adaptive robustness against various distortions through end-to-end training. During inference, the cover image and watermark are mapped into an overflowed stego image and latent variables. Arithmetic coding efficiently compresses these into a compact bitstream, which is embedded via reversible data hiding to ensure lossless recovery of both the image and watermark. To reduce pixel overflow, we introduce an overflow penalty loss, significantly shortening the auxiliary bitstream while improving both robustness and stego image quality. Additionally, we propose an adaptive weight adjustment strategy that eliminates the need to manually preset the watermark loss weight, ensuring improved training stability and performance. Experiments on multiple datasets demonstrate that DRRW achieves notable performance advantages. Compared to state-of-the-art RRW methods, DRRW improves robustness and reduces embedding, extraction, and recovery complexities by 55.14×, 5.95×, and 3.57×, respectively. The auxiliary bitstream is shortened by 43.86×, and reversible embedding succeeds on 16,762 images in the PASCAL VOC 2012 dataset, marking a significant step toward pra

关键词： Image enhancement

From Single to Multi-Functional RIS: Architecture, Key Technologies, Challenges, and Applications

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Ni, Wanli Zheng, Ailing Wang, Wen Niyato, Dusit Al-Dhahir, Naofal Debbah, Mérouane The Department of Electronic Engineering Tsinghua University China The State Key Laboratory of Networking and Switching Technology Beijing University of Posts and Telecommunications China The College of Computing and Data Science Nanyang Technological University Singapore The Department of Electrical and Computer Engineering The University of Texas Dallas United States The KU 6G Research Center Khalifa University of Science and Technology United Arab Emirates

Although reconfigurable intelligent surfaces (RISs) have demonstrated the potential to boost network capacity and expand coverage by adjusting their electromagnetic properties, existing RIS architectures have certain limitations, such as double-fading attenuation and restricted half-space coverage. In this article, we delve into the progressive development from single to multi-functional RIS (MF-RIS) that enables simultaneous signal amplification, reflection, and refraction. We begin by detailing the hardware design and signal model that distinguish MF-RIS from traditional RISs. Subsequently, we introduce the key technologies underpinning MF-RIS-aided communications, along with the fundamental issues and challenges inherent to its deployment. We then outline the promising applications of MF-RIS in the realm of communication, sensing, and computation systems, highlighting its transformative impact on these domains. Lastly, we present simulation results to demonstrate the superiority of MF-RIS in enhancing network performance in terms of spectral efficiency. Copyright © 2024, The Authors. All rights reserved.

关键词： Geometry

Integrating Generative Artificial Intelligence Into Future Internet of Vehicles [From the Guest Editors]

学校读者我要写书评

暂无评论

IEEE Vehicular Technology Magazine 2025年第2期20卷 40-42页

作者： Sun, Gang Du, Hongyang Jamalipour, Abbas Muntean, Gabriel-Miro Cai, Lin Kang, Jiawen Niyato, Dusit University of Electronic Science and Technology of China Chengdu611731 China The University of Hong Kong Department of Electrical and Electronic Engineering 999077 Hong Kong University of Sydney SydneyNSW2006 Australia Dublin City University Performance Engineering Laboratory DublinD9 Ireland University of Victoria Department of Electrical and Computer Engineering VictoriaBCV8W 2Y2 Canada Guangdong University of Technology Guangzhou510006 China Nanyang Technological University Singapore College of Computing and Data Science 639798 Singapore

Performance Optimization for Vehicular Cooperative Sensing: A Graph Attention Based Reinforcement Learning Approach

学校读者我要写书评

暂无评论

Performance Optimization for Vehicular Cooperative Sensing: ...

IEEE Conference on Global Communications (GLOBECOM)

作者： Xuefei Li Mingzhe Chen Danpu Liu Zhilong Zhang Tony Q. S. Quek Beijing Laboratory of Advanced Information Network Beijing University of Posts and Telecommunications Beijing China Department of Electrical and Computer Engineering and Institute for Data Science and Computing University of Miami Coral Gables FL USA Information Systems Technology and Design Pillar Singapore University of Technology and Design Singapore

ISBN: (数字)9798350351255

ISBN: (纸本)9798350351262

In this paper, the problem of collaborative vehicle sensing is investigated. In the considered model, a set of cooperative vehicles provide sensing information to sensing request vehicles with limited sensing and communication resources. A base station (BS) determines the subset of sensing request vehicles that each cooperative vehicle will serve and the sub-regions that each cooperative vehicle will detect. We formulate an optimization problem aiming to maximize the number of successfully detected sub-regions of sensing request vehicles while satisfying the cooperative sensing energy requirement by jointly determining the cooperative vehicle association and the sensing sub-region selection. To solve this problem, we propose a graph attention based reinforcement learning (RL) algorithm that can generate the graph information vectors based on the correlation between each cooperative vehicle and each sensing request vehicle. Using the learned graph information, the joint cooperative vehicle association and sensing sub-region selection strategy will be determined. Simulation results show that the proposed scheme can improve the number of successfully detected sub-regions of sensing request vehicles by up to 12.5% compared to the conventional RL algorithm without using graph attention networks (GANs).

关键词： Base stations Correlation Network topology Simulation Collaboration Reinforcement learning Vectors Sensors Global communication Optimization

Spiking Neural Networks for Temporal Processing: Status Quo and Future Prospects

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Ma, Chenxiang Chen, Xinyi Li, Yanchen Yang, Qu Wu, Yujie Li, Guoqi Pan, Gang Tang, Huajin Tan, Kay Chen Wu, Jibin Department of Data Science and Artificial Intelligence The Hong Kong Polytechnic University Hong Kong Department of Computing The Hong Kong Polytechnic University Hong Kong Department of Electrical and Computer Engineering National University of Singapore 119077 Singapore Institute of Automation Chinese Academy of Sciences Beijing100045 China State Key Laboratory of Brain-Machine Intelligence College of Computer Science and Technology MOE Frontier Science Center for Brain Science and Brain-Machine Integration Zhejiang University Hangzhou310027 China

Temporal processing is fundamental for both biological and artificial intelligence systems, as it enables the comprehension of dynamic environments and facilitates timely responses. Spiking Neural Networks (SNNs) excel in handling such data with high efficiency, owing to their rich neuronal dynamics and sparse activity patterns. Given the recent surge in the development of SNNs, there is an urgent need for a comprehensive evaluation of their temporal processing capabilities. In this paper, we first conduct an in-depth assessment of commonly used neuromorphic benchmarks, revealing critical limitations in their ability to evaluate the temporal processing capabilities of SNNs. To bridge this gap, we further introduce a benchmark suite consisting of three temporal processing tasks characterized by rich temporal dynamics across multiple timescales. Utilizing this benchmark suite, we perform a thorough evaluation of recently introduced SNN approaches to elucidate the current status of SNNs in temporal processing. Our findings indicate significant advancements in recently developed spiking neuron models and neural architectures regarding their temporal processing capabilities, while also highlighting a performance gap in handling long-range dependencies when compared to state-of-the-art non-spiking models. Finally, we discuss the key challenges and outline potential avenues for future research. Copyright © 2025, The Authors. All rights reserved.

关键词： Spatio-temporal data

Lightweight Deep Learning for Resource-Constrained Environments: A Survey

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Hou-I Galindo, Marco Xie, Hongxia Wong, Lai-Kuan Shuai, Hong-Han Li, Yung-Yui Cheng, Wen-Huang Department of Electronics and Electrical Engineering National Yang Ming Chiao Tung University Hsinchu300 Taiwan College of Computer Science and Technology Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Jilin University Changchun130000 China Faculty of Computing and Informatics Multimedia University Cyberjaya63100 Malaysia Hon Hai Research Institute Taipei114 Taiwan Department of Computer Science and Information Engineering National Taiwan University Taipei106 Taiwan

Over the past decade, the dominance of deep learning has prevailed across various domains of artificial intelligence, including natural language processing, computer vision, and biomedical signal processing. While there have been remarkable improvements in model accuracy, deploying these models on lightweight devices, such as mobile phones and microcontrollers, is constrained by limited resources. In this survey, we provide comprehensive design guidance tailored for these devices, detailing the meticulous design of lightweight models, compression methods, and hardware acceleration strategies. The principal goal of this work is to explore methods and concepts for getting around hardware constraints without compromising the model's accuracy. Additionally, we explore two notable paths for lightweight deep learning in the future: deployment techniques for TinyML and Large Language Models. Although these paths undoubtedly have potential, they also present significant challenges, encouraging research into unexplored areas. Copyright © 2024, The Authors. All rights reserved.

关键词： computer hardware

Unlocking the Secrets Behind Advanced Artificial Intelligence Language Models in Deidentifying Chinese-English Mixed Clinical Text: Development and Validation Study

学校读者我要写书评

暂无评论

Journal of Medical Internet Research 2024年第1期26卷 e48443页

作者： Lee, You-Qian Chen, Ching-Tai Chen, Chien-Chang Lee, Chung-Hong Chen, Peitsz Wu, Chi-Shin Dai, Hong-Jie Dialogue System Technical Department Asustek Computer Inc Taipei Taiwan Intelligent System Laboratory Department of Electrical Engineering College of Electrical Engineering and Computer Science National Kaohsiung University of Science and Technology Kaohsiung Taiwan Department of Bioinformatics and Medical Engineering Asia University Taichung Taiwan Center for Precision Health Research Asia University Taichung Taiwan Electromagnetic Sensing Control and AI Computing System Laboratory Department of Electrical Engineering College of Electrical Engineering and Computer Science National Kaohsiung University of Science and Technology Kaohsiung Taiwan Knowledge Discovery and Data Mining Lab Department of Electrical Engineering College of Electrical Engineering and Computer Science National Kaohsiung University of Science and Technology Kaohsiung Taiwan Department of Chemical Engineering Feng Chia University Taichung Taiwan National Center for Geriatrics and Welfare Research National Health Research Institutes Zhunan Taiwan National Institute of Cancer Research National Health Research Institutes Tainan Taiwan School of Post-Baccalaureate Medicine College of Medicine Kaohsiung Medical University Kaohsiung Taiwan Center for Big Data Research Kaohsiung Medical University Kaohsiung Taiwan

Background: The widespread use of electronic health records in the clinical and biomedical fields makes the removal of protected health information (PHI) essential to maintain privacy. However, a significant portion of information is recorded in unstructured textual forms, posing a challenge for deidentification. In multilingual countries, medical records could be written in a mixture of more than one language, referred to as code mixing. Most current clinical natural language processing techniques are designed for monolingual text, and there is a need to address the deidentification of code-mixed text. Objective: The aim of this study was to investigate the effectiveness and underlying mechanism of fine-tuned pretrained language models (PLMs) in identifying PHI in the code-mixed context. Additionally, we aimed to evaluate the potential of prompting large language models (LLMs) for recognizing PHI in a zero-shot manner. Methods: We compiled the first clinical code-mixed deidentification data set consisting of text written in Chinese and English. We explored the effectiveness of fine-tuned PLMs for recognizing PHI in code-mixed content, with a focus on whether PLMs exploit naming regularity and mention coverage to achieve superior performance, by probing the developed models’ outputs to examine their decision-making process. Furthermore, we investigated the potential of prompt-based in-context learning of LLMs for recognizing PHI in code-mixed text. Results: The developed methods were evaluated on a code-mixed deidentification corpus of 1700 discharge summaries. We observed that different PHI types had preferences in their occurrences within the different types of language-mixed sentences, and PLMs could effectively recognize PHI by exploiting the learned name regularity. However, the models may exhibit suboptimal results when regularity is weak or mentions contain unknown words that the representations cannot generate well. We also found that the availability of cod

关键词： ChatGPT code mixing deidentification electronic health record large language model pretrained language model

FIRE: a dataset for feedback integration and refinement evaluation of multimodal models 24

学校读者我要写书评

暂无评论

FIRE: a dataset for feedback integration and refinement eval...

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Pengxiang Li Zhi Gao Bofei Zhang Tao Yuan Yuwei Wu Mehrtash Harandi Yunde Jia Song-Chun Zhu Qing Li Beijing Key Laboratory of Intelligent Information Technology School of Computer Science & Technology Beijing Institute of Technology and State Key Laboratory of General Artificial Intelligence BIGAI State Key Laboratory of General Artificial Intelligence BIGAI and State Key Laboratory of General Artificial Intelligence Peking University State Key Laboratory of General Artificial Intelligence BIGAI Beijing Key Laboratory of Intelligent Information Technology School of Computer Science & Technology Beijing Institute of Technology and Guangdong Laboratory of Machine Perception and Intelligent Computing Shenzhen MSU-BIT University Department of Electrical and Computer System Engineering Monash University Guangdong Laboratory of Machine Perception and Intelligent Computing Shenzhen MSU-BIT University and Beijing Key Laboratory of Intelligent Information Technology School of Computer Science & Technology Beijing Institute of Technology State Key Laboratory of General Artificial Intelligence BIGAI and State Key Laboratory of General Artificial Intelligence Peking University and Department of Automation Tsinghua University

ISBN: (纸本)9798331314385

Vision language models (VLMs) have achieved impressive progress in diverse applications, becoming a prevalent research direction. In this paper, we build FIRE, a feedback-refinement dataset, consisting of 1.1M multi-turn conversations that are derived from 27 source datasets, empowering VLMs to spontaneously refine their responses based on user feedback across diverse tasks. To scale up the data collection, FIRE is collected in two components: FIRE-100K and FIRE-1M, where FIRE-100K is generated by GPT-4V, and FIRE-1M is freely generated via models trained on FIRE-100K. Then, we build FIRE-Bench, a benchmark to comprehensively evaluate the feedback-refining capability of VLMs, which contains 11K feedback-refinement conversations as the test data, two evaluation settings, and a model to provide feedback for VLMs. We develop the FIRE-LLaVA model by fine-tuning LLaVA on FIRE-100K and FIRE-1M, which shows remarkable feedback-refining capability on FIRE-Bench and outperforms untrained VLMs by 50%, making more efficient user-agent interactions and underscoring the significance of the FIRE dataset.

关键词：