检索结果-内蒙古大学图书馆

Lightweight joint source-channel coding for Semantic Communications

IEEE COMMUNICATIONS LETTERS 2023年第12期27卷 3161-3165页

作者： Jia, Yunjian Huang, Zhen Luo, Kun Wen, Wanli Chongqing Univ Sch Microelect & Commun Engn Chongqing 400044 Peoples R China

Semantic communications, which aim to effectively convey the meaning of messages (such as text and images) rather than transmitting the exact messages themselves, have garnered widespread attention from industry and academia. A suitable joint source-channel coding (JSCC) scheme is crucial for semantic communication systems, as it can significantly improve system performance, such as communication reliability. Current research efforts primarily focus on employing various deep neural network (DNN) models, particularly the Transformer model, to design JSCC schemes. However, existing Transformer-based JSCC schemes usually exhibit a considerable number of model parameters and computational demands, limiting their real-world applicability. To address this challenge, we propose a novel DNN model based on DeLighT, a deep and lightweight variant of the standard Transformer, using a text semantic communication system (TSC) as an example. This proposed model enables a lightweight JSCC scheme for the TSC system. Through simulation results, we demonstrate that the proposed JSCC scheme achieves comparable or better communication reliability than the Transformer-based JSCC scheme while requiring significantly fewer parameters and smaller runtime.

关键词： Semantics Transformers Decoding Receivers Transmitters Reliability Neural networks Semantic communications joint source-channel coding lightweight transformer deep neural network

来源：评论

学校读者我要写书评

暂无评论

Energy-Distortion Tradeoffs in Gaussian joint source-channel coding Problems

引用

IEEE TRANSACTIONS ON INFORMATION THEORY 2012年第5期58卷 3153-3168页

作者： Jain, Aman Guenduez, Deniz Kulkarni, Sanjeev R. Poor, H. Vincent Verdu, Sergio Princeton Univ Dept Elect Engn Princeton NJ 08544 USA Ctr Tecnol Telecomunicac Catalunya E-08860 Barcelona Spain

The information-theoretic notion of energy efficiency is studied in the context of various joint source-channel coding problems. The minimum transmission energy E(D) required to communicate a source over a noisy channel so that it can be reconstructed within a target distortion D is analyzed. Unlike the traditional joint source-channel coding formalisms, no restrictions are imposed on the number of channel uses per source sample. For single-source memoryless point-to-point channels, E(D) is shown to be equal to the product of the minimum energy per bit E-bmin of the channel and the rate-distortion function R(D) of the source, regardless of whether channel output feedback is available at the transmitter. The primary focus is on Gaussian sources and channels affected by additive white Gaussian noise under quadratic distortion criteria, with or without perfect channel output feedback. In particular, for two correlated Gaussian sources communicated over a Gaussian multiple-access channel, inner and outer bounds on the energy-distortion region are obtained, which coincide in special cases. For symmetric channels, the difference between the upper and lower bounds on energy is shown to be at most a constant even when the lower bound goes to infinity as D -> 0. It is also shown that simple uncoded transmission schemes perform better than the separation-based schemes in many different regimes, both with and without feedback.

关键词： Energy efficiency feedback information theory joint source-channel coding multiple-access channel (MAC) separate source and channel coding uncoded transmission

来源：评论

学校读者我要写书评

暂无评论

Second Order Analysis for joint source-channel coding With General channel and Markovian source

引用

IEEE TRANSACTIONS ON INFORMATION THEORY 2019年第9期65卷 5750-5770页

作者： Yaguchi, Ryo Hayashi, Masahito Nagoya Univ Grad Sch Math Nagoya Aichi 464860 Japan NEC Corp Ltd Tokyo 1088001 Japan Southern Univ Sci & Technol Shenzhen Inst Quantum Sci & Engn Shenzhen 518055 Peoples R China Natl Univ Singapore Ctr Quantum Technol Singapore 117542 Singapore

We derive the optimal second-order rates in joint source-channel coding when the channel is a general discrete memoryless channel and the source is an irreducible and ergodic Markov process. In contrast, previous studies solved it only when the channel satisfies a certain unique-variance condition and the source is subject to an independent and identical distribution. We also compare the joint source-channel scheme with the separation scheme in the second-order regime, while a previous study made a notable comparison with numerical calculation. To discuss these two topics, we introduce two kinds of new distribution families, switched Gaussian convolution distribution and *-product distribution, which are defined by modifying the Gaussian distribution.

关键词： Markov chain second order joint source-channel coding separation scheme

来源：评论

学校读者我要写书评

暂无评论

The Ziv-Zakai-Renyi Bound for joint source-channel coding

引用

IEEE TRANSACTIONS ON INFORMATION THEORY 2015年第8期61卷 4293-4315页

作者： Tridenski, Sergey Zamir, Ram Ingber, Amir Tel Aviv Univ Dept Elect Engn Syst IL-69978 Tel Aviv Israel Tel Aviv Univ IL-69978 Tel Aviv Israel Stanford Univ Stanford CA 94305 USA

Shannon's capacity and rate-distortion function, combined with the separation principle, provide tight bounds for the minimum possible distortion in joint source-channel coding. These bounds, however, are usually achievable only in the limit of a large block length. In their 1973 paper, Ziv and Zakai introduced a family of alternative capacity and rate-distortion functions, based on functionals satisfying the data-processing inequality, which potentially give tighter bounds for systems with a small block length. There is a considerable freedom as to how to choose those functionals, and the ways of finding the best possible functionals yielding the best bounds for a given source-channel combination are not specified. We examine recently conjectured high SNR asymptotic expressions for the Ziv-Zakai bounds, based on the Renyi-divergence functional. We derive nonasymptotic bounds on the Ziv-Zakai-Renyi rate-distortion function and capacity for a broad class of sources and additive noise channels, which hold for arbitrary SNR and prove the conjectured asymptotic expressions in the limit of a small distortion/high SNR. The results lead to new bounds on the best achievable distortion in finite dimensional joint source-channel coding. Examples are presented where the new bounds achieve significant improvement upon Shannon's original bounds.

关键词： joint source-channel coding finite blocklength Ziv-Zakai bounds Renyi divergence

来源：评论

学校读者我要写书评

暂无评论

Novel joint source-channel coding for Wireless Transmission of Radiography Images

Novel Joint Source-Channel Coding for Wireless Transmission ...

引用

32nd Annual International Conference of the IEEE Engineering-in-Medicine-and-Biology-Society (EMBC 10)

作者： Watanabe, Katsuhiro Takizawa, Kenichi Ikegami, Tetsushi Meiji Univ Sch Sci & Technol Kanagawa 2148571 Japan Natl Inst Informat & Commun Technol Kanagawa 2340847 Japan

ISBN: (纸本)9781424441242

A wireless technology is required to realize robust transmission of medical images like a radiography image over noisy environment. The use of error correction technique is essential for realizing such a reliable communication, in which a suitable channel coding is introduced to correct erroneous bits caused by passing through a noisy channel. However, the use of a channel code decreases its efficiency because redundancy bits are also transmitted with information bits. This paper presents a joint source-channel coding which maintains the channel efficiency during transmission of medical images like a radiography image. As medical images under the test, we use typical radiography images in this paper. The joint coding technique enjoys correlations between pixels of the radiography image. The results show that the proposed joint coding provides capability to correcting erroneous bits without increasing the redundancy of the codeword.

关键词： channel efficiency combined source-channel coding correcting erroneous bits diagnostic radiography error correction error correction technique image coding joint source-channel coding medical image processing noisy channel radiography images wireless transmission

来源：评论

学校读者我要写书评

暂无评论

Deep joint source-channel coding for Wireless Image Transmission

引用

IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING 2019年第3期5卷 567-579页

作者： Bourtsoulatze, Eirina Kurka, David Burth Gunduz, Deniz UCL Dept Elect & Elect Engn Commun & Informat Syst Grp London WC1E 7JE England Imperial Coll London Dept Elect & Elect Engn Informat Proc & Commun Lab London SW7 2BT England

We propose a joint source and channel coding (JSCC) technique for wireless image transmission that does not rely on explicit codes for either compression or error correction;instead, it directly maps the image pixel values to the complex-valued channel input symbols. We parameterize the encoder and decoder functions by two convolutional neural networks (CNNs), which are trained jointly, and can be considered as an autoencoder with a non-trainable layer in the middle that represents the noisy communication channel. Our results show that the proposed deep JSCC scheme outperforms digital transmission concatenating JPEG or JPEG2000 compression with a capacity achieving channel code at low signal-to-noise ratio (SNR) and channel bandwidth values in the presence of additive white Gaussian noise (AWGN). More strikingly, deep JSCC does not suffer from the "cliff effect," and it provides a graceful performance degradation as the channel SNR varies with respect to the SNR value assumed during training. In the case of a slow Rayleigh fading channel, deep JSCC learns noise resilient coded representations and significantly outperforms separation-based digital communication at all SNR and channel bandwidth values.

关键词： joint source-channel coding deep neural networks image communications

来源：评论

学校读者我要写书评

暂无评论

The Reliability Function of Variable-Length Lossy joint source-channel coding With Feedback

引用

IEEE TRANSACTIONS ON INFORMATION THEORY 2019年第8期65卷 5028-5042页

作者： Truong, Lan V. Tan, Vincent Y. F. NUS Sch Comp Dept Comp Sci Singapore 119077 Singapore NUS Dept Math Dept Elect & Comp Engn Singapore 119077 Singapore

We consider transmission of discrete memoryless sources (DMSes) across discrete memoryless channels (DMCs) using variable-length lossy source-channel codes with feedback. The reliability function (optimum error exponent) is shown to be equal to max{0, B(1 - R(D)/C)},, where R(D) is the rate-distortion function of the source, B is the maximum relative entropy between output distributions of the DMC, and C is the Shannon capacity of the channel. We show that in this asymptotic regime, separate source-channel coding is, in fact, optimal.

关键词： Variable-length codes joint source-channel coding feedback reliability function

来源：评论

学校读者我要写书评

暂无评论

Second Order Analysis for joint source-channel coding with Markovian source

Second Order Analysis for Joint Source-Channel Coding with M...

引用

IEEE International Symposium on Information Theory (ISIT)

作者： Yaguchi, Ryo Hayashi, Masahito Nagoya Univ Grad Sch Math Nagoya Aichi Japan Natl Univ Singapore Ctr Quantum Technol Singapore Singapore

ISBN: (纸本)9781509040964

We derive the second order rates of joint source-channel coding, whose source obeys an irreducible and ergodic Markov process by introducing new distribution family, switched Gaussian convolution distribution, when the channel is a discrete memoryless. We also compare the joint source-channel scheme with the separation scheme in the second order regime.

关键词： Markov chain second order joint source-channel coding separation scheme

来源：评论

学校读者我要写书评

暂无评论

Distributed joint source-channel coding for Functions over a Multiple Access channel

Distributed Joint Source-Channel Coding for Functions over a...

引用

IEEE Global Telecommunications Conference (GLOBECOM 09)

作者： Rajesh, R. Sharma, Vinod Indian Inst Sci Dept Elect Commun Engg Bangalore 560012 Karnataka India

ISBN: (纸本)9781424441471

In this paper we provide sufficient conditions for lossy transmission of functions of correlated data over a multiple access channel (MAC). The conditions obtained can be shown as generalized version of Yamamoto's result [28]. We also obtain efficient joint source-channel coding schemes for transmission of discrete and continuous alphabet sources to recover the function values.

关键词： joint source-channel coding Graph coloring Lipschitz functions Correlated sources

来源：评论

学校读者我要写书评

暂无评论

Spatially Coupled LDPC Codes Based joint source-channel coding 5th

Spatially Coupled LDPC Codes Based Joint Source-Channel Codi...

引用

5th International Conference on Wireless Communications and Applications (ICWCA)

作者： Lian Qiufang Lin, Zhou Chen Qiwang Chen, Chen Xi, Wang Natl Huaqiao Univ Coll Informat Sci & Engn Xiamen Key Lab Mobile Multimedia Commun Xiamen 361021 Fujian Peoples R China China Mobile Commun Grp Fujian Co Ltd Fuzhou 350003 Fujian Peoples R China

ISBN: (纸本)9789811922558;9789811922541

source coding and channel coding are the hot research parts in information theory. The source channel separation system cannot take full advantage of the correlation between source and channel. The performance of the joint source-channel coding (JSCC) system can be improved by using the redundant information of the source and this system is more suitable for future continuous error-free communication needs. In recent years, many applications require error-free transmission with low latency. Due to the special structure of parity check matrices (PCM), spatially coupled low-density parity-check (SC-LDPC) codes can adopt the sliding window decoding (SWD) algorithm to have the characteristics of low delay and ensure continuous error-free transmission in streaming media applications. Simulation results show that both spreading factor and window size affect decoding performance. This paper reviews the design of the sliding-window decoding algorithm in additive white Gaussian noise (AWGN) channel based on SC-LDPC codes and prospects future work.

关键词： joint source-channel coding Sliding window decoding Spatially coupled low-density parity-check codes

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：