In the letter, lossy distributed source coding using graphs is considered. This corresponds to the sourcecoding part of the graph-based frame [1] for transmission of analog correlated sources over the multiple-access...
详细信息
In the letter, lossy distributed source coding using graphs is considered. This corresponds to the sourcecoding part of the graph-based frame [1] for transmission of analog correlated sources over the multiple-access channel (MAC). Consequently, it is shown that a pair of analog correlated sources can be reliably represented into a bipartite graph by allowing certain amount of distortion. An achievable rate-distortion region for this problem is also provided. Therefore, it can be concluded that, for transmission of any (both discrete and continuous) set of correlated sources over MACs, graphs can be used as discrete interface between sourcecoding and the channel coding modules.
In this letter, functional duality between distributed source coding with One Distortion Criterion (DSC-ODC) and correlated messages and Semi-Deterministic Broadcast Channel coding (SD-BCC) with correlated messages is...
详细信息
In this letter, functional duality between distributed source coding with One Distortion Criterion (DSC-ODC) and correlated messages and Semi-Deterministic Broadcast Channel coding (SD-BCC) with correlated messages is considered. It is shown that under certain conditions, for a given DSC-ODC problem with correlated messages, a functional dual SD-BCC problem with correlated messages can be obtained, and vice versa. In particular, the correlation structure of the messages in the two dual problems are the same. The source distortion measure and the channel cost measure for this duality are also specified.
In this paper, we propose a rate-adaptive distributed source coding (DSC) scheme for two correlated sources using polar codes. We change the rule of selecting new frozen bits when the decoder requests more information...
详细信息
In this paper, we propose a rate-adaptive distributed source coding (DSC) scheme for two correlated sources using polar codes. We change the rule of selecting new frozen bits when the decoder requests more information. In our scheme, new frozen bits are chosen according to successive cancellation (SC) decoding instead of Bhattacharyya parameter. On receipt of a new frozen bit, SC decoding will continue from the new bit rather than restart from the first one. The novel scheme eliminates the recalculation of the previously decoded bits while reaching a competitive compression rates compared with alternatives. Furthermore, we derive a method for computing the average compression rates of the schemes in this paper, which match with the simulation results properly. Analysis shows that our novel scheme can reduce the decoding complexity significantly.
In this paper, we propose a lattice-based robust distributed source coding system for two correlated sources and provide a detailed performance analysis under the high resolution assumption. It is shown, among other t...
详细信息
In this paper, we propose a lattice-based robust distributed source coding system for two correlated sources and provide a detailed performance analysis under the high resolution assumption. It is shown, among other things, that, in the asymptotic regime where: 1) the side distortion approaches 0 and 2) the ratio between the central and side distortions approaches 0, our scheme is capable of achieving the information-theoretic limit of quadratic multiple description coding when the two sources are identical, whereas a variant of the random coding scheme by Chen and Berger with Gaussian codes has a performance loss of 0.5 bits relative to this limit.
Consider a pair of correlated Gaussian sources (X-1, X-2). Two separate encoders observe the two components and communicate compressed versions of their observations to a common decoder. The decoder is interested in r...
详细信息
Consider a pair of correlated Gaussian sources (X-1, X-2). Two separate encoders observe the two components and communicate compressed versions of their observations to a common decoder. The decoder is interested in reconstructing a linear combination of X-1 and X-2 to within a mean-square distortion of D. We obtain an inner bound to the optimal rate-distortion region for this problem. A portion of this inner bound is achieved by a scheme that reconstructs the linear function directly rather than reconstructing the individual components X-1 and X-2 first. This results in a better rate region for certain parameter values. Our coding scheme relies on lattice coding techniques in contrast to more prevalent random coding arguments used to demonstrate achievable rate regions in information theory. We then consider the case of linear reconstruction of K sources and provide an inner bound to the optimal rate-distortion region. Some parts of the inner bound are achieved using the following coding structure: lattice vector quantization followed by "correlated" lattice-structured binning.
In this paper, we propose a practical scheme for lossy distributed source coding with side information available at the decoder. Our proposed scheme is based on sending parity bits using LDPC codes. We provide the des...
详细信息
In this paper, we propose a practical scheme for lossy distributed source coding with side information available at the decoder. Our proposed scheme is based on sending parity bits using LDPC codes. We provide the design procedure for the LDPC code that guarantees performance close to the Wyner-Ziv limit for long LDPC codes. Using simulation results, we show that the proposed method performs close to the theoretical limit for even short length codes.
Specific to the lower power efficiency of node in wireless sensor network (WSN), a residual value coding algorithm is raise for clustering WSNs, which is based on distributedsource encoding system. Theoretical analys...
详细信息
Specific to the lower power efficiency of node in wireless sensor network (WSN), a residual value coding algorithm is raise for clustering WSNs, which is based on distributedsource encoding system. Theoretical analysis and experimental result indicate if this algorithm could be adopted in clustering WSN, then it would reduce the transferred data of node effectively. Thus, the power consumption of network would go down drastically.
This letter develops codes for the scenario in which users with correlated messages are to encipher and compress their mess' ages without collaboration and without the use of cryptographic keys or other secret mat...
详细信息
This letter develops codes for the scenario in which users with correlated messages are to encipher and compress their mess' ages without collaboration and without the use of cryptographic keys or other secret materials. We consider an eavesdropper that has access to an encoded message and in addition, some side-information in the form of uncoded symbols corresponding to the encoded message. Our codes are an extension of distributed source coding using syndromes (DISCUS) with the additional requirement of providing secrecy for the scenario described above. We state a secrecy condition that the subcodes of DISCUS must satisfy, and develop a general encoding algorithm meeting these conditions. We analyze the performance of the proposed code for the case of multiple eavesdropped messages.
A major bottleneck in distributed learning is the communication overhead of exchanging intermediate model update parameters between the worker nodes and the parameter server. Recently, it is found that local gradients...
详细信息
A major bottleneck in distributed learning is the communication overhead of exchanging intermediate model update parameters between the worker nodes and the parameter server. Recently, it is found that local gradients among different worker nodes are correlated. Therefore, distributed source coding (DSC) can be applied to increase communication efficiency by exploiting such correlation. However, it is highly non-trivial to exploite the gradient correlations in distributed learning due to the unknown and time-varying gradient correlation. In this paper, we first propose a DSC framework, named successive Wyner-Ziv coding, for distributed learning based on quantization and Slepian-Wolf (SW) coding. We prove that the proposed framework can achieve the theoretically minimum communication cost from an information theory perspective. We also propose a low-complexity and adaptive DSC for distributed learning, including a gradient statistics estimator, rate controller, and a log-likelihood ratio (LLR) computer. The gradient statistics estimator estimates the gradient statistics online based only on the quantized gradients at previous iterations, hence it does not introduce extra communication cost. The computation complexity of the rate controller and the LLR computer is reduced to a linear growth in the number of worker nodes by introducing a semi-analytical Monte Carlo simulation. Finally, we design a DSC-based distributed learning process and find that the extra delay introduced by DSC does not scale with the number of worker nodes.
We consider the distributed source coding (DSC) problem concerning the task of encoding an input in the absence of correlated side information that is only available to the decoder. Remarkably, Slepian and Wolf showed...
详细信息
We consider the distributed source coding (DSC) problem concerning the task of encoding an input in the absence of correlated side information that is only available to the decoder. Remarkably, Slepian and Wolf showed in 1973 that an encoder without access to the side information can asymptotically achieve the same compression rate as when the side information is available to it. This seminal result was later extended to lossy compression of distributedsources by Wyner, Ziv, Berger, and Tung. While there is vast prior work on this topic, practical DSC has been limited to synthetic datasets and specific correlation structures. Here we present a framework for lossy DSC that is agnostic to the correlation structure and can scale to high dimensions. Rather than relying on hand-crafted source modeling, our method utilizes a conditional Vector-Quantized Variational auto-encoder (VQ-VAE) to learn the distributed encoder and decoder. We evaluate our method on multiple datasets and show that our method can handle complex correlations and achieves state-of-the-art PSNR.
暂无评论