In training image generators, autoencoders (AEs) are used to compress data into latent variables. However, when attempting to reconstruct video images, learning more complex distributions is necessary, and a simple mo...
详细信息
The Big data explosion has necessitated the development of search algorithms that scale sub-linearly in time and memory. While compression algorithms and search algorithms do exist independently, few algorithms offer ...
详细信息
Widespread implementations of high-frequency electronic equipment increase the demand for high-frequency synchronized measurement data. However, high-speed data streaming challenges the quality of communication and da...
详细信息
ISBN:
(纸本)9781665465434
Widespread implementations of high-frequency electronic equipment increase the demand for high-frequency synchronized measurement data. However, high-speed data streaming challenges the quality of communication and data server storage. To address this problem, this paper proposes an online lossless compression of synchro-waveform measurement for smart grid monitoring. The lossless compression will highly reduce the data transmission and storage burden while reserving all the critical information for both online and offline analysis. To this end, the proposed method is designed based on the delta-delta, Simple-8b, and Lempel-Ziv-Markov chain algorithm technologies, where the delta-delta consists of a two-order delta and one periodical delta. Then, the simulation experiments based on various noise levels, time windows, and sampling rates are presented and compared with some state-of-art methods. Moreover, the laboratory experiment is conducted to verify the validity of the synchro-waveform measurement compression method, where 53.1% to 77.3% of data space can be saved under 60dB to 120dB noise scenarios.
compression coding of point clouds using deep learning has been studied. A large reduction of the code volume results in hole-like degradation. We propose new metrics and an optimization method to suppress such visual...
详细信息
The Industrial Internet of Things (IIoT) is increasingly emerging as a novel paradigm for information exchange within industrial production environments. To facilitate the efficient operation of IIoT, there is an urge...
详细信息
ISBN:
(纸本)9798331540845;9789887581598
The Industrial Internet of Things (IIoT) is increasingly emerging as a novel paradigm for information exchange within industrial production environments. To facilitate the efficient operation of IIoT, there is an urgent requirement for communication-efficient methods to transmit extensive production data. This paper proposes a communication-efficient distributed optimization algorithm tailored for the strongly convex and smooth convex optimization problems over a directed graph. To encompass a broader class of compressors, the assumption of compressor is relaxed to contain both relative and absolute errors. To mitigate compression errors, we adopt differential compression technique and dynamic scaling factor in the algorithm. In particular, under this compression assumption, a non-uniform quantizer is introduced to enable finite-bit transmission over communication channels and an upper bound of the required bits with this quantizer is provided. Moreover, we prove the linear convergence of the proposed algorithm with compression, and numerical examples are provided to verify the performance of the proposed algorithm.
In this work we introduce a novel, reversible data summarization technique, namely the Reverse Random Hyperplane Projection (RRHP) scheme. RRHP is particularly useful in Wireless Sensor Network (WSN) settings because ...
详细信息
Recently, point cloud data has attracted increasing attention in various machine vision tasks like classification and detection. However, directly transmitting the raw point cloud for such machine vision tasks will br...
详细信息
ISBN:
(纸本)9781665468916
Recently, point cloud data has attracted increasing attention in various machine vision tasks like classification and detection. However, directly transmitting the raw point cloud for such machine vision tasks will bring a huge bit-rate cost. In this work, we propose a new point cloud compression framework called PCHM-Net for both human vision and machine vision. Our proposed PCHM-Net adopts a two-branch structure with the shared octree-based compression module. To better compress the point cloud data and save bit-rate for machine vision tasks, we use the point cloud selection module to select a sparse set of points before octree construction, which allows us to use deeper octree structure and thus better reconstruct the point cloud coordinates for more discriminative feature extraction. We further propose a global feature aggregation-based classification module to deal with the sparse point cloud classification task. Comprehensive experiments on various point cloud benchmark datasets (e.g., ModelNet, ShapeNet and ScanNet) demonstrate that our newly proposed PCHM-Net achieves promising coding performance for both human vision and machine vision.
It is known that the exact form of the Burrows-Wheeler Transform (BWT) of a string collection depends, in most implementations, on the input order of the strings in the collection. Reordering strings of an input colle...
详细信息
ISBN:
(纸本)9798350347951
It is known that the exact form of the Burrows-Wheeler Transform (BWT) of a string collection depends, in most implementations, on the input order of the strings in the collection. Reordering strings of an input collection affects the number of equal-letter runs r, arguably the most important parameter of BWT-based data structures, such as the FM-index or the r-index. Bentley, Gibney, and Thankachan [ESA 2020] introduced a linear-time algorithm for computing the permutation of the input collection which yields the minimum number of runs of the resulting BWT. In this paper, we present the first tool that guarantees a Burrows-Wheeler Transform with minimum number of runs (optBWT), by combining i) an algorithm that builds the BWT from a string collection (either SAIS-based [Boucher et al., SPIRE 2021] or BCR [Bauer et al., CPM 2011]);ii) the SAP array data structure introduced in [Cox et al., Bioinformatics, 2012];and iii) the algorithm by Bentley et al. We present results both on real-life and simulated data, showing that the improvement achieved in terms of r with respect to the input order is significant and the overhead created by the computation of the optimal BWT negligible, making our tool competitive with other tools for BWT-computation in terms of running time and space usage. In particular, on real data the optBWT obtains up to 31 times fewer runs with only a 1.39x slowdown. Source code is available at https://***/davidecenzato/***.
Recent work has shown a strong theoretical connection between variational autoencoders (VAEs) and the rate distortion theory. Motivated by this, we consider the problem of lossy image compression from the perspective ...
详细信息
ISBN:
(纸本)9781665493468
Recent work has shown a strong theoretical connection between variational autoencoders (VAEs) and the rate distortion theory. Motivated by this, we consider the problem of lossy image compression from the perspective of generative modeling. Starting from ResNet VAEs, which are originally designed for data (image) distribution modeling, we redesign their latent variable model using a quantization-aware posterior and prior, enabling easy quantization and entropy coding for image compression. Along with improved neural network blocks, we present a powerful and efficient class of lossy image coders, outperforming previous methods on natural image (lossy) compression. Our model compresses images in a coarse-to-fine fashion and supports parallel encoding and decoding, leading to fast execution on GPUs. Code is made available online.
In distributed neural network training with multiple machines and devices, communication limitations often create efficiency bottlenecks due to the frequent exchange of model parameters and gradient information betwee...
详细信息
暂无评论