An adaptive predictive coding method, which efficiently encodes newspaper pages with printed text and screened photographs is presented. This coding technique utilizes two kinds of predictors with different reference ...
详细信息
An adaptive predictive coding method, which efficiently encodes newspaper pages with printed text and screened photographs is presented. This coding technique utilizes two kinds of predictors with different reference picture elements (pels). One is applied to printed text and the other is applied to screened photographs. The Dth previous pel and its neighboring pels age adopted as the reference pels for the photograph predictor, where distance D coincides with the screen period. Comparing the adaptive predictive coding with a typical document facsimile coding, the data compression ratio is improved by about two times for a screened photograph (compression ratio is 5 ∼ 6) and is almost the same or slightly higher for printed text. Computer simulation shows that if a 500-kbits buffer memory is employed, it is possible to transmit most pages, including an extreme case of a 100 percent photograph page, with a 4500-rev/min scanner at a transmission bit rate of 128 kbit/s. For average pages the revolution speed can be raised to 6000 rev/min. Page transmission time of about 5 min in analog facsimile through a 48-kHz band can be reduced to 1.8 min by adopting the digital transmission with a 128-kbit/s data modem and the adaptive predictive coding technique, when the facsimile revolution speed is set at 6000 rev/min.
作者:
Ahmadi, AhmadrezaTani, JunKorea Adv Inst Sci & Technol
Cognit Neurorobot Lab Dept Elect Engn N1 Bldg291 Daehak Ro373-1 Guseong Dong Daejeon 305701 South Korea Grad Univ
Okinawa Inst Sci & Technol Cognit Neurorobot Res Unit 1919-1 Tancha Onnason Okinawa 9040495 Japan
The current paper examines how a recurrent neural network (RNN) model using a dynamic predictive coding scheme can cope with fluctuations in temporal patterns through generalization in learning. The conjecture driving...
详细信息
The current paper examines how a recurrent neural network (RNN) model using a dynamic predictive coding scheme can cope with fluctuations in temporal patterns through generalization in learning. The conjecture driving this present inquiry is that a RNN model with multiple timescales (MTRNN) learns by extracting patterns of change from observed temporal patterns, developing an internal dynamic structure such that variance in initial internal states account for modulations in corresponding observed patterns. We trained a MTRNN with low-dimensional temporal patterns, and assessed performance on an imitation task employing these patterns. Analysis reveals that imitating fluctuated patterns consists in inferring optimal internal states by error regression. The model was then tested through humanoid robotic experiments requiring imitative interaction with human subjects. Results show that spontaneous and lively interaction can be achieved as the model successfully copes with fluctuations naturally occurring in human movement patterns. (C) 2017 Elsevier Ltd. All rights reserved.
predictive coding is a promising theoretical framework in neuroscience for understanding information transmission and *** posits that the brain perceives the external world through internal models and updates these mo...
详细信息
predictive coding is a promising theoretical framework in neuroscience for understanding information transmission and *** posits that the brain perceives the external world through internal models and updates these models under the guidance of prediction *** studies on predictive coding emphasized top-down feedback interactions in hierarchical multilayered networks but largely ignored lateral recurrent *** perform analytical and numerical investigations in this work on the effects of single-layer lateral *** consider a simple predictive response dynamics and run it on the MNIST dataset of hand-written *** find that learning will generally break the interaction symmetry between peer neurons,and that high input correlation between two neurons does not necessarily bring strong direct interactions between *** optimized network responds to familiar input signals much faster than to novel or random inputs,and it significantly reduces the correlations between the output states of pairs of neurons.
Linear predictive techniques perform poorly when used with color-mapped images where pixel values represent indices that point to color values in a look-up table, Reordering the color table, however, can lead to a low...
详细信息
Linear predictive techniques perform poorly when used with color-mapped images where pixel values represent indices that point to color values in a look-up table, Reordering the color table, however, can lead to a lower entropy of prediction errors, In this paper, we investigate the problem of ordering the color table such that the absolute sum of prediction errors is minimized, The problem turns out to be intractable, even for the simple case of one-dimensional (1-D) prediction schemes, We give two heuristic solutions for the problem and use them for ordering the color table prior to encoding the image by lossless predictive techniques. We demonstrate that significant improvements in actual bit rates can be achieved over dictionary-based coding schemes that are commonly employed for color-mapped images.
The standard cortical model assumes that the meaning of a neuron's signal is contained in its firing rate. While that model has been used to interpret a voluminous amount of experimental data, it does not address ...
详细信息
The standard cortical model assumes that the meaning of a neuron's signal is contained in its firing rate. While that model has been used to interpret a voluminous amount of experimental data, it does not address the question of timing, or how recipient neurons can decode this signal in time to predict behavioral results. We propose a model based on coincident firing of large groups of neurons. We show using an example of predictive coding, how the cortex can support vast amounts of non-interfering parallel computation. (C) 2000 Published by Elsevier Science B.V. All rights reserved.
Current models of cortical computation are based on analog quantities instead of single spikes. This paper extends the predictive coding model (Nature Neurosci. 2(1) (1999) 79) to the level of neural signaling. Neuron...
详细信息
Current models of cortical computation are based on analog quantities instead of single spikes. This paper extends the predictive coding model (Nature Neurosci. 2(1) (1999) 79) to the level of neural signaling. Neurons in our model use a mixed strategy to transmit information. Spikes are not only messages of computation, but also carriers of information with analog quantities encoded in their phases. Computation is shared among cells both in time and in space, such that information is signaled probabilistically in a distributed synchronous fashion. Contrary to "noise other than signal" interpretation of irregularity of neural signaling, our model proposes a computational role of such variability. (C) 2004 Published by Elsevier B.V.
Data acquired over long periods of time like High Definition (HD) videos or records from a sensor over long time intervals, have to be efficiently compressed, to reduce their size. The compression has also to allow ef...
详细信息
Data acquired over long periods of time like High Definition (HD) videos or records from a sensor over long time intervals, have to be efficiently compressed, to reduce their size. The compression has also to allow efficient access to random parts of the data upon request from the users. Efficient compression is usually achieved with prediction between data points at successive time instants. However, this creates dependencies between the compressed representations, which is contrary to the idea of random access. Prediction methods rely in particular on reference data points, used to predict other data points. The placement of these references balances compression efficiency and random access. Existing solutions to position the references use ad hoc methods. In this paper, we study this joint problem of compression efficiency and random access. We introduce the storage cost as a measure of the compression efficiency and the transmission cost for the random access ability. We express the reference placement problem that trades storage with transmission cost as an integer linear programming problem. Considering additional assumptions on the sources and coding methods reduces the complexity of the search space of the optimization problem. Moreover, we show that the classical periodic placement of the references is optimal, when the encoding costs of each data point are equal and when requests of successive data points are made. In this particular case, a closed-form expression of the optimal period is derived. Finally, the proposed optimal placement strategy is compared with an ad hoc method, where the references correspond to sources where the prediction does not help reducing significantly the encoding cost. The proposed optimal algorithm shows a bit saving of -20% with respect to the ad hoc method.
Wireless sensor networks (WSNs) generate a variety of continuous data streams. To reduce data storage and transmission cost, compression is recommended to be applied to the data streams from every single sensor node. ...
详细信息
Wireless sensor networks (WSNs) generate a variety of continuous data streams. To reduce data storage and transmission cost, compression is recommended to be applied to the data streams from every single sensor node. Local compression falls into two categories: lossless and lossy. Lossy compression techniques are generally preferable for sensors in commercial nodes than the lossless ones as they provide a better compression ratio at a lower computational cost. However, the traditional approaches for data compression in WSNs are sensitive to sensor accuracy. They are less efficient when there are abnormal and faulty measurements or missing data. This paper proposes a new lossy compression approach using the Bayesian predictive coding (BPC). Instead of the original signals, predictive coding transmits the error terms which are calculated by subtracting the predicted signals from the actual signals to the receiving node. Its compression performance depends on the accuracy of the adopted prediction technique. BPC combines the Bayesian inference with the predictive coding. Prediction is made by the Bayesian inference instead of regression models as in traditional predictive coding. In this way, it can utilize prior information and provide inferences that are conditional on the data without reliance on asymptotic approximation. Experimental tests show that the BPC is the same efficient as the linear predictive coding when handling independent signals which follow a stationary probability distribution. More than that, the BPC is more robust toward occasionally erroneous or missing sensor data. The proposed approach is based on the physical knowledge of the phenomenon in applications. It can be considered as a complementary approach to the existing lossy compression family for WSNs.
As large-scale time-series data can easily be found in real-world applications, multivariate time-series anomaly detection has played an essential role in diverse industries. It enables productivity improvement and ma...
详细信息
As large-scale time-series data can easily be found in real-world applications, multivariate time-series anomaly detection has played an essential role in diverse industries. It enables productivity improvement and maintenance cost reduction by preventing malfunctions and detecting anomalies based on time-series data. However, multivariate time-series anomaly detection is challenging because real-world time-series data exhibit complex temporal dependencies. For this task, it is crucial to learn a rich representation that effectively contains the nonlinear temporal dynamics of normal behavior. In this study, we propose an unsupervised multivariate time-series anomaly detection model named RAE-MEPC which learns informative normal representations based on multi-resolution ensemble reconstruction and predictive coding. We introduce multi-resolution ensemble encoding to capture the multi-scale dependency from the input time series. The encoder hierarchically aggregates the multi-scale temporal features extracted from the sub-encoders with different encoding lengths. From these encoded features, the reconstruction decoder reconstructs the input time series based on multi-resolution ensemble decoding where lower-resolution information helps to decode sub-decoders with higher-resolution outputs. predictive coding is further introduced to encourage the model to learn more temporal dependencies of the time series. Experiments on real-world benchmark datasets show that the proposed model outperforms the benchmark models for multivariate time-series anomaly detection.
In this paper, we propose an adaptive predictive coding method based on image segmentation for lossless compression. MAR (Multiplicative Autoregressive) predictive coding is an efficient lossless compression scheme. P...
详细信息
In this paper, we propose an adaptive predictive coding method based on image segmentation for lossless compression. MAR (Multiplicative Autoregressive) predictive coding is an efficient lossless compression scheme. Predictors of the MAR model can be adapted to changes in the local image statistics due to its local image processing. However, the performance of the MAR method is reduced when applied to images whose local statistics change within the block-by-block subdivided image. Furthermore, side-information such as prediction coefficients must be transmitted to the decoder with each block. In order to enhance the compression performance, we improve the MAR coding method by using image segmentation. The proposed MAR predictor can be adapted to the local statistics of the image efficiently at each pixel. Furthermore, less side-information need be transmitted compared with the conventional MAR method.
暂无评论