In the era of big data, traditional data clustering algorithms have gradually failed to meet the application requirements, and the optimization of datacompression and parallelization methods has become a research hot...
详细信息
Ensemble methods combining several models have shown superior predictive performance in data streams forecasting compared to individual models. Besides, they can cope with evolving data streams and concept drift as th...
详细信息
ISBN:
(数字)9781728186719
ISBN:
(纸本)9781728186719
Ensemble methods combining several models have shown superior predictive performance in data streams forecasting compared to individual models. Besides, they can cope with evolving data streams and concept drift as they allow adaptation. However, ensembles are renowned for their complexity and computational costs which makes them unsuitable in cases where both resources and time are limited such as IoT applications. In this paper, we propose to use model compression in the streaming setting in order to overcome the aforementioned drawbacks. We show that compressing a highly performing dynamic ensemble into an individual model leads to better predictive performance when compared to an individual learner while significantly reducing computational costs. We conduct an extensive experimental study on both real and synthetic time series to measure the impact of compression on both predictive performance and computational cost.
Recently, federated learning (FL) has gained momentum because of its capability in preserving data privacy. To conduct model training by FL, multiple clients exchange model updates with a parameter server via Internet...
详细信息
ISBN:
(纸本)9798350383515;9798350383508
Recently, federated learning (FL) has gained momentum because of its capability in preserving data privacy. To conduct model training by FL, multiple clients exchange model updates with a parameter server via Internet. To accelerate the communication speed, it has been explored to deploy a programmable switch (PS) in lieu of the parameter server to coordinate clients. The challenge to deploy the PS in FL lies in its scarce memory space, prohibiting running memory consuming aggregation algorithms on the PS. To overcome this challenge, we propose Federated Learning in-network Aggregation with compression (FediAC) algorithm, consisting of two phases: client voting and model aggregating. In the former phase, clients report their significant model update indices to the PS to estimate global significant model updates. In the latter phase, clients upload global significant model updates to the PS for aggregation. FediAC consumes much less memory space and communication traffic than existing works because the first phase can guarantee consensus compression across clients. The PS easily aligns model update indices to swiftly complete aggregation in the second phase. Finally, we conduct extensive experiments by using public datasets to demonstrate that FediAC remarkably surpasses the state-of-the-art baselines in terms of model accuracy and communication traffic.
Recent advances in deep learning have led to superhuman performance across a variety of applications. Recently, these methods have been successfully employed to improve the rate-distortion performance in the task of i...
详细信息
ISBN:
(纸本)9781665478939
Recent advances in deep learning have led to superhuman performance across a variety of applications. Recently, these methods have been successfully employed to improve the rate-distortion performance in the task of image compression. However, current methods either use additional post-processing blocks on the decoder end to improve compression or propose an end-to-end compression scheme based on heuris-tics. For the majority of these, the trained deep neural networks (DNNs) are not compatible with standard encoders and would be difficult to deploy on personal com-puters and cellphones. In light of this, we propose a system that learns to improve the encoding performance by enhancing its internal neural representations on both the encoder and decoder ends, an approach we call Neural JPEG. We propose frequency domain pre-editing and post-editing methods to optimize the distribution of the DCT coefficients at both encoder and decoder ends in order to improve the stan-dard compression (JPEG) method. Moreover, we design and integrate a scheme for jointly learning quantization tables within this hybrid neural compression framework. In summary, our contributions are as follows:
The proceedings contain 379 papers. The topics discussed include: a transformer based network in monocular satellite pose estimation;controller dynamic linearization based data-driven adaptive control for a vapor-comp...
ISBN:
(纸本)9798350361674
The proceedings contain 379 papers. The topics discussed include: a transformer based network in monocular satellite pose estimation;controller dynamic linearization based data-driven adaptive control for a vapor-compression refrigeration system;cooperative awareness message generation interval prediction model based on Bayesian optimized long short-term memory neural network;preassigned time prescribed performance tracking control for high-order nonlinear systems with time-varying powers;gaussian reinforcement learning: optimal tracking control for uncertain linear systems;a velocity tracking method for quadruped robot with rhythm controller;model-free predictive control of hydraulic cylinder based on parameter prediction of extreme learning machine;and semi-supervised domain adaptation with feature separation for wind turbine anomaly detection.
The ease of exchanging information can be misused by irresponsible parties to commit various cybercrimes such as data tapping. Therefore, this study was conducted with the aim of creating an Android-based application ...
详细信息
Determining the early-age compression strength of concrete is an integral part of many construction projects. This paper investigates the feasibility of a method to monitor temperatures related to concrete curing usin...
详细信息
With recent advancements in computational technology, technologies like artificial intelligence, and machine learning are gaining popularity among researchers and developers to realize various applications like image ...
详细信息
Conventional video coding methods have been developed based on the human visual system (HVS). However, in recent years, video has occupied a huge portion of internet traffic, and the mount of video data for machine co...
详细信息
ISBN:
(纸本)9781728198354
Conventional video coding methods have been developed based on the human visual system (HVS). However, in recent years, video has occupied a huge portion of internet traffic, and the mount of video data for machine consumption has increased rapidly due to the progress of neural networks. This paper proposes a novel machine-attention-based video coding method for machines. Inspired by the saliency-driven research, we first extract attention regions, sensitively affecting the machine vision performance, from the object detection network. Subsequently, a maximum a posterior (MAP)-based bit allocation method is applied to assign more bits to the attention regions. Our proposed method helps to maintain high machine vision performance whereas reducing the bitrate. Experimental results show that our proposed method achieves up to 34.89% bjontegaard delta (BD)-rate reduction for the video dataset and up to 44.70% BD-rate reduction for the image dataset compared to state-of-the-art video coding technology.
Regression models are employed in lossless compression of time series data, by storing the residual of each point, known as regression encoding. Owing to value fluctuation, the regression residuals could be large and ...
详细信息
暂无评论