检索结果-内蒙古大学图书馆

fast and efficient compression of floating-point data

IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2006年第5期12卷 1245-1250页

作者： Lindstrom, Peter Isenburg, Martin Lawrence Livermore Natl Lab Livermore CA 94551 USA Univ Calif Berkeley Berkeley CA 94720 USA

Large scale scientific simulation codes typically run on a cluster of CPUs that write/read time steps to/from a single file system. As data sets are constantly growing in size, this increasingly leads to I/O bottlenecks. When the rate at which data is produced exceeds the available I/O bandwidth, the simulation stalls and the CPUs are idle. Data compression can alleviate this problem by using some CPU cycles to reduce the amount of data needed to be transfered. Most compression schemes, however, are designed to operate offline and seek to maximize compression, not throughput. Furthermore, they often require quantizing floating-point values onto a uniform integer grid, which disqualifies their use in applications where exact values must be retained. We propose a simple scheme for lossless, online compression of floating-point data that transparently integrates into the I/O of many applications. A plug-in scheme for data-dependent prediction makes our scheme applicable to a wide variety of data used in visualization, such as unstructured meshes, point sets, images, and voxel grids. We achieve state-of-the-art compression rates and speeds, the latter in part due to an improved entropy coder. We demonstrate that this significantly accelerates I/O throughput in real simulation runs. Unlike previous schemes, our method also adapts well to variable-precision floating-point and integer data.

关键词： high throughput lossless compression file compaction for I/O efficiency fast entropy coding range coder predictive coding large scale simulation and visualization

来源：评论

学校读者我要写书评

暂无评论

fast and efficient compression of floating-point data

Fast and efficient compression of floating-point data

引用

IEEE Visualization Conference (Vis 2006)/IEEE Symposium on Information Visualization (InfoVis 2006)

作者： Lindstrom, Peter Isenburg, Martin Lawrence Livermore Natl Lab Livermore CA 94551 USA Univ Calif Berkeley Berkeley CA 94720 USA

关键词： high throughput lossless compression file compaction for I/O efficiency fast entropy coding range coder predictive coding large scale simulation and visualization

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：