检索结果-内蒙古大学图书馆

International Standard Conference on Trustworthy Computing and Services (ISCTCS)

作者： Huang, Hongjie Yang, Shuqiang Natl Univ Def Technol Sch Comp Sci Changsha 410073 Hunan Peoples R China

ISBN: (纸本)9783662474013;9783662474006

After analyzing evaluation methods of the data storage system reliability, we found there is not a set of generally accepted evaluation criteria for distributed storage system reliability. Based on reliability theory and probability method, a model is provided in this paper to evaluate the reliability of a given distributed system. This model evaluates the data reliability of the system by calculating successfully reading data probability and successfully writing data probability of the system. And then it provide a set of acceptable evaluation criteria for distributed storage system reliability.

关键词： distributed storage system Data reliability Successfully accessing data probability

来源：评论

学校读者我要写书评

暂无评论

Hybrid Redundancy Fault Tolerant Codec in distributed storage system

Hybrid Redundancy Fault Tolerant Codec in Distributed Storag...

引用

International Conference on Industrial Informatics - Computing Technology, Intelligent Technology, Industrial Information Integration

作者： Sun, Qiao Nie, Ling Sun, Lei Fu, Lan-Mei Sun, Jiasong Beijing GuoDianTong Network Technol Co Ltd Beijing Peoples R China Tsinghua Univ EE Dept Beijing 100084 Peoples R China

ISBN: (纸本)9781467383127

Reed-Solomon erasure codes is the most widely used multi-binary codes which could correct the random errors and unexpected errors. Its characteristics include: It has the strongest capability to correct random errors and burst errors under the same coding redundancy and larger coding gain under the same coding efficiency;Secondly, it is close to the limit in the case of short codes and medium codes and it can greatly improve the performance of the error correction when it is combined with the data interleaving technology;Finally, it has strict algebraic structure which is shown as the linear cyclic polynomials. This paper develops a new merge approach of nonlinear self-repairing code and Reed-Solomon codes. When the network condition is good, Reed-Solomon erasure codes is adopted;and in poor network conditions, nonlinear self-repairing codes is used. The efficiency of maintaining redundant data is improved by a few of damaged information. The experiments show that this method can reduce the amount of network transmission data, at the same time it can shorten the amount data of recovery operation and reconstruction time.

关键词： distributed storage system Erasure Codes Nonlinear Self-repairing code Reed-Solomon Code Network Bandwidth

来源：评论

学校读者我要写书评

暂无评论

Adaptive Parameter Tuning for Constructing storage Tiers in an Autonomous distributed storage system

引用

INTERNATIONAL JOURNAL OF NETWORKED AND distributed COMPUTING 2022年第1-2期10卷 1-10页

作者： Nunome, Atsushi Hirata, Hiroaki Kyoto Inst Technol Fac Informat & Human Sci Matsugasaki Sakyo Ku Kyoto 6068585 Japan

We are developing an autonomous distributed storage system to make effective use of networked heterogeneous storage devices. It dynamically configures the storage tiers using effective performance values measured during operation, rather than static performance indicators of the storage device. Data blocks are transferred to a more appropriate storage tier according to their read/write tendencies. In the previous paper, the storage tiers were set using statically defined thresholds, but in this paper, we propose a method to set the thresholds adaptively. This method eliminates the need to adjust the runtime parameters for threshold setting according to the runtime environment. It has also been improved so that appropriate parameter values can be set for individual storage, rather than applying a single parameter value to the entire system. In the previous system, the administrator had to readjust the parameter values periodically to match the usage status of the storage device and the behavior of the process. However, in the proposed method, the parameter values are fine-tuned during operation to reduce the workload of the administrator. The simulation results show that the proposed method can reduce the execution time by up to about 30% compared to the previous method with optimum parameters configured statically.

关键词： distributed storage system storage tiering Runtime parameter tuning Data block relocation

来源：评论

学校读者我要写书评

暂无评论

Performance Evaluation of Data Migration Policies for a distributed storage system with Dynamic Tiering

引用

INTERNATIONAL JOURNAL OF NETWORKED AND distributed COMPUTING 2019年第1期8卷 1-8页

作者： Nunome, Atsushi Hirata, Hiroaki Kyoto Inst Technol Fac Informat & Human Sci Sakyo Ku Kyoto 6068585 Japan

We have proposed a distributed storage system which autonomously migrates data blocks into a suitable storage node by considering their access frequency and read/write ratio. In this paper, we show that revised data migration policies can rapidly distribute input/output (I/O) hot spot over the storage nodes and can improve I/O performance of the entire system. Our simulation results show that the proposed method can reduce I/O execution time around 26% than the previous one at the maximum. (C) 2019 The Authors. Published by Atlantis Press SARL.

关键词： distributed storage system storage tiering block relocation performance evaluation

来源：评论

学校读者我要写书评

暂无评论

BTQoS: A Tenant Relationship-Aware QoS Framework for Multi-tenant distributed storage system 8th

BTQoS: A Tenant Relationship-Aware QoS Framework for Multi-t...

引用

8th International Joint Conference on Web and Big Data and Web-Age Information Management (APWeb-WAIM)

作者： Lu, Yixuan Qu, Yun Zhu, Dongjie Zhang, Rui Du, Haiwen Harbin Inst Technol Weihai Peoples R China

ISBN: (纸本)9789819772407;9789819772414

Quality of Service (QoS) is widely applied in multi-tenant distributed systems to meet tenants' Service Level Objective (SLO). Previous work ignored the relationship between tenants, making it challenging to achieve hierarchical resource management of tenants. This work proposes BTQoS, a tenant relationship-aware QoS framework for multi-tenant distributed storage systems. BTQoS introduces behavior and behavior tree abstractions to manage tenants' SLOs and relationships. BTQoS uses a two-level scheduling scheme to implement SLO enforcement, resource adaptation, and skew avoidance under dynamic workloads. In addition, BTQoS's two-level scheduler decouples tenant resource allocation and cluster resource adaptation, allowing the SLOs supported by BTQoS to be expanded with low development costs. We implement and evaluate BTQoS in HDFS. The experimental results show that BTQoS can hierarchically manage and enforce tenants' SLOs at low overheads and provide skew avoidance.

关键词： QoS Cloud computing distributed storage system

来源：评论

学校读者我要写书评

暂无评论

CCRS: An Optimized Algorithm based on CRS in distributed storage system 9

CCRS: An Optimized Algorithm based on CRS in distributed sto...

引用

Ninth International Conference on Frontier of Computer Science and Technology

作者： Yin, Chao Lv, Haitao Cui, Zongmin Li, Tongfang Yuan, Sihao Zhou, Hongbo Jiujiang Univ Sch Informat Sci & Technol Jiujiang 332005 Jiangxi Peoples R China

ISBN: (纸本)9781467392952

It is well-known that erasure codes, such as Reed-Solomn (RS) and Cauchy Reed-Solumn Codes (CRS), have played an important roles in distributed storage system to both industry and academic. While RS and CRS codes provide significant savings in storage space, they will decrease systems performance while encoding and decoding. In this paper we have developed an optimized algorithm named CCRS (Changed CRS) based on erasure coding technology, which can not only protect the system's reliability, but also improve the utilization of storage space. By studying existing high reliability and space saving rate of coding technology, we imported coding mechanism into distributed storage systems. Theory analysis and simulation test show CCRS algorithm can improve the performance. CCRS algorithm can can reduce the number of XOR in Galois field so that we can conclude that CCRS can shorten the time of encoding and decoding. The simulation test results shows that parallel decoding speed can rise up nearly two times than the past serial decoding speed. The encoding efficiency with CCRS coding is 36.1% and 58.2% higher than using CRS and RS coding equally. The decoding rate by using CCRS is 19.3% and 33.1% higher than using CRS and RS averagely.

关键词： distributed storage system CCRS performance reliabilty

来源：评论

学校读者我要写书评

暂无评论

A distributed storage system with Dynamic Tiering for iSCSI Environment 3

A Distributed Storage System with Dynamic Tiering for iSCSI ...

引用

3rd IIAI International Conference on Advanced Applied Informatics (IIAI-AAI)

作者： Nunome, Atsushi Hirata, Hiroaki Shibayama, Kiyoshi Kyoto Inst Technol Dept Informat Sci Sakyo Ku Kyoto 6068585 Japan

ISBN: (纸本)9781479941735

In this paper, we propose a distributed storage system which relocates data blocks autonomously among the storage nodes. In the system which is composed of heterogeneous storage nodes, there are performance gaps among the storage devices. The storage tiers are made by such gaps in the system. When frequently accessed data blocks are placed on improper storage tier, system performance may decline. To avoid this problem, a system administrator should periodically investigate the state of storage utilization and relocate the data blocks to the proper node. Although this makes efficient use of storage devices, administrators' workload is quite heavy. Our system is aimed at the realization of the following two functions;(i) Run-time construction of the storage tiers from the storage devices, and (ii) Automated block migration among the tiers. In general, such high level management tends to bring unignorable overhead. We also show a technique to reduce management traffic in iSCSI environment.

关键词： distributed storage system block migration storage tiering iSCSI

来源：评论

学校读者我要写书评

暂无评论

Performance Evaluation of Sheepdog distributed storage system

Performance Evaluation of Sheepdog Distributed Storage Syste...

引用

IEEE International Conference on systems, Man, and Cybernetics (SMC)

作者： Maciel, Paulo Matos, Rubcns Callou, Gustavo Silva, Bruno Barreto, Daniel Araujo, Julian Araujo, Jean Alves, Vandi Worth, Stephen Univ Fed Pernambuco Informat Ctr Recife PE Brazil EMC Corp Marlborough MA USA

ISBN: (纸本)9781479938407

distributed storage systems (DSS) are becoming even more important and complex due to the emergence of paradigms such as cloud computing, and the challenges for dealing with big data. DSS provide a set of services such as publishing, file sharing and high performance utility storage. In addition, there is a growing demand to support these services with high scalability, availability and low cost. Sheepdog is a distributed storage system which aims at providing storage volumes with high availability, using clusters of common machines. This type of storage system may prove useful in the VMS (Video Monitoring Service) market and as remote storage for cloud-based applications. This paper analyzes the scalability of Sheepdog clusters, by measuring the performance with different number of nodes and different replication degrees. The system analyzed here showed better performance for read operations in small cluster sizes than in larger ones. On the other hand, proper scalability was found for the write throughput, since no significant performance degradation was noticed when the number of cluster nodes increased.

关键词： Sheepdog Performance Evaluation distributed storage system Scalability

来源：评论

学校读者我要写书评

暂无评论

A distributed storage system with Dynamic Tiering for iSCSI Environment

引用

INTERNATIONAL JOURNAL OF NETWORKED AND distributed COMPUTING 2015年第1期3卷 42-50页

作者： Nunome, Atsushi Hirata, Hiroaki Shibayama, Kiyoshi Kyoto Inst Technol Dept Informat Sci Matsugasaki Sakyo Ku Kyoto 6068585 Japan

We propose a distributed storage system which relocates data blocks autonomously among the storage nodes. In order to optimize I/O performance with slight administrative workload, our system is aimed at the realization of the following two functions;(i) Run-time construction of the storage tiers from the heterogeneous storage devices, and (ii) Automated block migration among the tiers. We also show a technique to reduce management traffic in iSCSI environment.

关键词： distributed storage system Block Migration storage Tiering iSCSI

来源：评论

学校读者我要写书评

暂无评论

Tight Bound of Parallel Request Latency for Erasure-Coded distributed storage system 20th

Tight Bound of Parallel Request Latency for Erasure-Coded Di...

引用

20th International Conference on Algorithms and Architectures for Parallel Processing (ICA3PP)

作者： Zou, Xingshun Li, Wei Shandong Univ Jinan Peoples R China

ISBN: (纸本)9783030602451;9783030602444

With big data analysis and cloud storage improving at an astonishing rate in recent years, more and more parallel computing and data analysis techniques are invented and applied to accessing data from a distributed storage system, which has noticeable differences with accessing data from a separate dedicated storage system. The first and the last processes of a data analysis task in a shared filesystem may have a remarkable gap in latency. The latency of parallel file requests from these processes, however, lacks analytical model especially when erasure code is employed as storage strategy. The main contribution of this work is development of a tight bound of parallel file request latency to give a theoretical upper bound of lantency. Additionally, an exact batch file chunk request analytical model in distributed systems adopting erasure code is studied by the technique of two embedded Markov chains, performance measures such as queue length distribution, waiting time distribution, etc. are derived in closed form. Experimental evaluation verifies accuracy of the theoretical upper bound on latency.

关键词： Parallel file requests distributed storage system Erasure code Queueing theory Latency Embedded Markov chain

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：