检索结果-内蒙古大学图书馆

On the Synchronization Bottleneck of openstack swift-Like Cloud Storage Systems

IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS 2018年第9期29卷 2059-2074页

作者： Ruan, Mingkang Titcheu, Thierry Zhai, Ennan Li, Zhenhua Liu, Yao E, Jinlong Cui, Yong Xu, Hong Tsinghua Univ Sch Software Beijing 100084 Peoples R China Univ Luxembourg Interdisciplinary Ctr Secur Reliabil & Trust L-4365 Luxembourg Luxembourg Yale Univ Dept Comp Sci POB 2158 New Haven CT 06520 USA SUNY Binghamton Dept Comp Sci Binghamton NY 13902 USA Tsinghua Univ Dept Comp Sci & Technol Beijing 100084 Peoples R China City Univ Hong Kong Dept Comp Sci Hong Kong Hong Kong Peoples R China

As one type of the most popular cloud storage services, openstack swift and its follow-up systems replicate each object across multiple storage nodes and leverage object sync protocols to achieve high reliability and eventual consistency. The performance of object sync protocols heavily relies on two key parameters: r (number of replicas for each object) and n (number of objects hosted by each storage node). In existing tutorials and demos, the configurations are usually r = 3 andn < 1, 000 by default, and the sync process seems to perform well. However, we discover in data-intensive scenarios, e.g., when r > 3 and n >> 1, 000, the sync process is significantly delayed and produces massive network overhead, referred to as the sync bottleneck problem. By reviewing the source code of openstack swift, we find that its object sync protocol utilizes a fairly simple and network-intensive approach to check the consistency among replicas of objects. Hence in a sync round, the number of exchanged hash values per node is circle dot(n x r). To tackle the problem, we propose a lightweight and practical object sync protocol, LightSync, which not only remarkably reduces the sync overhead, but also preserves high reliability and eventual consistency. LightSync derives this capability from three novel building blocks: 1) Hashing of Hashes, which aggregates all the h hash values of each data partition into a single but representative hash value with the Merkle tree;2) Circular Hash Checking, which checks the consistency of different partition replicas by only sending the aggregated hash value to the clockwise neighbor;and 3) Failed Neighbor Handling, which properly detects and handles node failures with moderate overhead to effectively strengthen the robustness of LightSync. The design of LightSync offers provable guarantee on reducing the per-node network overhead from circle dot(n x r) to circle dot(n/h). Furthermore, we have implemented LightSync as an open-source patch and adopt

关键词： Cloud storage openstack swift object synchronization performance bottleneck

来源：评论

学校读者我要写书评

暂无评论

Optimization Scheme of Massive Meteorological Data Storage Based on openstack swift 12

Optimization Scheme of Massive Meteorological Data Storage B...

引用

12th International Conference on Communication Software and Networks (ICCSN)

作者： Xue, Shuangqing Wen, Chengyu Zhang, Xiaoli Wang, Zhuo Linfen Meteorol Bur Linfen Shanxi Peoples R China Chengdu Univ Informat & Technol Chengdu Peoples R China Unisplendour Cloud Technol Ltd Tianjin Peoples R China

ISBN: (数字)9781728198156

ISBN: (纸本)9781728198156

In order to solve the problem that cloud storage system will produce lots of metadata information and reduce the storage efficiency of the system when processing massive meteorological small files. In this paper, we propose an optimized scheme for storing massive meteorological data, which is implemented in openstack swift. The scheme consists of load balancing module and merge storage module. On the one hand, load balancing module combines HAproxy and UCARP to alleviate the uneven load distribution when swift stores a huge number of meteorological files. On the other hand, the scheme adopts the merge storage strategy to improve the reading and writing performance of meteorological small files in swift. Experiments show that this optimization method can not only reduce the reading delay of massive meteorological files in swift system, but also improve the throughput of swift.

关键词： openstack swift meteorological data small files merge storage load balancing

来源：评论

学校读者我要写书评

暂无评论

Formalization and Verification of openstack swift Using CSP 48

Formalization and Verification of OpenStack Swift Using CSP

引用

48th Annual IEEE International Computers, Software, and Applications Conference (COMPSAC) - Digital Development for a Better Future

作者： Su, Ziqing Lin, Wei Zhu, Huibiao East China Normal Univ Shanghai Key Lab Trustworthy Comp Shanghai Peoples R China

ISBN: (纸本)9798350376975;9798350376968

openstack swift is an object storage system that is part of the open-source cloud platform openstack. It adopts a fully symmetric architecture design and is extensively employed in production environments to offer users highly available storage services. In this paper, we model openstack swift's basic architecture, as well as its replication service using communication sequential processes (CSP). Additionally, we extend the audit service in swift and provide a formal model of it. Various properties of our model are subsequently verified using the model checker PAT. The properties include Deadlock Freedom, Data Reachability, Consistency, Availability, Partition Tolerance (CAP), Basically Available, Soft State, Eventually Consistent (BASE), and Data Integrity. The verification results show that the design of openstack swift satisfies both the CAP and the BASE theories and it achieves Data Integrity. In light of our results, it can be safely concluded that openstack swift provides users with highly available and fault-tolerant services.

关键词： openstack swift CSP Modeling Verification

来源：评论

学校读者我要写书评

暂无评论

Improving openstack swift interaction with the I/O Stack to enable Software Defined Storage 7

Improving OpenStack Swift interaction with the I/O Stack to ...

引用

IEEE 7th International Symposium on Cloud and Service Computing (IEEE SC2)

作者： Nou, Ramon Miranda, Alberto Siquier, Marc Cortes, Toni BSC Barcelona Spain Univ Politecn Cataluna BSC Barcelona Spain

ISBN: (纸本)9781538658628

This paper analyses how openstack swift, a distributed object storage service for a globally used middleware, interacts with the I/O subsystem through the Operating System. This interaction, which seems organised and clean on the middleware side, becomes disordered on the device side when using mechanical disk drives, due to the way threads are used internally to request data. We will show that only modifying the swift threading model we achieve an 18% mean improvement in performance with objects larger than 512 KiB and obtain a similar performance with smaller objects. Compared to the original scenario, the performance obtained on both scenarios is obtained in a fair way: the bandwidth is shared equally between concurrently accessed objects. Moreover, this threading model allows us to apply techniques for Software Defined Storage (SDS). We show an implementation of a Bandwidth Differentiation technique that can control each data stream and that guarantees a high utilization of the device.

关键词： SDS openstack swift Kernel Interaction Storage QoS Fairness

来源：评论

学校读者我要写书评

暂无评论

Dynamic Allocation of Replication and Erasure Codes for Enhancing Storage Efficiency in openstack swift

Dynamic Allocation of Replication and Erasure Codes for Enha...

引用

19th International Conference on Electronics, Information, and Communication (ICEIC)

作者： Ahn, Cheongjin Pirahandeh, Mehdi Kim, Deok-Hwan Inha Univ Dept Elect Engn Incheon 402751 South Korea

ISBN: (纸本)9781728162898

The object storage system introduced data redundancy techniques such as replication and erasure codes to build a reliable system. However, replication method has storage efficiency problem with large and less frequently accessed data types, and erase coding method has performance problem with small and frequently accessed data types. In this paper, we propose a dynamic allocation of replication and erasure coding approach (DARE) to improve storage efficiency and performance using access frequency and object size factors. Experimental results show that the proposed DARE can improve storage efficiency by 21 percent compared to the traditional resilient system

关键词： object storage erasure codes replication storage efficiency openstack swift

来源：评论

学校读者我要写书评

暂无评论

Design and Implementation of an Encrypted Cloud Storage System Based on openstack swift 7

Design and Implementation of an Encrypted Cloud Storage Syst...

引用

7th IEEE International Conference on Software Engineering and Service Science (ICSESS)

作者： Lv, Wuyou Univ Elect Sci & Technol China Res Inst Elect Sci & Technol UESTC Chengdu Sichuan Provinc Peoples R China

ISBN: (纸本)9781467399043

To solve the issues of user data security and sharing in the cloud storage environment, we studied the methods to build an encrypted cloud storage system with sharing mechanism. This paper provides a method to build such a system on the basis of the existing openstack swift storage service. Then the architecture design of this system is given, which includes the use of the combination of public-key encryption scheme and symmetric-key encryption scheme to encrypt user's private data and protect its security. An architecture design of proxy reencryption is given, which enables users to safely share encrypted data. And then we presented the implementation of the prototype system, as long as the test results of this system. This system is safe under the DBDH (Decisional Bilinear Diffie-Hellman) assumption and compatible with the existing openstack swift system, and it's of reference value for the design and implementation of encrypted cloud storage systems.

关键词： data security data sharing openstack swift encrypted cloud storage proxy re-encryption public-key encryption

来源：评论

学校读者我要写书评

暂无评论

Design and Implementation of an Encrypted Cloud Storage System Based on openstack swift

Design and Implementation of an Encrypted Cloud Storage Syst...

引用

2016 IEEE 7th International Conference on Software Engineering and Service Science

作者： Wuyou Lv Research Institute Electronic Science and Technology of UESTC University of Electronic Science and Technology of China

To solve the issues of user data security and sharing in the cloud storage environment,we studied the methods to build an encrypted cloud storage system with sharing *** paper provides a method to build such a system on the basis of the existing openstack swift storage *** the architecture design of this system is given,which includes the use of the combination of public-key encryption scheme and symmetric-key encryption scheme to encrypt user's private data and protect its *** architecture design of proxy reencryption is given,which enables users to safely share encrypted *** then we presented the implementation of the prototype system,as long as the test results of this *** system is safe under the DBDH(Decisional Bilinear Diffie-Hellman)assumption and compatible with the existing openstack swift system,and it's of reference value for the design and implementation of encrypted cloud storage systems.

关键词： data security data sharing openstack swift encrypted cloud storage proxy re-encryption public-key encryption

来源：评论

学校读者我要写书评

暂无评论

openstack swift服务访问层的设计及实现

引用

数字通信世界 2017年第8期 73-74页

作者：张难生厦门城市职业学院

Open Stack swift服务是一个开源的云存储项目,用其提供的存储对象访问层应用程序接口,接合openstack的Keystone安全访问机制及R ESTful软件架构风格,设计了灵活、安全稳定的面向对象的分布式存储对象管理方案,并实现了Android移动客户... 详细信息

Open Stack swift服务是一个开源的云存储项目,用其提供的存储对象访问层应用程序接口,接合openstack的Keystone安全访问机制及R ESTful软件架构风格,设计了灵活、安全稳定的面向对象的分布式存储对象管理方案,并实现了Android移动客户端以HTTP1.1协议对分布式存储对象的上传、下载、删除、查询、更新等管理操作,以此验证设计方案的可行性。

关键词： openstack swift 云存储移动应用

来源：评论

学校读者我要写书评

暂无评论

Towards benchmarking erasure coding schemes in object storage system: A systematic review

引用

FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE 2025年 163卷

作者： Noor, Jannatun Upoma, Rezuana Imtiaz Sakif, Md. Sadiqul Islam Islam, A. B. M. Alim Al BRAC Univ Sch Data & Sci Comp Sustainabil & Social Good C2SG Res Grp Dhaka Bangladesh BRAC Univ Dept Comp Sci & Engn Sch Data & Sci Dhaka Bangladesh Bangladesh Univ Engn & Technol Dept CSE Next Generat Comp Res Grp Dhaka Bangladesh

Erasure Coding (EC) in cloud storage minimizes data replication by reconstructing data from parity fragments. This method enhances data redundancy and efficiency while reducing storage costs and improving fault tolerance. It is more advantageous than replication in Object Storage Systems. EC guarantees data integrity by ensuring lossless transmission of all coded pieces. As data volumes continue to increase rapidly, the time efficiency of the EC method becomes crucial in ensuring optimal system performance. Various variables, including the algorithm employed, data size, number of storage nodes, hardware resources, and network conditions, can influence the speed of EC operations. Although some literature covers various aspects, there is still a research gap in understanding the I/O activities, time efficiency, and fault tolerance of EC in object storage systems. Hence, our research aims to address these challenges in cloud-based object storage systems. We analyze and benchmark the data storage I/O performance of openstack swift, focusing on the time efficiency of the Reed-Solomon (RS) algorithm across two datasets. Additionally, our contributions include benchmarking EC performance in both local and remote testbeds, utilizing the SimEDC simulator for comprehensive efficiency and fault tolerance assessments. Moreover, we create a comprehensive dataset (MCSD-100) for benchmarking and conduct a systematic literature review. Finally, we identify and discuss future opportunities for enhancing EC in cloud-based object storage systems.

关键词： Erasure coding openstack swift Reed-Solomon codes Cloud storage system

来源：评论

学校读者我要写书评

暂无评论

Sherlock in OSS: A Novel Approach of Content-Based Searching in Object Storage System

引用

IEEE ACCESS 2024年 12卷 69456-69474页

作者： Noor, Jannatun Sakif, Md. Sadiqul Islam Mondal, Joyanta Jyoti Rownak Ali Uday, Mir Haque Ratul, Rizwanul Chellappan, Sriram Alim Al Islam, A. B. M. BRAC Univ Sch Data & Sci Comp Sustainabil & Social Good C2SG Res Grp Dhaka 1212 Bangladesh Bangladesh Univ Engn & Technol Dept CSE Next Generat Comp Res Grp Dhaka 1000 Bangladesh Univ Alabama Birmingham Dept Comp Sci Birmingham AL 35294 USA Univ S Florida Dept Comp Sci Tampa FL 33620 USA

Cloud-based Object Storage Systems (OSS) are known for their scalability, durability, availability, and concurrency. However, there is a noticable vaccum in open-source OSS for a straightforward way for users and administrators to conduct data searches within object storage without fully utilizing the cloud infrastructure. In our research, we present Sherlock, a novel Content-Based Searching (CoBS) framework. Sherlock enhances search capabilities by using extra information from images and documents, incorporating this information into an Elasticsearch-powered database to enable content-driven searches. The framework operates through a two-stage process. First, it classifies the incoming data by type, directing images to an object detection model and processing documents for keyword extraction. Then, Elasticsearch catalogs the extracted data, facilitating searches based on content. The effectiveness of our searches is largely dependent on the precision of these models, which we improve by training them on large-scale datasets: the Microsoft COCO Dataset for multimedia content and the SemEval2017 Dataset for text documents. We further test our system's performance by integrating it with the open-source OSS, openstack swift, and conducting real-world experiments with image uploads to evaluate how our model performs within swift's object storage environments.

关键词： Content-based searching (CoBS) content-based image retrieval (CBIR) deep learning openstack swift object storage system (OSS) distributed systems

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：