检索结果-内蒙古大学图书馆

User-level parallel file system: Case studies and performance optimizations

CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE 2022年第13期34卷 e6905-e6905页

作者： Zou, Yanliang Chen, Chen Deng, Tongliang Zhang, Jian Zhu, Xiaomin Chen, Si Yin, Shu ShanghaiTech Univ Sch Informat Sci & Technol 393 Middle Huaxia Rd Shanghai Peoples R China Chinese Acad Sci Shanghai Inst Microsyst & Informat Technol Shanghai Peoples R China Univ Chinese Acad Sci Beijing Peoples R China Natl Univ Def Technol Sci & Technol Informat Syst Engn Lab Changsha Peoples R China West Chester Univ Penn Dept Comp Sci W Chester PA USA

User-level file systems are usually adopted to bridge the gap between efficacy and efficiency of file system developments for new applications' I/O demands. And the widely known user-space file system framework, FUSE, is commonly utilized to deployed user-level file systems. This article first uses a popular stack-able file system as a case study to exam how FUSE affects I/O performance. Based on the testing and analytical results, this article then presents SHC, an implementation method to implement a user-level file system without FUSE intervention. Experimental results indicate that SHC improves write bandwidth by up to 5.6x compared with that of FUSE and present leading superiority on read cases.

关键词： data consistency FUSE I O performance parallel file system storage system user-level file systems

来源：评论

学校读者我要写书评

暂无评论

A coarse-grained page cache aware multivariate analytical model for the storage performance of a parallel file system

引用

CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE 2018年第8期30卷 e4389-e4389页

作者： Inacio, Eduardo C. Dantas, Mario A. R. Univ Fed Santa Catarina Campus Reitor Joao David Ferreira Lima BR-88040900 Florianopolis SC Brazil

Huge requirements of emerging Big Data applications combined with the performance impairment of current I/O subsystems pose a great challenge on data storage, management, and access performance. In order to design efficient storage systems, a clear understanding about how factors in the I/O path affect the performance of a data-intensive application is of utmost importance. This paper reports our ongoing research toward addressing this issue, presenting a coarse-grained page cache aware multivariate analytical model for the performance of write operations in a parallel file system. The proposed model was developed to reflect the performance behavior observed in an extensive experimental effort, in which the impact of 14 parameters in the response time and throughput of the OrangeFS was investigated. More than one million experiments were carried out using four distinct computing infrastructures, providing a detailed performance characterization. Additionally, a thorough evaluation of the proposed model, covering more than 14000 scenarios, is reported, discussing both qualitative and quantitative aspects. Evaluation results indicate that the model succeeded in representing the behavior of the parallel file system performance, achieving a Mean Absolute Percentage Error of 39.94%.

关键词： analytical model high performance I/O parallel file system performance estimation

来源：评论

学校读者我要写书评

暂无评论

Performance Evaluation of A Infiniband-based Lustre parallel file system

引用

Procedia Environmental Sciences 2011年 11卷 316-321页

作者： Yuan Wang Yongquan Lu Chu Qiu Pengdong Gao Jintao Wang High Performance Computing Center Communication University of China Beijing 100024 China Information Engineering School Communication University of China Beijing 100024 China

As one of the most widely used parallel file systems, Lustre plays an important role in High Performance Computing (HPC). In this paper, an infiniband-based Lustre parallel file system is built firstly. And then a series of experiments are executed to evaluate the performance of luster with infiniaband. Some parameters have great influence on the result, such as size record, client count, stripe count and stripe size. Experimental results indicate that the higher is the speed of network the higher aggregation bandwidth luster could provide. Moreover, Client count and stripe count have more impact on the performance of luster than the record size and stripe size. Appropriate record size and stripe size could improve the performance a little, but not significantly.

关键词： Lustre infiniband parallel file system high performance computing performance evaluation

来源：评论

学校读者我要写书评

暂无评论

BFXM: A parallel file system Model Based on the Mechanism of Distributed Shared Memory

引用

Operating systems Review (ACM) 1997年第4期31卷 30-40页

作者： Li, Qun Jing, Jie Xie, Li Dept. of Computer Science Nanjing University Nanjing 210093 China

This paper proposes a parallel file system model under NOWs (network of workstations) environment. According to the features of NOWs, the system incorporates the mechanism of distributed shared memory, particularly the mechanism of COMA (cache only memory access). It links the memory of all nodes into a large cache;each node aggressively uses not only the local memory but also the remote memory of other nodes, which expedites the data accesses dramatically. It also accesses disks in parallel to improve I/O performance. Furthermore, in our model, data are shared naturally and conveniently among nodes as opposed to the traditional parallel file systems. The architecture of the parallel file system and its detailed implementation, such as file read and write, data replacement, file data dissipation, parallel file read and write are presented in this paper.

关键词： Cache only memory access Distributed shared memory parallel file system

来源：评论

学校读者我要写书评

暂无评论

Clusterfile: a flexible physical layout parallel file system

引用

CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE 2003年第7-8期15卷 653-679页

作者： Isaila, F Tichy, WF Univ Karlsruhe Fak Informat D-76128 Karlsruhe Germany

This paper presents Clusterfile, a parallel file system that provides parallel file access on a cluster of computers. We introduce a file partitioning model that has been used in the design of Clusterfile. The model uses a data representation that is optimized for multidimensional array partitioning while allowing arbitrary partitions. The paper shows how the file model can be employed for file partitioning into both physical subfiles and logical views. We also present how the conversion between two partitions of the same file is implemented using a general memory redistribution algorithm. We show how we use the algorithm to optimize non-contiguous read and write operations. The experimental results include performance comparisons with the parallel Virtual file system (PVFS) and an MPI-IO implementation for PVFS. Copyright (C) 2003 John Wiley Sons, Ltd.

关键词： parallel file system parallel I/O physical and logical partitioning non-contiguous I/O data redistribution mapping functions

来源：评论

学校读者我要写书评

暂无评论

MDMeter-A New Test Tool for Meta-data Throughput of parallel file system

MDMeter-A New Test Tool for Meta-data Throughput of Parallel...

引用

The Third International Joint Conference on Computational Science and Optimization(第三届计算科学与优化国际大会 CSO 2010)

作者： Xiaoshan Yang Ligu Zhu Qiang Li Wenjun Dai Na Ma Department of Computer Communication University of China Beijing 100024China

As the existing performance evaluation benchmark software for parallel file system has too many test items, it can't evaluate the meta-data throughput accurately, and there are great difficulties to evaluate the meta-data throughput performance in practical application environment. To solve these problems, a new meta-data throughput evaluation tool, called as MDMeter, has been designed and accomplished in this paper. A new simulation model for file operation is designed according to the real file operation records which were captured by IOTrace tool. MDMeter can launch a variety of meta-data operations on parallel file system, and can provide a comprehensive test result report to users;it can evaluate the meta-data throughput performance accurately for different application environment At the last, some tests are performed on Lustre parallel file system by MDMeter and traditional tools, the results show that MDMeter not only can give a simple and integrated performance test result to users, but also can evaluate the meta-data throughput for parallel file system more precisely than the existing test tools.

关键词： performance evaluation benchmark meta-data throughput parallel file system

来源：评论

学校读者我要写书评

暂无评论

Performance Evaluation of A Infiniband-based Lustre parallel file system

Performance Evaluation of A Infiniband-based Lustre Parallel...

引用

2011 2nd International Conference on Challenges in Environmental Science and Computer Engineering (CESCE 2011)

作者： Yuan Wang Yongquan Lu Chu Qiu Pengdong Gao Jintao Wang High Performance Computing Center Communication University of China Information Engineering School Communication University of China

As one of the most widely used parallel file systems, Lustre plays an important role in High Performance Computing(HPC). In this paper, an infiniband-based Lustre parallel file system is built firstly. And then a series of experiments are executed to evaluate the performance of luster with infiniaband. Some parameters have great influence on the result, such as size record, client count, stripe count and stripe size. Experimental results indicate that the higher is the speed of network the higher aggregation bandwidth luster could provide. Moreover, Client count and stripe count have more impact on the performance of luster than the record size and stripe size. Appropriate record size and stripe size could improve the performance a little, but not significantly.

关键词： Lustre infiniband parallel file system high performance computing performance evaluation

来源：评论

学校读者我要写书评

暂无评论

Performance Evaluation of A Infiniband-based Lustre parallel file system

Performance Evaluation of A Infiniband-based Lustre Parallel...

引用

2011 2ND International Conference on Innovative Computing and Communication and 2011 Asia-Pacific Conference on Information Technology and Ocean Engineering(CICC-ITOE 2011)

作者： Yuan Wang Yongquan Lu Chu Qiu Pengdong Gao Jintao Wang High Performance Computing Center Communication University of China Information Engineering School Communication University of China

As one of the most widely used parallel file systems, Lustre plays an important role in High Performance Computing(HPC). In this paper, an infiniband-based Lustre parallel file system is built firstly. And then a series of experiments are executed to evaluate the performance of luster with infiniaband. Some parameters have great influence on the result, such as size record, client count, stripe count and stripe size. Experimental results indicate that the higher is the speed of network the higher aggregation bandwidth luster could provide. Moreover, Client count and stripe count have more impact on the performance of luster than the record size and stripe size. Appropriate record size and stripe size could improve the performance a little, but not significantly.

关键词： Lustre infiniband parallel file system high performance computing performance evaluation

来源：评论

学校读者我要写书评

暂无评论

PsFS:a High-Throughput parallel file system for Secure Cloud Storage system

PsFS:a High-Throughput Parallel File System for Secure Cloud...

引用

2011 World Congress on Engineering and Technology(CET 2011)

作者： Hongtao Du,Zhanhuai Li Computer College Northwestern Polytechnical University Xi'An,Shaanxi 710072,P.R.China

Along with the development and application of Cloud Computing in recent years,Cloud Storage,as the module which provides data storage service in the Cloud Computing architecture,has become the kernel component of Cloud *** and more services choose Cloud Storage to manage *** present,the major obstacle of the Cloud Storage application is the security problems,and the common secure system use data encryption to protect *** the data encryption result in that the authentication of data become a big *** most current secure system,Merkle Tree was widely used,however,because write operation need to update Merkle Tree and multiple users modify a single Merkle Tree at the same time should lead to consistency *** all the secure systems do not support concurrent write yet,and it has became a big obstacle for secure Cloud Storage which should support high performance storage *** this paper,we present the design,implementation,and evaluation of PsFS,a high-throughput parallel file for secure Cloud Storage base on a new concurrent write mechanism,which use Multi-Merkle Trees to authenticate the integrity of the data.

关键词： parallel file system Concurrent Write Secure Cloud Storage Multi-Merkle Tree High-Throughput

来源：评论

学校读者我要写书评

暂无评论

Performance Evaluation of parallel file system Based on Lustre and Grey Theory

Performance Evaluation of Parallel File System Based on Lust...

引用

The Ninth International Conference on Grid and Cloud Computing(第九届网格与云计算国际学术会议 GCC 2010)

作者： Tiezhu Zhao Jinlong Hu Guangdong Key Laboratory of Computer Network South China University of TechnologyGuangzhou 510641 Guangdong Key Laboratory of Computer Network South China University of Technology Guangzhou 51064

High Performance Computing (HPC) system need to be coupled with efficient parallel file systems, such as Lustre file system, that can deliver commensurate IO throughput to scientific applications. It is important to gain insights into the deliverable parallel file system IO efficiency. In order to gain a good understanding on what and how to impact the performance of parallel file systems. This paper presents a study on performance evaluation of parallel file systems using Lustre file system. We conduct an in-depth survey on the basic performance factors of Lustre. Based on this survey, a series of test cases are designed to validate the performance of Lustre and we adopt relational analysis model and grey prediction model to analyze and predict the performance changes. In our relational analysis, we find that the performance of Lustre has a more closed correlation when performance factors change. Our prediction results indicate that our prediction model can obtain better prediction precision and could be further applied to performance evaluation of other parallel file systems.

关键词： Lustre parallel file system performance evaluation performance model

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：