检索结果-内蒙古大学图书馆

Cluster based parallel database management system for data intensive computing

中国高等学校学术文摘·计算机科学 2009年第3期3卷 302-314页

作者： Jianzhong LI Wei ZHANG School of Computer Science and Technology Harbin Institute of Technology Haribin 150001 China

This paper describes a computer-cluster based parallel database management system (DBMS), InfiniteDB, developed by the authors. InfiniteDB aims at efficiently sup-port data intensive computing in response to the rapid grow-ing in database size and the need of high performance ana-lyzing of massive databases. It can be efficiently executed in the computing system composed by thousands of computers such as cloud computing system. It supports the parallelisms of intra-query, inter-query, intra-operation, inter-operation and pipelining. It provides effective strategies for managing massive databases including the multiple data declustering methods, the declustering-aware algorithms for relational operations and other database operations, and the adaptive query optimization method. It also provides the functions of parallel data warehousing and data mining, the coordinator-wrapper mechanism to support the integration of heteroge-neous information resources on the Internet, and the fault tol-erant and resilient infrastructures. It has been used in many applications and has proved quite effective for data intensive computing.

关键词： parallel database cloud computing data inten-sive super computing

来源：评论

学校读者我要写书评

暂无评论

POTENTIAL: A Highly Adaptive Core of parallel database System

引用

Journal of Computer Science & Technology 2000年第6期15卷 527-541页

作者：文继荣陈红王珊 InstituteofComputingTechnolgoy TheChineseAcademyofSciencesBeijing100080P.R.China

POTENTIAL is a virtual database machine based on general computing platforms, especially parallel computing platforms. It provides a complete solution to high-performance database systems by a 'virtual processor + virtual data bus + virtual memory' architecture. Virtual processors manage all CPU resources in the system, on which various operations are running. Virtual data bus is responsible for the management of data transmission between associated operations, which forms the hinges of the entire system. Virtual memory provides efficient data storage and buffering mechanisms that conform to data reference behaviors in database systems. The architecture of POTENTIAL is very clear and has many good features, including high efficiency, high scalability, high extensibility, high portability, etc.

关键词： virtual database machine virtual data bus virtual processor virtual memory parallel database

来源：评论

学校读者我要写书评

暂无评论

Analysis and Research on the Balanced Distribution of the Network-Based Data in parallel database

Analysis and Research on the Balanced Distribution of the Ne...

引用

4th International Conference on Machine Vision (ICMV) - Computer Vision and Image Analysis - Pattern Recognition and Basic Technologies

作者： He, JunHua Huangshi Inst Technol Sch Comp Sci & Technol Huangshi Hubei Peoples R China

ISBN: (纸本)9780819490261

The rapid development of parallel computer systems, making parallel operating environment gradually mature and widely used in scientific computing and research in many fields, thus parallel database of research becomes more and more attention and research has become an important database field of study. This network-based parallel cluster of characteristics and the current parallel computer system new trends, analyzes the network parallel clusters of workstations, parallel database data skew problem in data distribution characteristics of the environment is proposed with the ability to adapt to the dynamic data balanced distribution programs.

关键词： Network parallel database data distribution

来源：评论

学校读者我要写书评

暂无评论

TIIS: A Two-level Inverted-index Scheme for Large-scale Data Processing in the parallel database System

TIIS: A Two-level Inverted-index Scheme for Large-scale Data...

引用

International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC)

作者： Yu, Lei Fu, Ge Tan, Huaiyuan Jin, Yan Zhang, Hong Liu, Xinran Xiang, Xiaojia Chinese Acad Sci Inst Comp Technol Beijing Peoples R China Natl Comp Network Emergency Response Tech Team Co Beijing Peoples R China Changan Commun Technol Co Ltd Beijing Peoples R China

ISBN: (纸本)9781479925650

Based on Service-Oriented Architecture, an inexpensive solution, parallel database middleware gather the standalone database instance to provide users with highly scalable relational data management platform. However, with the advent of the era of large-scale data, such platform has posed a serious challenge in the context of text data retrieval. Motivated by this observation, a parallel database middleware based on semi-structure data is firstly designed to support text retrieval. Then, a two-level inverted-index scheme called TIIS is designed for full-text query. The advantages of TIIS are that it can quickly locate the result data from large cluster distributed database storing large-scale data, and it can greatly reduce the network I/O and disk I/O. Experimental results show that, comparing with Hive using Hadoop Distributed File System in same environment of hardware, our system performs typical TPC-H data analysis, consuming of full-text query is declined by 90% on 2GB commercial data in average.

关键词： parallel database query optimization full text retrieval inverted index

来源：评论

学校读者我要写书评

暂无评论

A Provenance Storage Method Based On parallel database 2

A Provenance Storage Method Based On Parallel Database

引用

2nd International Conference on Information Science and Control Engineering

作者： Wang, Zhuo Xu, Yao Suo, Bo Wang, Zhong Xu, Jian Chen, Qun Li, Zhanhuai NPU Sch Comp Xian Peoples R China

ISBN: (纸本)9781467368506

When faced with dirty data fused from different sources, modern data management generally trace origins using data provenance technical to repair it fundamentally. Unfortunately, the state-of-art data provenance approaches can only deal with small amount of data using annotation or inverse process. What's worse, these approaches just work under stand-alone mode, resulting in low efficiencies. In this paper, we raise a distributed provenance storage strategy DPSM under the environment of parallel data-base combined with the small-amount-storage advantage of "Provenance Tree". The model optimizes both query efficiencies and storage cost by using a detached method to store different provenance information.

关键词： data provenanc provenance tree parallel database distributed storage component

来源：评论

学校读者我要写书评

暂无评论

Data Analysis and parallel database Construction of Cloud Platform

Data Analysis and Parallel Database Construction of Cloud Pl...

引用

2019 2nd International Conference on Mechanical Engineering,Industrial Materials and Industrial Electronics(MEIMIE 2019)

作者： Yan Wei Information Centre of HuaiHai Institute of Technology

With the arrival of the era of big data, people have higher and higher requirements for data processing. Clustering analysis is the key to data processing, which can facilitate people to describe and understand data objects, and collect the intrinsic information of large data hidden in cloud platforms. It is urgent to study a reasonable parallel clustering method for large data in cloud platforms. The Internet has taken root in people's lives and spread to every corner. The development of scientific research informationization makes people deal with things more and more conveniently and synchronization more and more timely. However, the emergence of new things will always bring new problems and usher in a new pattern. When we use the Internet for information transmission and interaction and it will produce a lot of data information. However, with the rapid growth of data storage and transmission, the existing traditional computer mechanisms and technologies can no longer meet the current computing needs, which prompt people to seek new technologies to process and analyze large amounts of data and extract potential information and value from data.

关键词： Cloud Platform Data Analysis parallel database Construction Hadoop

来源：评论

学校读者我要写书评

暂无评论

A New Oracle parallel database Optimization Model

A New Oracle Parallel Database Optimization Model

引用

2017 4th ICMIBI International Conference on Training, Education, and Management (ICMIBI-TEM 2017)

作者： Lei Yu Nanjing Institute of Technology

This manuscript proposes the new Oracle parallel database optimization model. There are many factors that affect the operational efficiency of the Oracle databases, which together constrain the performance of the general Oracle databases. Specifically, the influencing factors are as follows. The use of the transaction can make developers work more easily. In basic Java applications use transactions that can reduce the possibility of a basic multi-user environment data error. However, transaction control mechanism is very complex and its operation requires additional processing and the processing will degrade the performance of the system. Using stored procedures and storage functions, the application does not have to include multiple SQL statements of network operations to perform database server operations, but simply call stored and stored functions, and only on the network call the name of the process and output the results. The proposed model can deal with the mentioned challenges well which will be verified in the future research.

关键词： Oracle parallel database Optimization model Novel methodology

来源：评论

学校读者我要写书评

暂无评论

The instrumentation of a parallel, distributed database operation, retrieve-common, for merging two large sets of records

The instrumentation of a parallel, distributed database oper...

引用

作者： Gregory Alan Hammond Naval Postgraduate School

学位级别：硕士

The Naval Postgraduate School's Laboratory for database Systems Research is the site of the multi-backend database supercomputer (MBDS). Originally, MBDS supported a prototype primary operation (retrieve-common) which merged two sets of records in a distributed, parallel database environment. This thesis presents the testing, and modification of that prototyped primary operation. First, the design rationale of the MBDS is reviewed. Specifically, this review examines the reasons for a database-oriented supercomputer, the MBDS primary processes, and the methodology of distributing a database within loosely coupled and highly parallel database stores. Then, this study explains the methodology involved in developing theories on the cause of retrieve-common's defects and bottlenecks. Finally, in validating our theories, this study relates the process of discovering and correcting these discrepancies.

关键词： Distributed database parallel database Record Merging Multi-backend

来源：评论

学校读者我要写书评

暂无评论

Dynamic data reallocation for skew management in shared-nothing parallel databases

引用

DISTRIBUTED AND parallel databaseS 1997年第3期5卷 271-288页

作者： Helal, AS Yuan, D ElRewini, H MCI TELECOMMUN RICHARDSONTX 75081 UNIV NEBRASKA DEPT COMP SCIOMAHANE 68182

The shared nothing parallel database architecture is gaining wide popularity due to its scalability and increased data availability. However, in order to efficiently utilize parallelism in such architecture, independent data sets must be assigned to different processing nodes. This, of course, can initially be achieved by employing a careful partitioning scheme that allocates disjoint data sets to different processors. However, variations in the data access pattern may render some processors overloaded while others underloaded. This skewness in data access decreases the effective parallelism and eventually leads to overall performance degradation. A number of solutions have been proposed to periodically perform data re-allocation to remove the skewness in data access. Most of the proposed solutions perform either static re-allocation that requires the system to be taken off-line or dynamic, but non-transactional, re-allocation. In this paper, we introduce a dynamic and transactional re-allocation scheme based on the work on disk cooling in shared memory architecture by Scheuermann et al. The proposed scheme enhances the effective parallelism in the system regardless of the variations in the pattern of access. The proposed scheme detects access skew as it occurs and re-allocates data partitions to underloaded processing elements on the fly. Only the block being moved becomes unavailable. In addition, mutual consistency among transactions concurrent to the re-allocation event is preserved. The proposed scheme also uses replication as an additional cooling mechanism to help distribute access load over multiple replicas. We conducted a series of simulation experiments to study the behavior of shared nothing parallel database systems with and without the proposed dynamic re-allocation scheme. We also experimented with several replication strategies to measure their impact on the system performance. Finally, we studied the effect of using different concurrency control str

关键词： parallel database data allocation transaction processing performance evaluation

来源：评论

学校读者我要写书评

暂无评论

On the performances in simulation of parallel databases: an overview on the most recent techniques for query optimization

On the performances in simulation of parallel databases: an ...

引用

International Workshop on High Performance Computational Systems Biology (HiBi 2009)

作者： Sadat, A. B. M. Rubaiyat Islam Lecca, Paola Univ Trento Dept Informat Engn & Comp Sci Trento Italy Microsoft Res Univ Trento Ctr Computat & Syst Biol Trento Italy

ISBN: (纸本)9780769538099

The query optimization is a very big field in the context of database management. It has been studied in a great variety of contexts and from many different perspectives, giving rise to several diverse solutions in each Case. The purpose of this paper is to primarily provide a comprehensive review and discussion of the core problems which the techniques or query optimization generally cope with by simulating a parallel database environment in different processing units. In addition to that this paper focuses oil the skewing problem in parallel database architectures with proper survey of literature.

关键词： parallel database skew partition join query optimization

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：