检索结果-内蒙古大学图书馆

Design a Data Warehouse Schema from Document-Oriented database

Procedia Computer Science 2019年 159卷 221-230页

作者： Senda Bouaziz Ahlem Nabli Faiez Gargouri MIRACL Laboratory Faculty of Economics and Management Sfax BP 3018 Tunisia MIRACL Laboratory Faculty of Computer Sciences and Information Technologies Al-Baha University KSA MIRACL Laboratory Institute of Computer Science and Multimedia Sfax BP 3021 Tunisia

Traditional data warehouses are unable to meet the growing needs of the modern enterprise to integrate and analyze a wide variety of data generated by social, mobile and sensor sources. What is remarkable is that many companies have changed their data storage in nosql databases. Given the important role played by this type of databases, it is necessary to study nosql databases as a data source for the modeling and the implementation of data warehouses. This paper proposes a method to design the data warehouse schema from schema free databases known as nosql databases. Our proposal starts with the extraction of schemes from document-oriented databases as an example of nosql database. This extraction is performed based on the MapReduce paradigm. Then, it defines the structure identification graph from the extracted schemes. This graph will help the designer to identify the multidimensional concepts for each schema extracted in order to design the global data warehouse schema.

关键词： nosql databases Map-Reduce Data Warehouse Schema Design Document-oriented database Extraction

来源：评论

学校读者我要写书评

暂无评论

Model driven reverse engineering of nosql property graph databases: The case of Neo4j

Model driven reverse engineering of NoSQL property graph dat...

引用

IEEE International Conference on Big Data

作者： Isabelle Comyn-Wattiau Jacky Akoka ESSEC Business School Cergy France CEDRIC-CNAM & IMT-TEM Paris France

Most nosql databases are schemaless. Although they offer some flexibility, they do not have any knowledge of the database schema, losing the benefits provided by these schemas. It is generally accepted that data modelling can have an impact on performance, consistency, usability, and maintainability. We argue that nosql databases need data models that ensure the proper storage and the relevant querying of the data. This paper seeks to present and illustrate an MDA-based approach, allowing us to achieve a reverse engineering of nosql property graph databases into an Extended Entity-Relationship schema. The approach is applied to the case of Neo4j graph database. We present an illustrative scenario and evaluate the reverse engineering approach.

关键词： Reverse engineering nosql databases Unified modeling language Data models Ciphers Big Data

来源：评论

学校读者我要写书评

暂无评论

Creation of Information Portraits Using 'Polar' System 3

Creation of Information Portraits Using 'Polar' System

引用

3rd Russian-Pacific Conference on Computer Technology and Applications (RPC)

作者： Platonov, Y. Artamonova, E. Russian Acad Sci Siberian Branch AP Ershov Inst Informat Syst VLSI CAD Lab Novosibirsk Russia

ISBN: (纸本)9781538675311

The research is dedicated to the usage of specialized systems for the big data analytics. In the research, the authors focus on the problem of the fast search, reading and editing the data stored in systems operating with the data containing a great number (ex., about a billion) of records. The methods suggested in the current report have large opportunities of practical applications. Authors work on the join of Semantic Web and RDF model of the data description. This report extends the use of specialized databases. In particular, research was devoted to the use of Object Relational Mapping (ORM) technology for not relational databases. All operations were performed on specialized Polar system, the original implementation of Institute of Information Systems of Siberian Branch of the Russian Academy of Science.

关键词： polar RDF ORM nosql databases search indexing Big data

来源：评论

学校读者我要写书评

暂无评论

Evaluation of container orchestration systems for deploying and managing nosql database clusters 11

Evaluation of container orchestration systems for deploying ...

引用

11th IEEE International Conference on Cloud Computing (CLOUD) Part of the IEEE World Congress on Services

作者： Truyen, Eddy Van Landuyt, Dimitri Lagaisse, Bert Joosen, Wouter Bruzek, Matt KULeuven IMEC DistriNet Leuven Belgium Red Hat Raleigh NC USA

ISBN: (纸本)9781538672358

Container orchestration systems, such as Docker Swarm, Kubernetes and Mesos, provide automated support for deployment and management of distributed applications as sets of containers. While these systems were initially designed for running load-balanced stateless services, they have also been used for running database clusters because of improved resilience attributes such as fast auto-recovery of failed database nodes, and location transparency at the level of TCP/IP connections between database instances. In this paper we evaluate the performance overhead of Docker Swarm and Kubernetes for deploying and managing nosql database clusters, with MongoDB as database case study. As the baseline for comparison, we use an OpenStack IaaS cloud that also allows attaining these improved resilience attributes although in a less automated manner.

关键词： Container orchestration Performance evaluation nosql databases

来源：评论

学校读者我要写书评

暂无评论

Semantic Web Technologies and Big Data Warehousing 41

Semantic Web Technologies and Big Data Warehousing

引用

41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)

作者： Pticek, M. Vrdoljak, B. Univ Zagreb Fac Elect Engn & Comp Dept Appl Comp Zagreb Croatia

ISBN: (纸本)9789532330953

Research in data science field has pointed out analytical potentials contained in big data on numerous occasions. The new paradigms in data storage and processing emerged with the goal of handling big data, but also pushing traditional, already present systems out of focus and creating a gap between the old and the new. That was also the case with traditional data warehouses and emergence of nosql data stores, whose integration has shown to be quite problematic due to nosql and big data features. Latest research has been trying to overcome this gap in various ways, mostly by system integration on various levels or introducing completely different new ones, but due to the data warehouse's particular nature and strict process of data modelling and acquisition, this problem must be approached on a conceptual level, capturing the essence of the domain which is to be analysed. The lack of schema in nosql databases makes them less comprehensible for integration and analysis, which motivated the idea of employing semantics to enrich nosql database contents, making them more suitable for integration. This paper analyses ways in which semantics could be applied as an asset in bringing together data warehouses, nosql databases, and big data.

关键词： Big Data nosql databases Data warehouses Semantics Data science Memory System integration

来源：评论

学校读者我要写书评

暂无评论

The Read Amplification Analysis of nosql Database on Top of OSDs: A Case Study of HBase 4

The Read Amplification Analysis of NoSQL Database on Top of ...

引用

4th International Conference on Big Data Computing and Communications (BIGCOM)

作者： Liu, Shiyong Guo, Zhongwen Liu, Chen Wang, Xupeng Wang, Guohua Qiu, Zhijin Qin, Xukun Ocean Univ China Qingdao Shandong Peoples R China Univ Minnesota Minneapolis MN 55455 USA South China Univ Technol Guangzhou Guangdong Peoples R China Qilu Univ Technol Shandong Acad Sci Jinan Shandong Peoples R China

ISBN: (纸本)9781538680216

The nosql database has showed a great improvement for large-scale datasets in terms of storage and computing. As for the conventional deployment architecture, they can obtain tremendously good performance as storage and compute components are running in the same node. Nevertheless, many nosql users have their own storage pool (e.g., OSD server pool) which provides different interfaces for different nosql databases. Many benefits are achieved from this new application scenarios, such as higher scalability, better flexibility and data maintainability. However, the physical separation of nosql application and storage nodes potentially influences the system performance. To better understand the new scenario, we take HBase, a common nosql database, as a study. HBase exploits a layered storage architecture with two main layers, a distributed database atop a distributed file system (HDFS). We perform experiments with YCSB benchmark and a new developed benchmark to evaluate the separation deployment of RegionServer and HDFS server and verify the read amplification of network I/O between them. Based on our observations, we propose a novel OSD Agent scheme consisting of HBase Local Storage Scanner and HBase Local Storage Compactor to reduce the amplification by filtering out the requested data from the data block on OSD server pool. From the simulation results, the OSD Agent can reduce the network traffic amplification from 36x-92x to 2x for HBase read operation, 1.2x-21x to 1.2x for HBase scan with column filter operation. Moreover, the OSD Agent makes the read performance less sensitive to the network bandwidth. The OSD Agent brings in great performance improvement for nosql Database on top of OSDs.

关键词： Servers nosql databases Computer architecture Compaction Benchmark testing Bandwidth Scalability

来源：评论

学校读者我要写书评

暂无评论

PAX: Partition-Aware Autoscaling for the Cassandra nosql Database

PAX: Partition-Aware Autoscaling for the Cassandra NoSQL Dat...

引用

IEEE/IFIP Network Operations and Management Symposium (NOMS)

作者： Dipietro, Salvatore Buyya, Rajkumar Casale, Giuliano Imperial Coll London Dept Comp London England Univ Melbourne Sch Comp & Informat Syst Cloud Comp & Distributed Syst Lab Melbourne Vic Australia

ISBN: (纸本)9781538634165

Apache Cassandra has emerged as one of the most widely adopted nosql databases. However, there is still a limited understanding on how to optimally operate Cassandra in the cloud using autoscaling methods, by which resources can be scaled up or down to reduce operational costs and meet service-level objectives (SLOs). To address this limitation, we present PAX, a partition-aware elastic resource management system for Apache Cassandra. PAX uses low-overhead query sampling and knowledge of the data-partitioning across the nodes to automatically adapt capacity in Cassandra clusters. Differently from existing autoscaling methods for Cassandra, which incur large acquisition times for new nodes, PAX exploits Cassandra's hinted handoff mechanism and a shared hints storage to minimize the time needed to acquire a node into the cluster. We propose a reactive and a proactive implementation of PAX and compare their performance against different workloads with varying intensities and item popularity distributions, finding that the proactive version significantly reduces SLO violations.

关键词： Radio frequency nosql databases Cloud computing Synchronization Forecasting

来源：评论

学校读者我要写书评

暂无评论

CAP-based Examination of Popular nosql Database Technologies in Streaming Data Processing

CAP-based Examination of Popular NoSQL Database Technologies...

引用

International Artificial Intelligence and Data Processing Symposium (IDAP)

作者： Tuğba Beril Doğuç Ahmet Arif Aydın Inonu University Malatya Turkey

Nowadays, when the Internet, software and hardware technologies develop rapidly, we are in a digital era where a wide range of resources generate data in different formats and 7/24. It is essential for organizations to quickly process data in near-real time and store it in a scalable form, especially without loss of data. In addition, the importance of streaming data processing due to the desire to get information quickly instantly increases. In this study, the popular nosql databases, which are prominent in streaming data processing, have been examined based on CAP's theorem. This work will help software developers in the selection and use of nosql databases for streaming data processing.

关键词： Data processing Twitter Cluster computing nosql databases Facebook Java Software

来源：评论

学校读者我要写书评

暂无评论

Document-Oriented Geospatial Data Warehouse: An Experimental Evaluation of SOLAP Queries

Document-Oriented Geospatial Data Warehouse: An Experimental...

引用

IEEE Conference on Commerce and Enterprise Computing, CEC

作者： Marcio Ferro Rogerio Fragoso Robson Fidalgo Informatics Center Federal University of Pernambuco Recife Brazil

Geospatial Data Warehouse (GDW) is a repository of historical and geospatial data used in the decision-making process. This kind of system manages large volumes of data and supports Spatial On-Line Analytical Processing (SOLAP) queries. The use of nosql databases in the construction of GDW is still an unexplored topic, even though nosql databases present good performance and high scalability with low-cost hardware. In this context, we seek to identify the level of redundancy of geospatial data in Document-Oriented GDW (DGDW) that reduces the storage cost and increases the performance of SOLAP queries. Using the MongoDB database, we exhaustively define and investigate nine DGDW schemas, which have different levels of geospatial data redundancy in their dimensions. We performed an experimental evaluation of these schemas in a cluster structure, to analyze the data volume and the runtime of seven queries which simulate SOLAP operations in geospatial fields with different levels of redundancy and selectivity. Our experimental results indicate that the normalization of low-selectivity geospatial fields and the denormalization of high-selectivity geospatial fields are good strategies to reduce the storage cost and improve the performance of SOLAP queries. The results of our experimental evaluation are an important contribution because they can be used as a guide for construction of DGDW.

关键词： Geospatial analysis Unified modeling language Redundancy nosql databases Data warehouses Informatics

来源：评论

学校读者我要写书评

暂无评论

A REVIEW ON INTEGRATION OF BIG DATA AND IoT 4

A REVIEW ON INTEGRATION OF BIG DATA AND IoT

引用

4th International Conference on Computing Sciences (ICCS)

作者： Kaur, Harjinder Kushwaha, Ajay Shriram Lovely Profess Univ Sch Comp Applicat Jalandhar Punjab India

ISBN: (纸本)9781538680254

Communication plays a vital role whether we talk about formal or informal but when it comes to device communication or objects communication. IoT plays very important role to understand real world objects after transforming into virtual objects and generate huge amount of data which is in structured as well as unstructured form. In this paper author is focusing on various attributes which may provide feasible and optimal solutions for effective integration of IoT with Big Data to solve critical data analysis. Author would also highlights various challenges faced in IoT and Big Data integration by providing reviews of various authors.

关键词： Big Data Analytics Big Data Lambda Architecture(BDLA) Big Data Learning(BDL) IoT Map-Reduce nosql databases PIG SkyTree

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：