检索结果-内蒙古大学图书馆

International Conference on Computing Communication Control and Automation

作者： Umesh Taware Nuzhat Shaikh Department of computer Engineering MES College of Engineering Pune India

ISBN: (纸本)9781538652589;9781538652572

Nowadays data is increasing at such high rate there is need of tool which can analyze this data in equally efficient matter, as this data analysis contributes to crucial decision making while dealing with day to day business scenarios. It is quite impractical to analyze this data with traditional relational database tools. There has been new growth in technologies which increases our ability to process to this data, Hadoop and nosql databases are some of the names that are very popular these for the same reason. In particular, Elasticsearch is most preferred tool now a days, it is text-based search engine developed by Apache Foundation. It is near real time, highly scalable and distributed tool to search, analyze and store your data. Hybrid database system proposes a solution to most common problem of increased data retrieval time as the size of data increases.

关键词： Elasticsearch Full-text search nosql database Search engine

来源：评论

学校读者我要写书评

暂无评论

A nosql data management infrastructure for bridge monitoring

引用

SMART STRUCTURES AND SYSTEMS 2016年第4期17卷 669-690页

作者： Jeong, Seongwoon Zhang, Yilan O'Connor, Sean Lynch, Jerome P. Sohn, Hoon Law, Kincho H. Stanford Univ Dept Civil & Environm Engn 473 Via Ortega Stanford CA 94305 USA Univ Michigan Dept Civil & Environm Engn 2350 Hayward St Ann Arbor MI 48109 USA Korea Adv Inst Sci & Technol Dept Civil & Environm Engn 291 Daehak Ro Taejon 305701 South Korea

Advances in sensor technologies have led to the instrumentation of sensor networks for bridge monitoring and management. For a dense sensor network, enormous amount of sensor data are collected. The data need to be managed, processed, and interpreted. Data management issues are of prime importance for a bridge management system. This paper describes a data management infrastructure for bridge monitoring applications. Specifically, nosql database systems such as MongoDB and Apache Cassandra are employed to handle time-series data as well the unstructured bridge information model data. Standard XML-based modeling languages such as OpenBrIM and SensorML are adopted to manage semantically meaningful data and to support interoperability. Data interoperability and integration among different components of a bridge monitoring system that includes on-site computers, a central server, local computing platforms, and mobile devices are illustrated. The data management framework is demonstrated using the data collected from the wireless sensor network installed on the Telegraph Road Bridge, Monroe, MI.

关键词： cyber infrastructure bridge monitoring bridge information modeling nosql database

来源：评论

学校读者我要写书评

暂无评论

A convergence of key-value storage systems from clouds to supercomputers

引用

CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE 2016年第1期28卷 44-69页

作者： Li, Tonglin Zhou, Xiaobing Wang, Ke Zhao, Dongfang Sadooghi, Iman Zhang, Zhao Raicu, Ioan IIT Dept Comp Sci Chicago IL 60616 USA Argonne Natl Lab MCS Div Lemont IL USA Hortonworks Palo Alto CA USA Univ Calif Berkeley AMP Lab Berkeley CA 94720 USA

This paper presents a convergence of distributed key-value storage systems in clouds and supercomputers. It specifically presents ZHT, a zero-hop distributed key-value store system, which has been tuned for the requirements of high-end computing systems. ZHT aims to be a building block for future distributed systems, such as parallel and distributed file systems, distributed job management systems, and parallel programming systems. ZHT has some important properties, such as being lightweight, dynamically allowing nodes join and leave, fault tolerant through replication, persistent, scalable, and supporting unconventional operations such as append, compare and swap, callback in addition to the traditional insert/lookup/remove. We have evaluated ZHT's performance under a variety of systems, ranging from a Linux cluster with 64 nodes, an Amazon EC2 virtual cluster up to 96 nodes, to an IBM Blue Gene/P supercomputer with 8K nodes. We compared ZHT against other key-value stores and found it offers superior performance for the features and portability it supports. This paper also presents several real systems that have adopted ZHT, namely, FusionFS (a distributed file system), IStore (a storage system with erasure coding), MATRIX (distributed scheduling), Slurm++ (distributed HPC job launch), Fabriq (distributed message queue management);all of these real systems have been simplified because of key-value storage systems and have been shown to outperform other leading systems by orders of magnitude in some cases. It is important to highlight that some of these systems are rooted in HPC systems from supercomputers, while others are rooted in clouds and ad hoc distributed systems;through our work, we have shown how versatile key-value storage systems can be in such a variety of environments. Copyright (c) 2015 John Wiley & Sons, Ltd.

关键词： nosql database distributed key-value store supercomputer cloud computing

来源：评论

学校读者我要写书评

暂无评论

A Configuration-Independent Score-Based Benchmark for Distributed databases

引用

IEEE TRANSACTIONS ON SERVICES COMPUTING 2016年第1期9卷 123-137页

作者： Ardagna, Claudio A. Damiani, Ernesto Frati, Fulvio Rebeccani, Davide Univ Milan Dipartimento Informat I-26013 Crema Italy Khalifa Univ Sci Technol & Res Etisalat British Telecom Innovat Ctr Abu Dhabi U Arab Emirates

The business potential of big data is leading to a data-driven economy, where low-cost and low-latency data analysis represents a major competitive advantage. The research community has proposed many technological solutions for big data, such as nosql databases, which are difficult to evaluate and compare via standard IT procurement procedures. In addition, lack of competences in big data domains make procurement of big data solutions a tedious and uncertain process, which might impair the success of a business. In this paper, we present a score-based benchmark for distributed databases, which supports adopters in selecting a solution that fits their needs. The proposed benchmark is independent from the configurations of the specific database and deployment environment, requires low effort on the part of end users, is extensible and can be applied to both SQL and nosql databases, can be used to evaluate databases according to different properties (e.g., performance, consistency), and can be integrated with existing benchmarks to reduce the burden of their execution. We experimentally evaluate our methodology to validate its effectiveness.

关键词： Big data cloud nosql database score-based benchmark

来源：评论

学校读者我要写书评

暂无评论

Logical Level Design of nosql databases

Logical Level Design of NoSQL Databases

引用

IEEE Region 10 Conference

作者： Shreya Banerjee Anirban Sarkar Department of Computer Applications National Institute of Technology Durgapur India

ISBN: (纸本)9781509025985

Now-a-days nosql databases have been potentially used for web-scale applications due its supports towards dynamic and flexible schema design and scalability. However, lack of a suitable database designing method for heterogeneous nosql databases create difficulties towards application developers and database designers to choose and design such databases effectively. To overcome this challenge, this paper proposes a systematic and rule based transformation mechanism to convert conceptual level nosql data model [6] into an equivalent logical level data model specified in JSON schema (Java Script Object Notation). Further, the correctness of the proposed transformation mechanism has been verified. Moreover, the proposed mechanism is illustrated using a case study.

关键词： Logical Level Data Model nosql database database Design Methodology Validation Transformation Rules

来源：评论

学校读者我要写书评

暂无评论

Cassandra and SQL database Comparison for Near Real-Time Twitter Data Warehouse

Cassandra and SQL Database Comparison for Near Real-Time Twi...

引用

International Seminar on Intelligent Technology and Its Applications (ISITIA) - Recent Trends in Intelligent Computational Technologies for Sustainable Energy

作者： Murazza, Muh. Rafif Nurwidyantoro, Arif Univ Gadjah Mada Dept Comp Sci & Elect Yogyakarta Indonesia

ISBN: (纸本)9781509017096

In the era of Big Data, social media analysis has grown extremely popular. Twitter, one of the most popular social media, is believed to contain many user opinion in its message. Thus, leading organizations start utilizing its data using social media analytic tools to get in-sight of their markets in real-time. However, many Twitter analytic tools are still specified only in some specific tasks. Therefore, in order to enhance the possibility of doing many analysis on Twitter, a data warehouse technology can be utilized to receive, process, and store a real-time Twitter streams. Nonetheless, data warehouse development using relational database start to show its limit on storing big data let alone real-time. Hence, nosql (Not Only SQL) technology has emerged as an alternative solution. In this paper, we try to develop near real-time Twitter data warehouse using nosql database, Cassandra, and compare its storing and querying performance with that developed using relational databases. The results show that Cassandra performs significantly better in storing data than the relational databases. Meanwhile, in its querying performance, Cassandra is slower while using small data but way faster on vast data.

关键词： casandra nosql database social media real time

来源：评论

学校读者我要写书评

暂无评论

A Cloud based Information Repository for Bridge Monitoring Applications

A Cloud based Information Repository for Bridge Monitoring A...

引用

Conference on Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems

作者： Jeong, Seongwoon Zhang, Yilan Hou, Rui Lynch, Jerome P. Sohn, Hoon Law, Kincho H. Stanford Univ Dept Civil & Environm Engn Stanford CA 94305 USA Univ Michigan Dept Civil & Environm Engn Ann Arbor MI 48109 USA Korea Adv Inst Sci & Technol Dept Civil & Environm Engn Daejeon 305701 South Korea

ISBN: (纸本)9781510600447

This paper describes an information repository to support bridge monitoring applications on a cloud computing platform. Bridge monitoring, with instrumentation of sensors in particular, collects significant amount of data. In addition to sensor data, a wide variety of information such as bridge geometry, analysis model and sensor description need to be stored. Data management plays an important role to facilitate data utilization and data sharing. While bridge information modeling (BrIM) technologies and standards have been proposed and they provide a means to enable integration and facilitate interoperability, current BrIM standards support mostly the information about bridge geometry. In this study, we extend the BrIM schema to include analysis models and sensor information. Specifically, using the OpenBrIM standards as the base, we draw on CSI Bridge, a commercial software widely used for bridge analysis and design, and SensorML, a standard schema for sensor definition, to define the data entities necessary for bridge monitoring applications. nosql database systems are employed for data repository. Cloud service infrastructure is deployed to enhance scalability, flexibility and accessibility of the data management system. The data model and systems are tested using the bridge model and the sensor data collected at the Telegraph Road Bridge, Monroe, Michigan.

关键词： Bridge information modeling OpenBrIM SensorML cloud service nosql database

来源：评论

学校读者我要写书评

暂无评论

Hug the Elephant: Migrating a Legacy Data Analytics Application to Hadoop Ecosystem 32

Hug the Elephant: Migrating a Legacy Data Analytics Applicat...

引用

32nd IEEE International Conference on Software Maintenance and Evolution (ICSME)

作者： Zhu, Feng Liu, Jie Wang, Sa Xu, Jiwei Xu, Lijie Ren, Jixin Ye, Dan Wei, Jun Huang, Tao Univ Chinese Acad Sci Beijing Peoples R China Chinese Acad Sci Inst Software State Key Lab Comp Sci Beijing Peoples R China Chinese Acad Sci Inst Software Beijing Peoples R China Chinese Acad Sci Inst Comp Beijing Peoples R China Xin Yi Hua Med Technol Co Zhengzhou Henan Peoples R China

ISBN: (纸本)9781509038060

Big data applications that rely on relational databases gradually expose limitations on scalability and performance. In recent years, Hadoop ecosystem has been widely adopted as an evolving solution. This paper presents the migration of a legacy data analytics application in a provincial data center. The target platform follows "no one size fits all" method. Considering different workloads, data storage is hybrid with distributed file system (HDFS) and distributed nosql database. Beyond the architecture re-design, we focus on the problem of data model transformation from relational database to nosql database. We propose a query-aware approach to free developers from tedious manual work. The approach generates query-specific views (NoView) for nosql and re-structures the views to align with nosql's data model. Our results show that the migrated application achieves high scalability and high performance. We believe that our practice provides valuable insights (such as nosql data modeling methodology), and the techniques can be easily applied to other similar migrations.

关键词： Hadoop Migration Data Model nosql database

来源：评论

学校读者我要写书评

暂无评论

Big Data Analytics Architecture for Agro Advisory System 23

Big Data Analytics Architecture for Agro Advisory System

引用

23rd Annual IEEE International Conference on High Performance Computing, Data, and Analytics (HiPCW)

作者： Shah, Purnima Hiremath, Deepak Chaudhary, Sanjay Ahmedabad Univ Sch Engn & Appl Sci Ahmadabad Gujarat India

ISBN: (纸本)9781509057733

Modern trends in the agriculture domain have made people realize the importance of big data. The key challenge of big data in agriculture is to identify the effectiveness of big data analytics. Moreover, how big data analytics can be used to improve the productivity in agricultural practices. The purpose of the proposed research is to reduce the technological gap between rural communities and information through recommendations and decision support system. The main contribution of this paper is to propose an open source, cost-effective and scalable big data analytics architecture for an Agro advisory system. As a part of implementation, an analytic framework for big data application development is built and implemented. Also, a prototype application for crop yield prediction is implemented for cotton crop in Ahmedabad district, Gujarat, India.

关键词： Big Data Big Data Analytics nosql database Multiple Linear Regression

来源：评论

学校读者我要写书评

暂无评论

Efficiency of nosql databases under a Moderate Application Load 10

Efficiency of NoSQL Databases under a Moderate Application L...

引用

10th International Workshop on databases in Networked Information Systems (DNIS)

作者： Arefin, Mohammad Shamsul Hossain, Khondoker Nazibul Morimoto, Yasuhiko Chittagong Univ Engn & Technol Comp Sci & Engn Dept Chittagong 4349 Bangladesh Hiroshima Univ Grad Sch Engn Hiroshima 730 Japan

ISBN: (纸本)9783319163130;9783319163123

Consider the fact, that the concepts of nosql databases have been developed and recently, big Internet companies such as Google, Amazon, Yahoo!, and Facebook are using nosql databases. Although the primary focus of nosql databases is to deal with huge volume of heterogeneous data, these can also be suited for handling moderate volume of data, especially if the data are heterogeneous and there are frequent changes in data. Considering this we consider the development and implementation of an application with moderate volume of heterogeneous data using a nosql database. We perform comparative performance analysis with a relational database system. The experimental evaluations show that nosql databases are also often suitable for handling moderate volume of data.

关键词： nosql database relational database data distribution mobile server

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：