检索结果-内蒙古大学图书馆

In-place query driven big data platform: Applications to post processing of environmental monitoring

In-place query driven big data platform: Applications to pos...

29th Workshop of the Pacific Rim Applications and Grid Middleware Assembly (PRAGMA) / International Clouds for Data Science Workshop

作者： Lee, Jen-Gaw Tsai, Whey-Fone Lee, Lung-Cheng Lin, Ching-Yao Lin, Hsi-Ching Tsuang, Ben-Jei NARL Natl Ctr High Performance Comp 7R&D 6th RdHsinchu Sci Pk Hsinchu 300 Taiwan Natl Chung Hsing Univ Taichung Taiwan

This paper describes the use of an experimental big data platform for applications of environmental monitoring associated with visualization of global climate forecast data and air quality model simulation and response. Environmental monitoring in general requires both capabilities of model simulation for forecast, and data processing for visualization and analyses. The in-place query driven big data platform, based on concepts of Query Driven Visualization and shared-nothing distributed database, thus is developed for the need. The system architecture of this experimental big data platform entails one master data node and 17 slave data nodes, while the system links to the National Center for High-performance Computing supercomputer, Advanced Large-scale Parallel Supercluster, and storage pool. For software implementation, the openSUSE operating system and MariaDB database are installed on all nodes. The master data node is responsible for metadata management and information integration and the 17 slave data nodes for distributed database and parallel model simulation, data visualization, and analyses. The application of global climate data visualization (Outgoing Longwave Radiation or OLR, temperature, rainfall, etc.) in the platform serves first to partition Network Common Data Form file data into shared-nothing distributed databases for partial visualization in slave data nodes, then integrated into whole visualization in the master node through Message Passing Interface communication. For the application of air quality management, we first accessed Taiwan Environmental Protection Administration (EPA) observed data in the master node. EPA observed data are replicated to distributed databases in slave nodes;and the air pollution model, Gaussian plume trajectory model, is replicated in all slave nodes for model simulation, which produces output data and associated image files in the local file system. The master node is able to collect whole image files through the

关键词： air pollution big data platform climate model distributed database in-place computing parallel visualization

来源：评论

学校读者我要写书评

暂无评论

A distributed Cloud-based Cyberinfrastructure Framework for Integrated Bridge Monitoring

A Distributed Cloud-based Cyberinfrastructure Framework for ...

引用

Conference on Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems

作者： Jeong, Seongwoon Hou, Rui Lynch, Jerome P. Sohn, Hoon Law, Kincho H. Stanford Univ Dept Civil & Environm Engn Stanford CA 94305 USA Univ Michigan Dept Civil & Environm Engn Ann Arbor MI 48109 USA Korea Adv Inst Sci & Technol Dept Civil & Environm Engn Daejeon 305701 South Korea

ISBN: (数字)9781510608221

ISBN: (纸本)9781510608221

This paper describes a cloud-based cyberinfrastructure framework for the management of the diverse data involved in bridge monitoring. Bridge monitoring involves various hardware systems, software tools and laborious activities that include, for examples, a structural health monitoring (SHM), sensor network, engineering analysis programs and visual inspection. Very often, these monitoring systems, tools and activities are not coordinated, and the collected information are not shared. A well-designed integrated data management framework can support the effective use of the data and, thereby, enhance bridge management and maintenance operations. The cloud-based cyberinfrastructure framework presented herein is designed to manage not only sensor measurement data acquired from the SHM system, but also other relevant information, such as bridge engineering model and traffic videos, in an integrated manner. For the scalability and flexibility, cloud computing services and distributed database systems are employed. The information stored can be accessed through standard web interfaces. For demonstration, the cyberinfrastructure system is implemented for the monitoring of the bridges located along the I-275 Corridor in the state of Michigan.

关键词： Bridge monitoring bridge management cloud computing distributed database

来源：评论

学校读者我要写书评

暂无评论

Bringing Modular Concurrency Control to the Next Level 17

Bringing Modular Concurrency Control to the Next Level

引用

ACM International Conference on Management of Data

作者： Su, Chunzhi Crooks, Natacha Ding, Cong Alvisi, Lorenzo Xie, Chao Univ Texas Austin Austin TX 78712 USA Cornell Univ Ithaca NY 14853 USA Google Mountain View CA USA

ISBN: (纸本)9781450341974

This paper presents Tebaldi, a distributed key-value store that explores new ways to harness the performance opportunity of combining different specialized concurrency control mechanisms (CCs) within the same database. Tebaldi partitions conflicts at a fine granularity and matches them to specialized CCs within a hierarchical framework that is modular, extensible, and able to support a wide variety of concurrency control techniques, from single-version to multiversion and from lock-based to timestamp-based. When running the TPC-C benchmark, Tebaldi yields more than 20 x the throughput of the basic two-phase locking protocol, and over 3.7 x the throughput of Callas, a recent system that, like Tebaldi, aims to combine different CCs.

关键词： distributed database modular concurrency control transaction

来源：评论

学校读者我要写书评

暂无评论

An Efficient Approach for Data Replication in distributed database Systems

An Efficient Approach for Data Replication in Distributed Da...

引用

International Conference on Advances in Information Technology and Mobile Communication (AIM 2011)

作者： Yadav, Arun Kumar Agarwal, Ajay Rahmatkar, S. BMAS Engn Coll Dept Comp Sci Agra Uttar Pradesh India Krishna Inst Engn & Tech Dept MCA Ghaziabad Uttar Pradesh India Nagpur Inst Technol Dept Comp Sci Nagpur Maharashtra India

ISBN: (纸本)9783642205729

To increase the availability of data and fault tolerance in distributed database, it is better to add a backup server for each primary server in the system. So, the primary server and backup server must be connected to each other. To connect these computers to each other when they are at a long distance, it is necessary to use a leased line which needs to be charged as data is transferred. When packets are transferred between primary and backup server, more money need to be paid for charging this line. So if number of transferred packets between these computers can be reduced, the company can economize in its expenditures. Moreover, the number of transactions which should be performed in the backup server reduces. In order to achieve this, a new method is introduced which will reduce the number of transferred packets between primary and backup server. In this method, the replicated data of primary server on other computers is used as its backup.

关键词： distributed database Remote backup Data replication Load balancing filtering

来源：评论

学校读者我要写书评

暂无评论

Query Parsing in Order to Optimize distributed DB Structure 9

Query Parsing in Order to Optimize Distributed DB Structure

引用

9th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems - Technology and Applications (IDAACS)

作者： Fisun, Mykola Dvoretskyi, Mykhailo Shved, Alyona Davydenko, Yevhen Petro Mohyla Black Sea Natl Univ 1068 Desantnykiv St UA-54003 Mykolaiv Ukraine

This article considers problems of distributed database structure development connected with presenting similar data in different nodes. It is suggested to use the results of users SQL-queries parsing for optimizing D... 详细信息

ISBN: (纸本)9781538606971

关键词： information system distributed database distributed transaction the consolidated accounting database management system SQL-query workstation parsing profiling ANTLR data synchronization ETL-system

来源：评论

学校读者我要写书评

暂无评论

Multilevel Policy Based Security in distributed database 1

引用

1st International Conference on Advances in Computing and Communications

作者： Batra, Neera Singh, Manpreet Department of Computer Engineering M. M. Engineering College M. M. University Mullana

ISBN: (数字)9783642227097

ISBN: (纸本)9783642227080

Addressing security demands under fixed budgets and tight time constraints are becoming extremely challenging, time consuming and resource intensive. Moreover, securing the distributed database in compliance with several security guidelines makes the system more complex. Mission critical systems, military, government and financial institutions have been under tremendous pressure to secure their databases. Such requirements mandate that each system passes a strict security scan before it is deemed suitable to go into operational mode. This paper presents a framework that embeds security capabilities into distributed database by replicating different predefined security policies at different sites using multilevel secure database management system.

关键词： Policy based security Replication Multilevel secure database Covert channel distributed database

来源：评论

学校读者我要写书评

暂无评论

Non-Replicated Dynamic Fragment Allocation in distributed database Systems

引用

1st International Conference on Computer Science and Information Technology

作者： Mukherjee, Nilarun Bengal Inst Technol Dept CSE IT Kolkata W Bengal India

ISBN: (纸本)9783642178566

distributed databases have become the most essential technology for recent business organizations. The performance, efficiency and availability of a distributed database largely depend on the fragmentation of global relations and the allocation of those fragments at several sites of the network. In Non-Replicated fragment allocation scenario, the optimum allocation of the fragments is the only way, which can be exploited to increase the performance, efficiency, reliability and availability of the distributed database. In this paper, a new dynamic fragment allocation algorithm is proposed in Non-Replicated allocation scenario, which incorporates access threshold, time constraints of database accesses and most importantly the volume of data transmitted to dynamically reallocate fragments to sites at runtime in accordance with the changing access probabilities of nodes to fragments. It will decrease the migration of fragments and data transfer cost and will also improve the overall performance by dynamically reallocating fragments in a most intuitive manner.

关键词： distributed database Fragmentation Dynamic Fragment Allocation Local Agent Root Agent

来源：评论

学校读者我要写书评

暂无评论

A Comprehensive Survey on distributed Transactions based Data Partitioning

A Comprehensive Survey on Distributed Transactions based Dat...

引用

International Conference on Computing Communication Control and Automation

作者： R. D. Bharati V. Z. Attar Computer Engineering and IT Department College of Engineering Pune Pune India

ISBN: (纸本)9781538652589;9781538652572

distributed Transactional systems need to be fast and scalable to increase the performance of the system. Many distributed databases achieve high throughput and scalability through data partitioning. The paper presents comprehensive survey of different techniques and parameters related to distributed transactions used in the distributed databases. It specifies different ways of partitioning algorithms. The purpose of this review is to study the techniques of horizontal partitioning like range partitioning, schema level partitioning, graph level partitioning etc. giving the high performance and availability of data. The vital aim of these techniques is to reduce distributed transaction and increase scalability of distributed databases.

关键词： distributed database Data partitioning distributed transactions

来源：评论

学校读者我要写书评

暂无评论

Demand-Addressable Sensor Network: Toward Large-Scale Active Information Acquisition

引用

IEEE SENSORS JOURNAL 2016年第20期16卷 7421-7432页

作者： Miyazaki, Toshiaki Suematsu, Naoki Baba, Daisuke Li, Peng Guo, Song Kitamichi, Junji Hayashi, Takafumi Tsukahara, Tsuneo Univ Aizu Fukushima 9658580 Japan Univ Aizu Undergrad Sch Comp Sci & Engn Fukushima Japan Nippon Telegraph & Tel Corp Tokyo Japan Niigata Univ Grad Sch Niigata Niigata Japan Tokyo Univ Agr & Technol Tokyo Japan Osaka Univ Suita Osaka Japan Univ Tokyo Tokyo Japan

A new type of sensor network called the demand-addressable sensor network (DASN) is proposed in this paper. The DASN actively acquires the desired information by addressing user demands and delivers the information to appropriate destinations. This is in contrast to the conventional sensor networks that simply send sensed data to users. The DASN is useful for finding the desired information in a short duration of time from a large amount of sensed data generated by a large-scale sensor network. The DASN is constructed with a demand-addressable network that integrates many on-demand reconfigurable wireless sensor networks (ODRWSN) and other existing information and communications technology systems or services, such as Google Maps and Twitter. In addition to the demand-addressing mechanism, the demand-addressable network has an in-network data combining or mashup mechanism. The mashed up data are displayed on the user terminal using an ordinary Web browser without any requirement to install a dedicated application program. The functions of the ODRWSN can be dynamically customized by injecting roles specified by the user. Thus, the user can actively get the desired information by customizing the sensor network function. The main application of the DASN is wide-area disaster site monitoring, for which the DASN features outlined above are suitable. In this paper, the concept underlying the DASN, its architecture and implementation, and experimental results are presented.

关键词： Active sensing distributed database reconfigurable sensor node field-programmable gate array (FPGA)

来源：评论

学校读者我要写书评

暂无评论

In-place query driven big data platform: Applications to post processing of environmental monitoring

引用

CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE 2017年第13期29卷

关键词： air pollution big data platform climate model distributed database in-place computing parallel visualization

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：