The selected aspects of design methodology of a telemetric system for monitoring civil engineering constructions-using fiber-optic strain sensors-are considered. Particular attention is paid to the design decisions co...
详细信息
The selected aspects of design methodology of a telemetric system for monitoring civil engineering constructions-using fiber-optic strain sensors-are considered. Particular attention is paid to the design decisions concerning the choice of a method for sensor calibration and measurand reconstruction, resulting requirements for computing power and their consequence on the distribution of dataprocessing in the considered telemetric system. The results of this study may be applied for designing a specific telemetric system with fiber-optic sensors of strain.
The Shipyard Management Information System is a computer-based system that processes data on virtually e^/ery element of operations within a United States Naval Shipyard. This thesis examines the characteristics and o...
详细信息
The Shipyard Management Information System is a computer-based system that processes data on virtually e^/ery element of operations within a United States Naval Shipyard. This thesis examines the characteristics and objectives of a general management information system and the philosophies of the Ship- yard Management Information System as envisioned by the Naval Sea Systems Command. The motivations for, and the characteristics of, distributedprocessing as they apply to management informations systems are presented. It will be shown how an effective distributed data processing system can be created from selective addition of equipment to, and purposeful personnel reorganiza- tion of, the dataprocessing configuration at Mare Island Naval Shipyard.
We have proposed a Web-based sensor network constructed of Web-based sensor nodes and a remote management system. The Web-based sensor nodes consist of communication units and measurement devices with Web servers. The...
详细信息
We have proposed a Web-based sensor network constructed of Web-based sensor nodes and a remote management system. The Web-based sensor nodes consist of communication units and measurement devices with Web servers. The management system has intelligent processing and rule-based function to manage them flexibly via the Internet and performs various image analyses easily with Web application services. By distributing the image analyses to Web application services, our proposed system provides versatile and scalable dataprocessing. We demonstrated that it can realize the desired image analyses effectively and perform complicated management by changing its operations depending on the results of analysis. (C) 2011 Elsevier B.V. All rights reserved.
With the development of synchrotron radiation sources and high-frame-rate detectors, the amount of experimental data collected at synchrotron radiation beamlines has increased exponentially. As a result, data processi...
详细信息
With the development of synchrotron radiation sources and high-frame-rate detectors, the amount of experimental data collected at synchrotron radiation beamlines has increased exponentially. As a result, dataprocessing for synchrotron radiation experiments has entered the era of big data. It is becoming increasingly important for beamlines to have the capability to process large-scale data in parallel to keep up with the rapid growth of data. Currently, there is no set of dataprocessing solutions based on the big data technology framework for beamlines. Apache Hadoop is a widely used distributed system architecture for solving the problem of massive data storage and computation. This paper presents a set of distributed data processing schemes for beamlines with experimental data using Hadoop. The Hadoop distributed File System is utilized as the distributed file storage system, and Hadoop YARN serves as the resource scheduler for the distributed computing cluster. A distributed data processing pipeline that can carry out massively parallel computation is designed and developed using Hadoop Spark. The entire dataprocessing platform adopts a distributed microservice architecture, which makes the system easy to expand, reduces module coupling and improves reliability.
In this era of distributed computing the trend in medical informatics is toward achieving two goals: the availability of software applications and medical information anywhere and anytime and the invisibility of compu...
详细信息
In this era of distributed computing the trend in medical informatics is toward achieving two goals: the availability of software applications and medical information anywhere and anytime and the invisibility of computing. The six papers in this special issue provide an overview of the most promising prospects for the state-of-the-art and emerging field of image, signal, and distributed data processing for networked eHealth applications.
The Systolic Hypertension in the Elderly Program (SHEP) Pilot was a collaborative clinical trial that distributed to the clinics all dataprocessing tasks except for randomization assignment codes and morbidity and mo...
详细信息
The Systolic Hypertension in the Elderly Program (SHEP) Pilot was a collaborative clinical trial that distributed to the clinics all dataprocessing tasks except for randomization assignment codes and morbidity and mortality data. The clinics used customized programs to enter and verify data interactively, to maintain their own local master files, and to transmit the data electronically to the Coordinating Center. We measured quality control based on criteria from centralized as well as distributed models: the error rate for baseline forms was 0.5 per 1000 items. Ninety-eight percent of the forms were query-free, and a central reentry of the data in a 5% sample yielded a miskey rate of 2 per 1000 items. The potential problems of distributed data processing are vulnerability of the local master files and the time demands on Coordinating Center programmers for maintaining clinic computer systems. The advantages are the active involvement of clinical staff in their own quality control, the functional accessibility of the clinics to the Coordinating Center in controlling protocol decisions and data monitoring, and the level of accuracy, completeness, and timeliness of the data that can be achieved.
In recent years, research on big data, data storage and other topics that represent innovations in the analytics field has become very popular. This paper describes a proposal of a big web data application and archive...
详细信息
ISBN:
(纸本)9783319243061;9783319243054
In recent years, research on big data, data storage and other topics that represent innovations in the analytics field has become very popular. This paper describes a proposal of a big web data application and archive for the distributed data processing with Apache Hadoop, including the framework with selected methods, which can be used with this platform. It proposes a workflow to create a web content mining application and a big data archive, which uses modern technologies like Python, PHP, JavaScript, MySQL and cloud services. It also shows the overview about the architecture, methods and data structures used in the context of web mining, distributedprocessing and big data analytics.
Current trends, such as the increase in the number of Internet-connected devices, exponential growth of data volumes, development of cloud technologies, change all spheres of economy and business. Global network traff...
详细信息
ISBN:
(纸本)9781728117393
Current trends, such as the increase in the number of Internet-connected devices, exponential growth of data volumes, development of cloud technologies, change all spheres of economy and business. Global network traffic growth dictates the business need to configure large-scale systems and networks. At the same time, the explosive growth of data transmission forces state and commercial enterprises to look for opportunities to quickly reduce current costs in the continuous implementation of new services and technologies. The paper proposes the development of a web-oriented digital platform of distributed data processing for rendering digital educational services for people with disabilities. In the quality of software implementation of the developed digital platform proposed to use PHP framework Pandora. The architecture of the digital platform is represented as UML class diagrams, plug-ins and widgets. The developed digital platform, thanks to a wide range of software tools and open APIs, implements the ability to quickly connect and deploy new digital services.
In recent years, distributeddata-processing frameworks have become popular for processing big data. However, in an HPC, where the computation and storage nodes are separated, the bandwidth between the computation and...
详细信息
ISBN:
(纸本)9798350370621
In recent years, distributeddata-processing frameworks have become popular for processing big data. However, in an HPC, where the computation and storage nodes are separated, the bandwidth between the computation and storage components is small, causing a reduction in dataprocessing throughput. Therefore, in this paper, data were stored on the computation node to solve the dataprocessing throughput degradation. We propose an I/O acceleration method that integrates Apache Arrow and CHFS. It leverages non-volatile memory, a state-of-the-art storage device, via CHFS and leverages CHFS from a distributed data processing framework via Apache Arrow's abstract file system API. The evaluation results showed that the system achieved up to 11.60 times higher bandwidth than when reading data from the parallel file system Lustre. This study also compared with Apache Arrow with BeeOND and UnifyFS, other ad hoc filesystems. The proposed Apache Arrow CHFS showed up to 1.67x/1.23x better write performance. The implementation is published at https://***/tsukuba-hpcs/arrow-chfs
In the paper a concept of the measuring instrument with distributed data processing, cooperating with PC is presented. A functional configuration of the instrument performing additional functions connected with measur...
详细信息
ISBN:
(纸本)9789638841001
In the paper a concept of the measuring instrument with distributed data processing, cooperating with PC is presented. A functional configuration of the instrument performing additional functions connected with measurement result accuracy assessment as well as respective algorithms are shown. The principles of cooperation with PC computer are discussed. The laboratory implementation of the designed instrument and scope of its use for teaching process is proposed.
暂无评论