Container technologies are seeing wider use at advanced computing facilities for managing highly complex applicationsthat must execute at multiple sites. However, in a distributed high throughput computing setting, t...
详细信息
ISBN:
(纸本)9781728168760
Container technologies are seeing wider use at advanced computing facilities for managing highly complex applicationsthat must execute at multiple sites. However, in a distributed high throughput computing setting, the unrestricted use of containers can result in the container explosion problem. If a new container image is generated for each variation of a job dispatched to a site, shared storage is soon exceeded. On the other hand, if a single large container image is used to meet multiple needs, the size of that container may become a problem for storage and transport. To address this problem, we observe that many containers have an internal structure generated by a structured package manager, and this information could be used to strategically combine and share container images. We develop LANDLORD to exploit this property and evaluate its performance through a combination of simulation studies and empirical measurement of high energy physics applications.
Block tridiagonal systems of linear equations arise in a wide variety of scientific and engineering applications. Recursive doubling algorithm is a well-known prefix computation-based numerical algorithm that requires...
详细信息
ISBN:
(纸本)9780769552071
Block tridiagonal systems of linear equations arise in a wide variety of scientific and engineering applications. Recursive doubling algorithm is a well-known prefix computation-based numerical algorithm that requires O(M-3 (N/P + logP)) work to compute the solution of a block tridiagonal system with N block rows and block size M on P processors. In real-world applications, solutions of tridiagonal systems are most often sought with multiple, often hundreds and thousands, of different right hand sides but withthe same tridiagonal matrix. Here, we show that a recursive doubling algorithm is sub-optimal when computing solutions of block tridiagonal systems with multiple right hand sides and present a novel algorithm, called the accelerated recursive doubling algorithm, that delivers O(R) improvement when solving block tridiagonal systems with R distinct right hand sides. Since R is typically similar to 10(2) - 10(4), this improvement translates to very significant speedups in practice. Detailed complexity analyses of the new algorithm with empirical confirmation of runtime improvements are presented. To the best of our knowledge, this algorithm has not been reported before in the literature.
Withthe development of information technology, real-time data stream processing(RTDSP) has become a popular research topic. the first step of RTDSP is collecting data, requiring a data collector to receive data from ...
详细信息
ISBN:
(纸本)9781538637906
Withthe development of information technology, real-time data stream processing(RTDSP) has become a popular research topic. the first step of RTDSP is collecting data, requiring a data collector to receive data from the source and send them to the sink. Apache Flume, a distributed and reliable framework, used for this purpose, has some limitations and drawbacks on load balancing and storage. In this paper, we aim to improve performance and availability for collecting unstable real-time big data stream. So we propose a new load balancing strategy based on the free memory size and a storage strategy of integration memory channel withthe multi-file channel to reduce the overhead of disk and network. Finally, the experimental results show that the availability and performance are improved under the condition of a poor network, high availability requirements, intense competition in memory resources and large data size. Specifically, the availability is higher than 99.999%, and the performance can be improved by 10%-50% under different conditions.
Anomaly diagnosis for distributed service plays an important role in communication network information system. Log analysis is the main method to undertake anomaly detection. In order to reduce the manual detection, w...
详细信息
ISBN:
(纸本)9781538637906
Anomaly diagnosis for distributed service plays an important role in communication network information system. Log analysis is the main method to undertake anomaly detection. In order to reduce the manual detection, we propose an anomaly detection method based on the time-weighted control flaw graph model. the border is split by a discrete degree strategy based on analyzing the time interval distribution and the time weight is selected to be k-means. Experiments show that our algorithm has good precision and recall in anomaly diagnosis. In real-world scenarios, it has a precision of 80% and a recall rate of 65% on average.
In recent years, chaos-based image cipher has been widely studied and a growing number of schemes based on permutation-substitution architecture have been proposed. To better meet the challenge of real-time secure ima...
详细信息
ISBN:
(纸本)9781538637906
In recent years, chaos-based image cipher has been widely studied and a growing number of schemes based on permutation-substitution architecture have been proposed. To better meet the challenge of real-time secure image communication applications, this paper suggests a new image encryption scheme using a parallel substitution. In the permutation stage, the Arnold cat map is employed to shuffle the pixel positions so as to erase the strong relationship between adjacent pixels. In the substitution stage, the scrambled image is firstly decomposed into eight bit-planes which are then parallelly mixed with keystreams generated by the chaotic logistic map. theoretically, the parallel substitution strategy runs eight times faster than the serial strategy on an 8-thread processor as the volume of data processed by each substitution unit is 1/8 of that of the input image. Experimental results show that the proposed parallel scheme runs more than five times faster than the serial scheme. Extensive security analysis is carried out with detailed analysis, demonstrating the satisfactory security of the proposed scheme.
distributed computing systems are widely used in mission-critical real-time applications like missile defense systems, aircraft control and sonar applications. Designing a low cost distributed computing system which s...
详细信息
ISBN:
(纸本)0818676140
distributed computing systems are widely used in mission-critical real-time applications like missile defense systems, aircraft control and sonar applications. Designing a low cost distributed computing system which satisfies all the stringent requirements of a given application is a difficult problem. this problem can be alleviated using Computer-Aided Synthesis (CAS) tools. Due to the large number of design alternatives, the CAS tools are compute intensive and can take a considerably long time even for medium sized real-time applications. In this paper, we describe a set of parallel synthesis algorithms which dynamically adapt to the number of available processors in a parallel computer system to substantially reduce the total turn-around time of the synthesis process.
As distributedapplications became more commonplace and more sophisticated, new programming languages and models for distributed programming were created. In the context of continuously increasing data flows in parall...
详细信息
ISBN:
(纸本)9781479959198
As distributedapplications became more commonplace and more sophisticated, new programming languages and models for distributed programming were created. In the context of continuously increasing data flows in parallelapplications, there is a renewed interest in the dataflow paradigm. this paper shows why AGAPIA language is suitable for dataflow programming. AGAPIA is capable of expressing massive parallelism in a manageable way for programmers, allowing building dynamic nodes and links in the data flow graph at runtime. the nodes of the dataflow graph, also called programs, are modular and reusable. the communication is transparent for users allowing them to concentrate on the high level flow and algorithm. A complete application and an analysis in terms of productivity and performance are presented in order to demonstrate the AGAPIA's capabilities.
In the context of large-scale distributed computing environments, among various DAG scheduling heuristics aiming at coping with severe uncertainties during task execution, those ones that try to maximize the paralleli...
详细信息
ISBN:
(纸本)9781538637906
In the context of large-scale distributed computing environments, among various DAG scheduling heuristics aiming at coping with severe uncertainties during task execution, those ones that try to maximize the parallelism of ready tasks seems to be promising. However, most of such heuristics consider only the DAG structure when making scheduling decision. When the information about task execution time (even though might be inaccurate) is given, it might be interesting to investigate whether this information should be taken into account during scheduling, and if yes, how to. this paper presents an adaptive priority based heuristic, which properly considers the task execution time estimate and the DAG structure attributes in the task prioritization. the evaluation result shows the proposed approach obtains better scheduling performance than existing solutions.
the problem of identifying faulty processors (or units) in diagnosable systems is considered. For the purpose of diagnosis, a system composed of interconnected independent heterogeneous processors is modeled using a c...
详细信息
ISBN:
(纸本)0769524346
the problem of identifying faulty processors (or units) in diagnosable systems is considered. For the purpose of diagnosis, a system composed of interconnected independent heterogeneous processors is modeled using a comparison graph, where tasks are assigned to pairs of processors and the results are compared. the agreements and disagreements among the units are the basis for identifying faulty processors. It is assumed that at most t processors can fail at the same time and that faults are permanent. In this paper, we introduce a new artificial-immune-based diagnosis approach using the comparison approach. the new approach has been implemented and evaluated using randomly generated diagnosable systems. Simulations results indicate that the immune approach is a viable addition to present diagnosis problems.
the Grid seems to be everywhere, with announcements appearing almost every day of Grid products, sales, and deployments from major vendors. However, in spite of the popularity of the term, there is often confusion as ...
详细信息
暂无评论