distributed systems comprise a significant number of entities that must be properly coordinated to reach a goal. These systems present high turnover of elements, and demand for solutions that keep their coordination a...
详细信息
ISBN:
(纸本)9780769543512
distributed systems comprise a significant number of entities that must be properly coordinated to reach a goal. These systems present high turnover of elements, and demand for solutions that keep their coordination as decentralized as possible to avoid bottlenecks. The paper discusses why it is important to address these characteristics from a system's conception and proposes A-3, an innovative architectural solution that adopts the concept of group as an abstraction for organizing an application into semi-independent slices, providing a single and coherent view of these aggregates, and coordinating the interactions inside and among groups. The paper presents the A-3 model and defines it as an innovative architectural style, describes a Java-based framework that supports A-3 and provides users with the proper means to exploit the style, and exemplifies all the main concepts on a simple scenario where autonomous robotic vacuum cleaners are coordinated to properly clean a museum.
Large-scale e-science applications feature complex work-flows consisting of many computing modules. Mapping such workflows in distributed network environments and minimizing their latency are crucial to those applicat...
详细信息
ISBN:
(纸本)9781617828362
Large-scale e-science applications feature complex work-flows consisting of many computing modules. Mapping such workflows in distributed network environments and minimizing their latency are crucial to those applications that require fast system response and prompt user interaction. We model the time cost of each workflow component and design an efficient algorithm to compute the exact end-to-end delay of the entire workflow by explicitly accounting for the resource sharing dynamics. We further propose a workflow mapping approach to minimize the workflow latency using a recursive optimization procedure. The validity of the cost models and the accuracy of the latency computing algorithm are verified in comparison with an approximate solution, a dynamic system simulation program, and a workflow engine deployed in a real network. The performance superiority of the proposed mapping approach is illustrated by extensive simulation-based comparisons with existing algorithms.
Modern tracking and fusion settings involve multiple platforms in different locations, tracking different target tracks, focusing on different regions of interest, while using different update rates and sensor resolut...
详细信息
ISBN:
(纸本)9780819486240
Modern tracking and fusion settings involve multiple platforms in different locations, tracking different target tracks, focusing on different regions of interest, while using different update rates and sensor resolutions with the goal of providing increased situation awareness in the region by fusing together the diversity of information from each platform. In this paper, a decentralized, distributed fusion architecture is presented along with results and trade studies comparing performance to that of a centralized fusion architecture. The decentralized distributed architecture is designed to work with legacy tracking systems and uses an efficient message passing scheme to share information and coordinate tracks across a diverse group of platforms. This system does not rely on a central node and allows for track information to be maintained at the local level while utilizing track information from other platforms to increase situation awareness. We compare the performance between our distributed approach and a centralized system using simulated airborne sensors operating in overlapping regions of interest with target densities and routes chosen to demonstrate tradeoffs between the different architectures. Preliminary results show that the decentralized distributed system provides similar performance to the centralized fusion system in terms of situation awareness relative to traditional tracking metrics, but at the cost of using an increased communication bandwidth to provide frequent updates to neighboring platforms. Results demonstrate the tradeoff between flexibility and optimality - configuration of the distributed decentralized system to provide increased flexibility and robustness comes at the cost of reduced situation awareness as compared to the centralized system.
With the rise of network science as an exciting interdisciplinary research topic, efficient graph algorithms are in high demand. Problematically, many such algorithms measuring important properties of networks have as...
详细信息
ISBN:
(纸本)9780769543758
With the rise of network science as an exciting interdisciplinary research topic, efficient graph algorithms are in high demand. Problematically, many such algorithms measuring important properties of networks have asymptotic lower bounds that are quadratic, cubic, or higher in the number of vertices. For analysis of social networks, transportation networks, communication networks, and a host of others, computation is intractable. In these networks computation in serial fashion requires years or even decades. Fortunately, these same computational problems are often naturally parallel. We present here the design and implementation of a master-worker framework for easily computing such results in these circumstances. The user needs only to supply two small fragments of code describing the fundamental kernel of the computation. The framework automatically divides and distributes the workload and manages completion using an arbitrary number of heterogeneous computational resources. In practice, we have used thousands of machines and observed commensurate speedups. Writing only 31 lines of standard C++ code, we computed betweenness centrality on a network of 4.7M nodes in 25 hours.
In this paper two modal identification approaches appropriate for use in a distributed computing environment are applied to a full-scale, complex structure. The natural excitation technique (NExT) is used in conjuncti...
详细信息
ISBN:
(纸本)9780819485434
In this paper two modal identification approaches appropriate for use in a distributed computing environment are applied to a full-scale, complex structure. The natural excitation technique (NExT) is used in conjunction with a condensed eigensystem realization algorithm (ERA), and the frequency domain decomposition with peak-picking (FDD-PP) are both applied to sensor data acquired from a 57.5-ft, 10 bay highway sign truss structure. Monte-Carlo simulations are performed on a numerical example to investigate the statistical properties and sensitivity to noise of the two distributed algorithms. Experimental results are provided and discussed.
We design a distributed multi-channel P2P Video-on-Demand (VoD) system using "plug-and-play" helpers. Helpers are heterogenous "micro-servers" with limited storage, bandwidth and number of users th...
详细信息
ISBN:
(纸本)9780819487452
We design a distributed multi-channel P2P Video-on-Demand (VoD) system using "plug-and-play" helpers. Helpers are heterogenous "micro-servers" with limited storage, bandwidth and number of users they can serve simultaneously. Our proposed system has the following salient features: (1) it jointly optimizes over helper-user connection topology, video storage distribution and transmission bandwidth allocation;(2) it minimizes server load, and is adaptable to varying supply and demand patterns across multiple video channels irrespective of video popularity;and (3) it is fully distributed and requires little or no maintenance overhead. The combinatorial nature of the problem and the system demand for distributed algorithms makes the problem uniquely challenging. By utilizing Lagrangian decomposition and Markov chain approximation based arguments, we address this challenge by designing two distributed algorithms running in tandem: a primal-dual storage and bandwidth allocation algorithm and a "soft-worst-neighbor-choking" topology-building algorithm. Our scheme provably converges to a near-optimal solution, and is easy to implement in practice. Packet-level simulation results show that the proposed scheme achieves minimum sever load under highly heterogeneous combinations of supply and demand patterns, and is robust to system dynamics of user/helper churn, user/helper asynchrony, and random delays in the network.
In the present study we consider the parallel simulation on a peer-to-peer demonstrator for the computation of a 3D differential equations, which model the behavior of the continuous-flow electrophoresis problem. The ...
详细信息
ISBN:
(纸本)9783642218866;9783642218873
In the present study we consider the parallel simulation on a peer-to-peer demonstrator for the computation of a 3D differential equations, which model the behavior of the continuous-flow electrophoresis problem. The physical model considered is constituted by the Navier-Stokes equation coupled with a convection-diffusion equation and a Laplacian equation. By using appropriate discretization of the coupled boundary value problems, we can prove the convergence of synchronous and more generally asynchronous relaxation methods. Finally parallel experiments on the peer-to-peer demonstrator are presented and analyzed.
The LHC computing Grid (LCG) leads by CERN, has solved with the LCG File Catalog (LFC) the major problem of scaling the data management catalog. However, additional performance issues should be faced to deploy a painl...
详细信息
The LHC computing Grid (LCG) leads by CERN, has solved with the LCG File Catalog (LFC) the major problem of scaling the data management catalog. However, additional performance issues should be faced to deploy a painless catalog service. With this aim, we present a decentralized LFC server configuration, and its performance evaluation compared with the traditional LFC deployment. A performance analysis is shown, including not only the catalog server, but also analysing the client side overhead. We find that the LFC service has in the clients a relevant workload of the overall service. The experimental results show that the proposed LFC deployment for servers and clients, improves the performance of the service.
For a future WDM network to efficiently support distributed computing applications that require both execution by multiple geographically separated computing nodes and data transferring between them, traditional appro...
详细信息
ISBN:
(纸本)9781424415809
For a future WDM network to efficiently support distributed computing applications that require both execution by multiple geographically separated computing nodes and data transferring between them, traditional approaches to establishing lightpaths between given source destination pairs are not sufficient because a computing task may be executed on any one of several computing nodes having the necessary resources. Therefore, lightpath establishment has to be considered jointly with task assignment to achieve best performance. In this paper, we design and evaluate approaches to the joint optimization of the task assignment and lightpath establishment (TALE) problem. We first formulate the off-line version of the TALE problem and then devise a branch and bound algorithm to obtain the minimum number of wavelengths required to support a set of given jobs. In addition, we propose efficient heuristics to deal with the TALE problem in both off-line and on-line versions. Finally, we demonstrate and compare the performances of proposed heuristics through simulation.
Tantamount to the overall performance delivered by a Grid environment is the quality of the middleware on which distributed Grid applications can run. Due to its complex nature, this middleware can be difficult to inv...
详细信息
Tantamount to the overall performance delivered by a Grid environment is the quality of the middleware on which distributed Grid applications can run. Due to its complex nature, this middleware can be difficult to investigate in full detail and can also be problematic to tune efficiently, especially when running on a production type environment. Thanks to the BSC Monitoring Framework, a set of tools that can instrument and analyze Java applications as well as the entire system, we were able to undertake both global and fine-grained investigation into one of the most popular Grid middleware of the moment, Globus Toolkit 4. The steps taken, revealed some interesting findings and resulted in the detection of some job management problems in this middleware. Primarily, the main issue was that it was possible to reach a situation which caused jobs to be lost on the node due to an overloading amount of jobs being processed by the system. Again, the BSC-MF was used to investigate this issue further and helped extract a possible solution to prevent the node becoming a point of contention in the architecture. A simple but effective policy was formulated, which prioritized the finishing and acceptance of jobs over the response time and throughput, and was evaluated as a solution to the problem. It was determined that, due to the dynamic nature of the problem, it could be best resolved by adding self-managing capabilities to the middleware. Using the new policy, a prototype of an autonomous system was built and succeeded in allowing more jobs to be accepted and finished correctly. The improvement over the original GT4 middleware was significant and resulted in better performance by a factor of 30%. The path from investigation to development, as described in this paper, might serve as a guide to others involved in the field who are interested in extracting knowledge about a Grid node, extending the Grid middleware or adding self-managing behaviour to their applications. (C) 2010
暂无评论