Building distributed grid applications is notoriously difficult: the complex interactions between concurrently running processes, middleware, operating systems, underlying devices, and interconnecting networks can lea...
详细信息
ISBN:
(纸本)0769522564
Building distributed grid applications is notoriously difficult: the complex interactions between concurrently running processes, middleware, operating systems, underlying devices, and interconnecting networks can lead to unpredictable and difficult to analyze errors. Yet debugging support for such systems is woefully inadequate;typically a central user interface coordinates a set of conventional debuggers. This structure leads to synchronization problems and is limited to debugging user-mode applications. In this paper we present the design and implementation of PDB, a pervasive debugger which executes in a virtualization layer underneath the entire distributed system. By running each node of a distributed application in a separate virtual environment atop the debugger PDB can exercise full control over the entire execution environment.
New parallel Normalized Explicit Preconditioned Conjugate Gradient - type methods are introduced for solving finite element systems on distributed memory MIMD systems. The performance and applicability of the proposed...
详细信息
A comprehensive study of the whole petabyte-scale archival data of astronomical observatories has a possibility of new science and new knowledge in the field, while it was not feasible so far due to lack of enough dat...
详细信息
ISBN:
(纸本)0769522564
A comprehensive study of the whole petabyte-scale archival data of astronomical observatories has a possibility of new science and new knowledge in the field, while it was not feasible so far due to lack of enough data analysis environment. The Grid Datafarm architecture is designed for global petabyte-scale data-intensive computing, which provides a Grid file system with file replica management for fault tolerance and load balancing, and parallel and distributed data computing support for a set of files, to meet with the requirements of the comprehensive study of the whole archival data. In the paper, we discuss about worldwide parallel and distributed data analysis in the observational astronomical field The archival data is stored, replicated and dispersed in a Gfarm file system. All the astronomical data analysis tools successfully access files in Gfarm file system without any code modification, using a syscall hooking library regardless of file replica locations. Performance evaluation of the parallel data analysis in several ways shows file-affinity process scheduling plays an essential role for scalable and efficient parallel file I/O performance. A data calibration tools shows scalable file I/O performance, and achieved the file I/O performance of 5.9 GB/sec and 4.0 GB/sec for reading and writing FITS files, respectively, using 30 cluster nodes (60 CPUs). On-demand file replica creation mitigates the overhead of access concentration. Another tool shows the performance improvement at a factor of six for reading a shared file by creating file replicas.
The parallel (and distributed) Discrete Event Simulation (PADS) community - over it's more than 20 years of existence has achieved remarkable results in getting the execution of simulations of discrete event syste...
详细信息
ISBN:
(纸本)0769521118
The parallel (and distributed) Discrete Event Simulation (PADS) community - over it's more than 20 years of existence has achieved remarkable results in getting the execution of simulations of discrete event systems faster, involving multiple, logically and/or physically dispersed, communicating computational resources. A solid, mature and empirically approved body of foundational concepts, models, systems, methods and algorithms are at hand and well documented in more than 50.000 pages of research papers. PADS simulation engines, model and software libraries, and operating systems have proven feasibility and applicability of these results in solving real world problems. Despite the (healthy) self-criticism of it's proponents ("Will the field survive?"), PADS was - and is - a success! With this talk we aim at a prospect for the challenges posed by the emerging new models of computational and communication, the evolving new paradigms of interaction and coordination, the new styles of system design, and even the availability of new technologies, for which - in my opinion - no other community qualifies better than the PADS community.
advances in network technologies and the emergence of Grid computing have, both increased the need and provided the infrastructure for computation and data intensive applications to run over collections of heterogeneo...
详细信息
ISBN:
(纸本)0769522564
advances in network technologies and the emergence of Grid computing have, both increased the need and provided the infrastructure for computation and data intensive applications to run over collections of heterogeneous and autonomous nodes. In the context of database query processing, existing parallelisation techniques cannot operate well in Grid environments because the way they select machines and allocate tasks compromises partitioned parallelism. The main contribution of this paper is the proposal of a low-complexity, practical resource selection and scheduling algorithm that enables queries to employ partitioned parallelism, in order to achieve better performance in a Grid setting.
The proceedings contain 23 papers from the conference on the 18th workshop on parallel and distributed Simulation, PADS 2004. The topics discussed include: Simulation validation using direct execution of wireless ad-h...
详细信息
ISBN:
(纸本)0769521118
The proceedings contain 23 papers from the conference on the 18th workshop on parallel and distributed Simulation, PADS 2004. The topics discussed include: Simulation validation using direct execution of wireless ad-hoc routing protocols;detailed OFDM modeling in network simulation of mobile ad-hoc networks;event reconstruction in time warp;just-in-time cloning;towards grid-aware time warp;and the effect of detail on ethernet simulation.
In this paper we discuss the peer to peer solution for the deployment of large scale numerical applications on distributed resources. We use the XtremWeb P2P middleware for managing the computational resources. This g...
详细信息
ISBN:
(纸本)0769522564
In this paper we discuss the peer to peer solution for the deployment of large scale numerical applications on distributed resources. We use the XtremWeb P2P middleware for managing the computational resources. This global computing platform, such as much current grid deployments, is currently dedicated to multi-parameters applications. Our goal is to use it for executing numerical parallel applications that require communications between tasks. We discuss the performances of a block based matrix-vector product deployed for two XtremWeb networks;a local one with 128 non dedicated PCs, and for 261 PCs distributed on two geographic sites: University of Lille I and Paris XI University at Orsay. We give an investigation of the scheduling schemes well adapted for such systems and applications. We also present the performances of out-of-core products and discuss relationship between out-of-core and peer-to-peer computing for numerical applications.
Designing fast parallel discrete event simulation systems for shared-memory parallel computers is simplified by the efficient communication operations enabled by the common memory space. The difficulties involved in d...
详细信息
ISBN:
(纸本)0769521118
Designing fast parallel discrete event simulation systems for shared-memory parallel computers is simplified by the efficient communication operations enabled by the common memory space. The difficulties involved in designing large shared-memory computers and the resulting high cost of even modest size systems has led to the proliferation of computer systems consisting of small shared-memory computers connected via low-latency message-passing interconnection networks. This paper describes how a network simulation system using a simulation kernel optimized for high performance operation on shared-memory parallel computers has been extended to operate on computers that mix shared-memory and message-passing paradigms. Results are presented showing that the system can achieve over 60 million simulated packet transmissions per second on 32 4-processor nodes. The results demonstrate the advantage of using a mixture of shared-memory and message-passing over using only message-passing in many cases.
We study the adaptation of an optimistic Time Warp kernel to cross-cluster computing on the Grid. Wide area communication, the primary source of overhead, is off-loaded onto dedicated routing processes. This allows th...
详细信息
ISBN:
(纸本)0769521118
We study the adaptation of an optimistic Time Warp kernel to cross-cluster computing on the Grid. Wide area communication, the primary source of overhead, is off-loaded onto dedicated routing processes. This allows the simulation processes to run at full speed and it thus significantly decreases the performance gap caused by the wide area distribution. Further improvements are obtained by employing message aggregation on the wide area links. We achieve many of our objectives for lazy cancellation and moderate communication, but high communication rates with aggressive cancellation remains a challenge.
The proceedings contains 13 papers from the conference on Ninth International workshop on High-Level parallel Programming Models and Supportive Environments. The topics discussed include: the multiloop programming con...
详细信息
The proceedings contains 13 papers from the conference on Ninth International workshop on High-Level parallel Programming Models and Supportive Environments. The topics discussed include: the multiloop programming construct;modeling master-worker application in POETRIES;abstraction for dynamic data distribution;the cascade high productivity language;techniques for wrapping scientific application to CORBA components;arches: an infrastructure for PSE development and DCA: a distributed CCA framework based on MPI.
暂无评论