Next-generation problem solving environments (PSEs) promise significant advances over those now available. they will span scientific disciplines and incorporate collaboration capabilities. they will host feature-detec...
详细信息
Next-generation problem solving environments (PSEs) promise significant advances over those now available. they will span scientific disciplines and incorporate collaboration capabilities. they will host feature-detection and other agents, allow data mining and pedigree tracking, and provide access from a wide range of devices. Fundamental changes in PSE architecture are required to realize these and other PSE goals. this paper focuses specifically on issues related to data management and recommends an approach based on open, metadata-driven repositories with loosely defined, dynamic schemas. Benefits of this approach are discussed and the redesign of the Extensible Computational Chemistry Environment's (Ecce) data storage architecture to use such a repository is described, based on the distributed authoring and versioning (DAV) standard. the suitability of DAV for scientific data, the mapping of the Ecce schema to DAV, and promising initial results are presented.
Data replication is a key issue in a data grid and can be managed in different ways and at different levels of granularity: for example, at the file level or the object level. In the high-energy physics community, dat...
详细信息
Data replication is a key issue in a data grid and can be managed in different ways and at different levels of granularity: for example, at the file level or the object level. In the high-energy physics community, data grids are being developed to support the distributed analysis of experimental data. We have produced a prototype data replication tool, the Grid Data Management Pilot (GDMP) that is in production use in one physics experiment, with middleware provided by the Globus toolkit used for authentication, data movement and other purposes. We present a new, enhanced GDMP architecture and prototype implementation that uses Globus data-grid tools for efficient file replication. We also explain how this architecture can address object replication issues in an object-oriented database management system. File transfer over wide-area networks requires specific performance tuning in order to gain optimal data transfer rates. We present performance results obtained with GridFTP, an enhanced version of FTP, and discuss tuning parameters.
the science of bioinformatics provides researchers withthe tools necessary to unravel the mysteries of life and evolution, discover cures for disease, and control the evolution of living organisms. To assist research...
详细信息
the science of bioinformatics provides researchers withthe tools necessary to unravel the mysteries of life and evolution, discover cures for disease, and control the evolution of living organisms. To assist researchers in managing the growing data processing and management demands associated with bioinformatics, we have created a production system that draws upon Grid based technologies to control several aspects of the process. We briefly discuss system architecture, results, and future directions of the project.
high-performancecomputing faces considerable change as the Internet and the Grid mature. Applications that once were tightly-coupled and monolithic are now decentralized, with collaborating components spread across d...
详细信息
high-performancecomputing faces considerable change as the Internet and the Grid mature. Applications that once were tightly-coupled and monolithic are now decentralized, with collaborating components spread across diverse computational elements. Such distributed systems most commonly communicate through the exchange of structured data. Definition and translation of metadata is incorporated in all systems that exchange structured data. We observe that the manipulation of this metadata can be decomposed into three separate steps: discovery, binding of program objects to the metadata, and marshaling of data to and from wire formats. We have designed a method of representing message formats in XML, using datatypes available in the XML Schema specification. We have implemented a tool, XMIT that uses such metadata and exploits this decomposition in order to provide flexible run-time metadata definition facilities for an efficient binary communication mechanism. We also demonstrate that the use of XMIT makes possible such flexibility at little performance cost.
the vision of computational grids promises an exciting future for highperformancecomputing (HPC). In the project presented we make a small but practical step toward the grand vision of pervasive HPC by using some of...
详细信息
ISBN:
(纸本)0769509517
the vision of computational grids promises an exciting future for highperformancecomputing (HPC). In the project presented we make a small but practical step toward the grand vision of pervasive HPC by using some of the prevailing Internet technologies to enable access of HPC anytime and anywhere. Specifically, the project focuses on HPC that could be accessed by using the World Wide Web. We have conducted experiments based on engineering/scientific applications. Examples include simulations of automated guided vehicles (hereafter AGVs for short) in container port operations, N-body and molecular simulations. We initially build systems based on an ad-hoc approach, whose merits and demerits are identified. then, we employ Jini technology to reconstruct the system architecture and present a more efficient and robust model. performance studies are also presented. the objectives are to explore and address relevant issues, evaluate various approaches, demonstrate a workable version and conduct experiments with actual Web-enabled applications. the result is that now we are able to partially realize the dream of using the HPCs anytime and anywhere through devices such as a wireless/mobile computer, as long as they are armed with a common Web browser.
Nowadays, most image processing systems are implemented using either MMX-optimized software libraries or, when time requirements are limited, expensive highperformance DSP-based boards. In this paper we present a tex...
详细信息
Nowadays, most image processing systems are implemented using either MMX-optimized software libraries or, when time requirements are limited, expensive highperformance DSP-based boards. In this paper we present a texture analysis co-processor concept that permits the efficient hardware implementation of statistical feature extraction, and hardware-software codesign to achieve high-performance low-cost solutions. We propose a hybrid architecture based on FPGA chips, for massive data processing, and digital signal processor (DSP) for floating-point computations. In our preliminary trials with test images, we achieved sufficient performance improvements to handle a wide range of real-time applications.
Retrograde analysis is an efficient exhaustive search method. It is a powerful tool that can be used in solving problems where end states have known values but starting states do not. It has been widely used to solve ...
详细信息
Retrograde analysis is an efficient exhaustive search method. It is a powerful tool that can be used in solving problems where end states have known values but starting states do not. It has been widely used to solve mathematically-precise games such as chess endgames, and is potentially usable in energy-minimization problems. With increasing computing power, both in speed and storage capacity, retrograde analysis will become more and more useful. this paper looks at successful applications to games, the challenges ahead and the modifications that are required to utilize distributed hardware. the power and the usefulness of retrograde analysis are still limited by the computing resources one has access to. Today, the best sequential retrograde algorithms are capable of solving problems with about 10/sup 9/ states in a few hours on a standard personal computer. Bigger problems need more powerful computers, or take much longer to solve, or are simply out of the reach of today's technologies. Introducing parallelism to retrograde analysis is a natural way to attack the bigger problems. there are today three main architectures available for doing parallel retrograde analysis, namely symmetric multiprocessor (SMP) systems, high-speed network-based distributed systems and Internet-based distributed systems. In this paper, we discuss some of the key issues in doing parallel retrograde analysis on these different architectures. Technical challenges are addressed in detail, as well as some examples and proposals. these examples and proposals are drawn from various board games, but the ideas can be applied to other problem domains.
Data grids are currently proposed solutions to large-scale data management problems, including efficient file transfer and replication. Large amounts of data and the world-wide distribution of data stores contribute t...
详细信息
Data grids are currently proposed solutions to large-scale data management problems, including efficient file transfer and replication. Large amounts of data and the world-wide distribution of data stores contribute to the complexity of the data management challenge. Recent architecture proposals and prototypes deal with replication of read-only files but do not address the replica synchronisation problem. We propose a new data grid service, called the Grid Consistency Service (GCS), that sits on top of existing data grid services and allows for replica update synchronisation and consistency maintenance. We give models for different levels of consistency, provided to the Grid user and discuss how they can be included into a replica consistency service for a data grid.
暂无评论