The SCoPE@Scuola initiative was born with the aim to inspire curiosity in high school students about High Performance computing (HPC) and parallel and distributedcomputing (PDC). The HPC/PDC world could be an interes...
详细信息
ISBN:
(数字)9783319751788
ISBN:
(纸本)9783319751788;9783319751771
The SCoPE@Scuola initiative was born with the aim to inspire curiosity in high school students about High Performance computing (HPC) and parallel and distributedcomputing (PDC). The HPC/PDC world could be an interesting matter for students because is a necessary tool to solve challenging problems in science and technology and it provides context where a plenty of knowledge acquired at school can find a real application. In fact, the themes related to HPC/PDC involve a large range of knowledge and skills: from mathematical modelling of problems to algorithm design, from software implementation to design and management of complex computer systems. The initiative, begun at the end of 2014, involved several schools in the Naples (Italy) district, and has also been used for work-based learning activities and projects aimed to avoid students "dropouts". The results collected during all the last years make us hopeful that such initiative could be useful both to increment students awareness about the utility in the real world of all the knowledge acquired at school and to help them in their future educational and/or working choices.
Cloud computing is the dominating paradigm in distributedcomputing. The most popular open source cloud solutions support different type of storage subsystems, because of the different needs of the deployed services (...
详细信息
ISBN:
(纸本)9780769549392;9781467353212
Cloud computing is the dominating paradigm in distributedcomputing. The most popular open source cloud solutions support different type of storage subsystems, because of the different needs of the deployed services (in terms of performance, flexibility, cost-effectiveness). In this paper, we investigate the supported standard and open source storage types and create a classification. We point out that the Internet Small Computer System Interface (iSCSI) based block level storage can be used for I/O intensive services currently. However, the ATA-over-Ethernet (AoE) protocol uses fewer layers and operates on lower level which makes it more lightweight and faster than iSCSI. Therefore, we proposed an architecture for AoE based storage support in OpenNebula cloud. The novel storage solution was implemented and the performance evaluation shows that the I/O throughput of the AoE based storage is better (32.5-61.5%) compared to the prior iSCSI based storage and the new storage solution needs less CPU time (41.37%) to provide the same services.
MapReduce is a popular computing framework for large-scale data processing. Practical experience shows that inappropriate configurations can result in poor performance of MapReduce jobs, however, it is challenging to ...
详细信息
ISBN:
(纸本)9780769557854
MapReduce is a popular computing framework for large-scale data processing. Practical experience shows that inappropriate configurations can result in poor performance of MapReduce jobs, however, it is challenging to pick out a suitable configuration in a short time. Also, current central resource scheduler may cause low resource utilization, and degrade the performance of the cluster. This paper proposes an online performance tuning system, JellyFish, to improve performance of MapReduce jobs and increase resource utilization in Hadoop YARN. JellyFish continually collects real-time statistics to optimize configuration and resource allocation dynamically during execution of a job. During performance tuning process, JellyFish firstly tunes configuration parameters by reducing the dimensionality of search space with a divide-and-conquer approach and using a model-based hill climbing algorithm to improve tuning efficiency;secondly, JellyFish re-schedules resources in nodes by using a novel elastic container that can expand and shrink dynamically according to resource usage, and a resource re-scheduling strategy to make full use of cluster resources. Experimental results show that JellyFish can improve performance of MapReduce jobs by an average of 24% for jobs run for the first time, and by an average of 65% for jobs run multiple times compared to default YARN.
Since the emergence of WSNs (Wireless Sensor Networks), various middleware architectures have been proposed to achieve a suitable abstraction from the distribution and management tasks of sensor devices. This allows u...
详细信息
ISBN:
(数字)9783642176258
ISBN:
(纸本)9783642176241
Since the emergence of WSNs (Wireless Sensor Networks), various middleware architectures have been proposed to achieve a suitable abstraction from the distribution and management tasks of sensor devices. This allows users to focus on application development. In the near future, WSNs will be more pervasive, common, and distributed. Programming on WSNs requires a novel programming paradigm and middleware, especially in distributed and heterogeneous WSNs. We propose Virtual Sensor Agent-Oriented Middleware (VSAM), a middleware system for distributed and heterogeneous WSNs, which provides data dissemination protocol-independent Application Programming Interface (API) and an integrated platform for sensor applications. VSAM makes it possible to integrate WSNs with traditional networks.
A distributed scheduling algorithm is proposed for achieving end-to-end flow max-min fairness in wireless multi-hop networks. The problem is modeled as an optimization problem by taking into account the MAC-layer cons...
详细信息
ISBN:
(纸本)9780769530499
A distributed scheduling algorithm is proposed for achieving end-to-end flow max-min fairness in wireless multi-hop networks. The problem is modeled as an optimization problem by taking into account the MAC-layer constraints. With dual programming and Lagrange relaxation, the problem is decomposed into two subproblems, one is for transport layer at the source node, and the other for MAC layer in the network. A max-price based max-min fair rate allocation algorithm is adopled for the transport layer subproblem and an algorithm based on integer programming is designed for scheduling link activities at MAC layer Simulation results show that the proposed algorithm can achieve conflict-free schedule for wireless links and provide max-min fairness for end-to-end flows efficiently.
Standardization of resource interfaces and behaviors is critical for realizing the grid vision. Most works up to now mainly focus on technologies of accessing remote and heterogeneous resources. A two-layer framework ...
详细信息
ISBN:
(纸本)9780769526942
Standardization of resource interfaces and behaviors is critical for realizing the grid vision. Most works up to now mainly focus on technologies of accessing remote and heterogeneous resources. A two-layer framework for selecting and accessing resources on computational grids is presented. It groups resources across organizations in an application oriented manner, and virtualizes each group of resources to be a set of stateful WEB services. These WEB services provide the capabilities for combining resources within, as well as across, organizations to prepare customized job execution environments as required. For every dynamically created execution environment, its lifecycle is allowed to span as long as desired to execute multiple jobs, and its interface and behaviors are standardized in an application oriented way. The framework has been implemented to virtualize resources in Harmonia, which is a software platform for coordinative computation and is utilized for developing the campus grid of Peking University.
We developed parallel algorithm for solving Vlasov-Poisson systems of equations using particle-in-cell method. It uses new technique of dynamic load balancing for processors, which are distributed between subdomains i...
详细信息
We developed parallel algorithm for solving Vlasov-Poisson systems of equations using particle-in-cell method. It uses new technique of dynamic load balancing for processors, which are distributed between subdomains in correspndance with the number of modeling particles located in the subdomain. Domain decomposition method combines grid (eulerian) method for solving Poisson equation with lagrangian paricle method for solving Vlasov equation. It takes into account physical features of the modeling nonstationary rotating disks (both 2D and 3D).
The ATLAS distributedcomputing (ADC) project delivers production tools and services for ATLAS offline activities such as data placement and data processing on the grid. The system has been capable of sustaining with ...
详细信息
The ATLAS distributedcomputing (ADC) project delivers production tools and services for ATLAS offline activities such as data placement and data processing on the grid. The system has been capable of sustaining with high efficiency the needed computing activities during the first run of LHC data taking, and has demonstrated flexibility in reacting promptly to new challenges. Databases are a vital part of the whole ADC system. The Oracle Relational Database Management System (RDBMS) has been addressing a majority of the ADC database requirements for many years. Much expertise was gained through the years and without a doubt will be used as a good foundation for the next generation PanDA (Production ANd distributed Analysis) and DDM (distributed Data Management) systems. In this paper we present the current production ADC database solutions and notably the planned changes on the PanDA system, and the next generation ATLAS DDM system called Rucio. Significant work was performed on studying different solutions to arrive at the best relational and physical database model for performance and scalability in order to be ready for deployment and operation in 2014.
In parallel Discrete Event Simulation (PDES), the simulation model is partitioned into a set of distinct Logical Processes (LPs) which are allowed to concurrently execute simulation events. In this work we present an ...
详细信息
ISBN:
(纸本)9781467323703;9781467323727
In parallel Discrete Event Simulation (PDES), the simulation model is partitioned into a set of distinct Logical Processes (LPs) which are allowed to concurrently execute simulation events. In this work we present an innovative approach to load-sharing on multi-core/multiprocessor machines, targeted at the optimistic PDES paradigm, where LPs are speculatively allowed to process simulation events with no preventive verification of causal consistency, and actual consistency violations (if any) are recovered via rollback techniques. In our approach, each simulation kernel instance, in charge of hosting and executing a specific set of LPs, runs a set of worker threads, which can be dynamically activated/deactivated on the basis of a distributed algorithm. The latter relies in turn on an analytical model that provides indications on how to reassign processor/core usage across the kernels in order to handle the simulation workload as efficiently as possible. We also present a real implementation of our load-sharing architecture within the ROme OpTimistic Simulator (ROOT-Sim), namely an open-source C-based simulation platform implemented according to the PDES paradigm and the optimistic synchronization approach. Experimental results for an assessment of the validity of our proposal are presented as well.
Virtual machine provides cloud computing services that offer computing resources to users through the Internet based on virtualization technology. Generally, supercomputing or gridcomputing has been used to process a...
详细信息
ISBN:
(纸本)9789813292444;9789813292437
Virtual machine provides cloud computing services that offer computing resources to users through the Internet based on virtualization technology. Generally, supercomputing or gridcomputing has been used to process a large scale job in scientific, technology, and engineering application problems. Currently, services for large scale parallel processing through idle virtual machines in cloud computing are not provided. Previously, the utilization rate of computing resources in cloud computing was low when users do not use virtual machines anymore or for a long period of time since all the rights in relation to the use of virtual machine are given to users. This study proposes a scheme that increase resource utilization of idle virtual machines and process a large scale job through the idle virtual machines. Basically, idle virtual machines are identified based on virtual machines created through OpenStack, and idle virtual machine-computing service (IVM-CS) is proposed.
暂无评论