检索结果-内蒙古大学图书馆

Segmenting large traces of inter-process communication with a focus on high performance computing systems

JOURNAL OF systems AND SOFTWARE 2016年第0期120卷 1-16页

作者： Alawneh, Luay Hamou-Lhadj, Abdelwahab Hassine, Jameleddine Jordan Univ Sci & Technol Dept Software Engn Irbid Jordan Concordia Univ Dept Elect & Comp Engn SBA Res Lab Montreal PQ Canada King Fahd Univ Petr & Minerals Dept Informat & Comp Sci Dhahran Saudi Arabia

The understanding of the interactions among processes of a high performance computing (HPC) system can be made easier if trace analysis is used. Traces, however, can be quite large, making it difficult to analyze their content unless some abstraction is provided. This paper presents a novel trace abstraction approach that aims to facilitate the analysis of large execution traces generated from HPC applications. Our approach allows automatic segmentation of large traces into smaller and meaningful clusters that reflect the various execution phases of the traced scenarios. Our approach is based on the application of information theory principles to the analysis of sequences of communication patterns extracted from traces of HPC systems. This work is inspired by recent studies in the field of bioinformatics where several techniques have been proposed to segment DNA sequences into homogeneous sub-domains, where each sub-domain exhibits a certain degree of internal homogeneity. Trace segments can be used in a number of applications such as recovering high-level views of the system behavior and program understanding. We demonstrate the usefulness of our approach by applying it to different traces of hundreds of millions of events, generated from two HPC systems. (C) 2016 Elsevier Inc. All rights reserved.

关键词： Dynamic analysis Trace abstraction and analysis Inter-process communication traces high performance computing systems Software maintenance Program comprehension

来源：评论

学校读者我要写书评

暂无评论

ScRNAbox: empowering single-cell RNA sequencing on high performance computing systems

引用

BMC BIOINFORMATICS 2024年第1期25卷 1页

作者： Thomas, Rhalena A. Fiorini, Michael R. Amiri, Saeid Fon, Edward A. Farhan, Sali M. K. McGill Univ Montreal Neurol Inst Hosp Dept Neurol & Neurosurg Montreal PQ H3A 2B4 Canada McGill Univ Montreal Neurol Inst Hosp Neuro Early Drug Discovery Unit Montreal PQ H3A 2B4 Canada McGill Univ Montreal Neurol Inst Hosp Dept Human Genet Montreal PQ H3A 2B4 Canada

BackgroundSingle-cell RNA sequencing (scRNAseq) offers powerful insights, but the surge in sample sizes demands more computational power than local workstations can provide. Consequently, high-performance computing (HPC) systems have become imperative. Existing web apps designed to analyze scRNAseq data lack scalability and integration capabilities, while analysis packages demand coding expertise, hindering *** response, we introduce scRNAbox, an innovative scRNAseq analysis pipeline meticulously crafted for HPC systems. This end-to-end solution, executed via the SLURM workload manager, efficiently processes raw data from standard and Hashtag samples. It incorporates quality control filtering, sample integration, clustering, cluster annotation tools, and facilitates cell type-specific differential gene expression analysis between two groups. We demonstrate the application of scRNAbox by analyzing two publicly available *** is a comprehensive end-to-end pipeline designed to streamline the processing and analysis of scRNAseq data. By responding to the pressing demand for a user-friendly, HPC solution, scRNAbox bridges the gap between the growing computational demands of scRNAseq analysis and the coding expertise required to meet them.

关键词： Single-cell RNA sequencing ScRNAseq high performance computing systems Pipeline

来源：评论

学校读者我要写书评

暂无评论

Mathematical Modeling of Thermal Stabilization of Vertical Wells on high performance computing systems

Mathematical Modeling of Thermal Stabilization of Vertical W...

引用

9th International Conference on Large-Scale Scientific Computations (LSSC)

作者： Pavlova, Natalia V. Vabishchevich, Petr N. Vasilyeva, Maria V. North Eastern Fed Univ Belinskogo Str 58 Yakutsk 677000 Russia Nucl Safety Inst Moscow 115191 Russia

ISBN: (纸本)9783662438800;9783662438794

Temperature stabilization of oil and gas wells is used to ensure stability and prevent deformation of a subgrade estuary zone. In this work, we consider the numerical simulation of thermal stabilization using vertical seasonal freezing columns. A mathematical model of such problems is described by a time-dependent temperature equation with phase transitions from water to ice. The resulting equation is a standard nonlinear parabolic equation. Numerical implementation is based on the finite element method using the package FEniCS. After standard purely implicit approximation in time and simple linearization, we obtain a system of linear algebraic equations. Because the size of freezing columns are substantially less than the size of the modeled area, we obtain mesh refinement near columns. Due to this, we get a large system of equations which are solved using high performance computing systems.

关键词： Stefan problem Finite element method FEniCS Thermal stabilization high performance computing systems

来源：评论

学校读者我要写书评

暂无评论

Towards a Common Metamodel for Traces of high performance computing systems to Enable Software Analysis Tasks 22

Towards a Common Metamodel for Traces of High Performance Co...

引用

22nd IEEE International Conference on Software Analysis, Evolution, and Reengineering (SANER)

作者： Alawneh, Luay Hamou-Lhadj, Abdelwahab Hassine, Jameleddine Jordan Univ Sci & Technol Dept Software Engn Irbid Jordan Concordia Univ SBA Res Lab Elect & Comp Engn Montreal PQ Canada King Fahd Univ Petr & Minerals Dept Informat & Comp Sci Dhahran Saudi Arabia

ISBN: (纸本)9781479984695

There exist several tools for analyzing traces generated from HPC (high performance computing) applications, used by software engineers for debugging and other maintenance tasks. These tools, however, use different formats to represent HPC traces, which hinders interoperability and data exchange. At the present time, there is no standard metamodel that represents HPC trace concepts and their relations. In this paper, we argue that the lack of a common metamodel is a serious impediment for effective analysis for this class of software systems. We aim to fill this void by presenting MTF2 (MPI Trace Format2)- a metamodel for representing HPC system traces. MTF2 is built with expressiveness and scalability in mind. Scalability, an important requirement when working with large traces, is achieved by adopting graph theory concepts to compact large traces. We show through a case study that a trace represented in MTF2 can be in average 49% smaller than a trace represented in a format that does not consider compaction.

关键词： high performance computing systems inter-process communication traces metamodeling HPC trace analysis

来源：评论

学校读者我要写书评

暂无评论

Quantum Computers for high-performance computing

引用

IEEE MICRO 2021年第5期41卷 15-23页

作者： Humble, Travis S. McCaskey, Alexander Lyakh, Dmitry, I Gowrishankar, Meenambika Frisch, Albert Monz, Thomas Oak Ridge Natl Lab Quantum Comp Inst Oak Ridge TN 37830 USA Alpine Quantum Technol A-6020 Innsbruck Austria Univ Innsbruck Inst Experimentalphys A-6020 Innsbruck Austria

Quantum computing systems are developing rapidly as powerful solvers for a variety of real-world calculations. Traditionally, many of these same applications are solved using conventional high-performance computing (HPC) systems, which have progressed sharply through decades of hardware and software improvements. Here, we present a perspective on the motivations and challenges of pairing quantum computing systems with modern HPC infrastructure. We outline considerations and requirements for the use cases, macroarchitecture, microarchitecture, and programming models needed to integrate near-term quantum computers with HPC system, and we conclude with the expectation that such efforts are well within reach of current technology.

关键词： Parallel Processing Quantum computing Quantum computing systems Powerful Solvers Real World Calculations high performance computing systems Software Improvements Pairing Quantum Modern HPC Infrastructure Near Term Quantum Computers HPC System

来源：评论

学校读者我要写书评

暂无评论

Modeling and Simulation Speed-Up of Plasma Actuators Implementing Reconfigurable Hardware

引用

AIAA JOURNAL 2018年第8期56卷 3035-3046页

作者： Ebrahimi, Abbas Zandsalimy, Mohammad Sharif Univ Technol Dept Aerosp Engn Tehran 111551639 Iran

The objective of the present study is to investigate the capability of field-programmable gate array hardware in numerical simulation of a model of a dielectric barrier discharge plasma actuator to accelerate the calculations. The reconfigurable hardware is designed such that it is possible to reprogram its architecture after manufacturing. This provides the capability to design and implement various architectures for several applications. Two reconfigurable chips are used in the present study, one of which consists of a programmable logic unit and a typical microprocessor. This hybrid architecture makes the high performance of the reconfigurable hardware in custom computing and the efficiency of the microprocessor in data flow control accessible. An automated design procedure is used for the design of the reconfigurable hardware. Further, a finite difference representation of a phenomenological model of a plasma actuator is derived and implemented on the field-programmable gate array hardware. The results are validated against other numerical data, and the computational time is compared to different conventional processors. Using the reconfigurable hardware results in up to 96% computational time reduction compared to a recent Core i7 processor.

关键词： Plasma Actuator Application Specific Integrated Circuits Numerical Simulation Dielectric Barrier Discharge high performance computing systems Digital Computers Graphics Processing Unit Electric Potential Application Programming Interface Discontinuous Galerkin Method

来源：评论

学校读者我要写书评

暂无评论

An exchange format for representing dynamic information generated from high performance computing applications

引用

FUTURE GENERATION COMPUTER systems-THE INTERNATIONAL JOURNAL OF ESCIENCE 2011年第4期27卷 381-394页

作者： Alawneh, Luay Hamou-Lhadj, Abdelwahab Concordia Univ Dept Elect & Comp Engn Montreal PQ H3G 1M8 Canada

high performance computing (HPC) systems tend to be complex to debug and analyze due to the large number of processes they involve and the way they communicate with each other to perform specific tasks. Recently, there has been an increase in the number of tools to help software engineers analyze the behavior of HPC applications. These tools provide several features that facilitate the understanding and analysis of the information contained in inter-process communication traces generated from running an HPC application. They, however, use different formats to represent traces, which hinders interoperability and sharing of data. In this paper, we address this by proposing an exchange format called MTF (MPI Trace Format) for representing and exchanging traces generated from HPC applications based on the MPI (Message Passing Interface) standard, which is a de facto standard for inter-process communication for high performance computing systems. The design of MTF is validated against well-known requirements for a standard exchange format, with an objective being to lead the work towards standardizing the way MPI traces are represented in order to allow better synergy among tools. We have also developed an MTF toolkit that supports the generation of MTF traces equipped with a query engine to facilitate the retrieval of data from MTF traces. Finally, we show how MTF can carry a large trace generated using a commercial off the shelf MPI trace analysis tool. Crown Copyright (C) 2010 Published by Elsevier B.V. All rights reserved.

关键词： high performance computing systems Inter-process communication traces Message passing interface Standard exchange format

来源：评论

学校读者我要写书评

暂无评论

Machine Learning-Based Temperature Prediction for Runtime Thermal Management Across System Components

引用

IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED systems 2018年第2期29卷 405-419页

作者： Zhang, Kaicheng Guliani, Akhil Ogrenci-Memik, Seda Memik, Gokhan Yoshii, Kazutomo Sankaran, Rajesh Beckman, Pete Northwestern Univ Dept Elect Engn & Comp Sci 2145 Sheridan Rd Evanston IL 60208 USA Argonne Natl Lab Math & Comp Sci Div 9700 South Cass Ave Argonne IL 60439 USA

Elevated temperatures limit the peak performance of systems because of frequent interventions by thermal throttling. Non-uniform thermal states across system nodes also cause performance variation within seemingly equivalent nodes leading to significant degradation of overall performance. In this paper we present a framework for creating a lightweight thermal prediction system suitable for run-time management decisions. We pursue two avenues to explore optimized lightweight thermal predictors. First, we use feature selection algorithms to improve the performance of previously designed machine learning methods. Second, we develop alternative methods using neural network and linear regression-based methods to perform a comprehensive comparative study of prediction methods. We show that our optimized models achieve improved performance with better prediction accuracy and lower overhead as compared with the Gaussian process model proposed previously. Specifically we present a reduced version of the Gaussian process model, a neural network-based model, and a linear regression-based model. Using the optimization methods, we are able to reduce the average prediction errors in the Gaussian process from 4: 2 degrees C to 2: 9 degrees C. We also show that the newly developed models using neural network and Lasso linear regression have average prediction errors of 2: 9 degrees C and 3: 8 degrees C respectively. The prediction overheads are 0.22, 0.097, and 0.026 ms per prediction for reduced Gaussian process, neural network, and Lasso linear regression models, respectively, compared with 0.57 ms per prediction for the previous Gaussian process model. We have implemented our proposed thermal prediction models on a two-node system configuration to help identify the optimal task placement. The task placement identified by the models reduces the average system temperature by up to 11: 9 degrees C without any performance degradation. Furthermore, these models respectively achieve 7

关键词： Thermal modeling many-core processors operating systems high performance computing systems

来源：评论

学校读者我要写书评

暂无评论

HPC and Cloud Convergence Beyond Technical Boundaries: Strategies for Economic Sustainability, Standardization, and Data Accessibility

引用

COMPUTER 2024年第6期57卷 128-136页

作者： Taufer, Michela Milroy, Daniel Gamblin, Todd Jones, Andrew Magro, Bill Poxon, Heidi Seelam, Seetharami Univ Tennessee High Performance Comp Knoxville TN 37996 USA Lawrence Livermore Natl Lab Livermore CA 94550 USA Microsoft Microsoft Azure Redmond WA 98052 USA Google LLC HPC Mountain View CA 94043 USA Amazon Web Serv Seattle WA 98109 USA IBM TJ Watson Res Ctr Armonk NY 10504 USA

At the IEEE/ACM International Conference for high-performance computing, Networking, Storage, and Analysis (SC23), held in Denver, experts discussed the convergence of high-performance computing and cloud computing. They explored how this integration could address current scientific computing limitations, enhance computational capabilities, and foster global collaboration while focusing on economic, security, technical, and community challenges and opportunities.

关键词： Data Access high performance computing Technical Boundaries Landscape Scientific Research Scalable Data Management Computer Science Cloud computing Technical Challenges Scientific Findings Rapid Advances Management Costs Security Measures Computational Capabilities Cloud Environment Foster Collaboration Cloud Providers Software Stack high performance computing systems Data Security Unique System Central Hub Application Programming Interface Cloud Platform Public Cloud Comprehensive Training Containerized Research Community Pricing Model

来源：评论

学校读者我要写书评

暂无评论

Reliability Guided Resource Allocation for Large-scale systems 6

Reliability Guided Resource Allocation for Large-scale Syste...

引用

6th IEEE International Conference on Cloud computing Technology and Science (CloudCom)

作者： Umamaheshwaran, Shruti Hacker, Thomas J. Purdue Univ Comp & Informat Technol W Lafayette IN 47907 USA Purdue Univ Discovely Pk NEEScomm W Lafayette IN 47907 USA

ISBN: (纸本)9781479940936

In high performance computing systems running on native hardware or cloud computing resources, parallel applications can reserve a large number of resources for long time periods. Resource failures trigger the failure of applications using this resource. Our investigation of large-scale systems in the field has revealed a difference in the operational reliability of nodes. By adding awareness of this difference to the scheduler along with the predicted reliability needs, we match reliable resources with the most demanding applications to reduce the probability of application failure. In this paper, we describe a new approach we developed to enhance reliability and reduce failure costs. Our approach partitions resources based on expected reliability and sizes each partition to bound the probability of blocking requests. Our approach can be used to size systems for peak loads with a bounded probability of blocking requests, and would be useful for operators seeking to improve the reliability and efficiency of systems.

关键词： cloud computing large-scale systems parallel processing probability reliability resource allocation system recovery application failure probability cloud computing resources high performance computing systems operational reliability parallel applications reliability guided resource allocation request blocking resource failures Checkpointing Computer hacking Equations Fault tolerance Fault tolerant systems Resource management

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：