检索结果-内蒙古大学图书馆

Acceleration for Deep Reinforcement Learning using parallel and distributed computing: A Survey

ACM computing SURVEYS 2025年第4期57卷 1-35页

作者： Liu, Zhihong Xu, Xin Qiao, Peng Li, Dongsheng Natl Univ Def Technol Changsha Peoples R China

Deep reinforcement learning has led to dramatic breakthroughs in the field of artificial intelligence for the past few years. As the amount of rollout experience data and the size of neural networks for deep reinforcement learning have grown continuously, handling the training process and reducing the time consumption using parallel and distributed computing is becoming an urgent and essential desire. In this article, we perform a broad and thorough investigation on training acceleration methodologies for deep reinforcement learning based on parallel and distributed computing, providing a comprehensive survey in this field with state-ofthe-art methods and pointers to core references. In particular, a taxonomy of literature is provided, along with a discussion of emerging topics and open issues. This incorporates learning system architectures, simulation parallelism, computing parallelism, distributed synchronization mechanisms, and deep evolutionary reinforcement learning. Furthermore, we compare 16 current open-source libraries and platforms with criteria of facilitating rapid development. Finally, we extrapolate future directions that deserve further research.

关键词： Deep reinforcement learning acceleration parallel and distributed computing large-scale

来源：评论

学校读者我要写书评

暂无评论

Nicaea: A Byzantine Fault Tolerant Consensus Under Unpredictable Message Delivery Failures for parallel and distributed computing

引用

IEEE TRANSACTIONS ON COMPUTERS 2025年第3期74卷 915-928页

作者： Jing, Guanlin Zou, Yifei Xu, Minghui Zhang, Yanqiang Yu, Dongxiao Shan, Zhiguang Cheng, Xiuzhen Ranjan, Rajiv Shandong Univ Inst Intelligent Comp Sch Comp Sci & Technol Qingdao 266237 Peoples R China State Informat Ctr Dept Informatizat & Ind Dev Beijing 100804 Peoples R China Newcastle Univ Sch Comp Newcastle Upon Tyne NE1 7RU England

Byzantine fault-tolerant (BFT) consensus is a critical problem in parallel and distributed computing systems, particularly with potential adversaries. Most prior work on BFT consensus assumes reliable message delivery and tolerates arbitrary failures of up to n3 nodes out of n total nodes. However, many systems face unpredictable message delivery failures. This paper investigates the impact of unpredictable message delivery failures on the BFT consensus problem. We propose Nicaea, a novel protocol enabling consensus among loyal nodes when the number of Byzantine nodes is below a new threshold, given by: (2-rho)(1-rho)2n-2-1 /(2-rho)(1-rho)2n-2+1n, where rho denotes the message failure rate. Theoretical proofs and experimental results validate Nicaea's Byzantine resilience. Our findings reveal a fundamental trade-off: as message delivery instability increases, a system's tolerance to Byzantine failures decreases. The well-known n3 threshold under reliable message delivery is a special case of our generalized threshold when rho = 0. To the best of our knowledge, this work presents the first quantitative characterization of unpredictable message delivery failures' impact on Byzantine fault tolerance in parallel and distributed computing.

关键词： Protocols Reliability Fault tolerant systems Fault tolerance distributed computing Consensus protocol Computational modeling Electronic mail Consensus algorithm Computers Byzantine fault-tolerance message delivery failure parallel and distributed computing

来源：评论

学校读者我要写书评

暂无评论

Pervasive parallel and distributed computing in a liberal arts college curriculum

引用

JOURNAL OF parallel and distributed computing 2017年 105卷 53-62页

作者： Newhall, Tia Danner, Andrew Webb, Kevin C. Swarthmore Coll Comp Sci Dept Swarthmore PA 19081 USA

We present a model for incorporating parallel and distributed computing (PDC) throughout an undergraduate CS curriculum. Our curriculum is designed to introduce students early to parallel and distributed computing topics and to expose students to these topics repeatedly in the context of a wide variety of CS courses. The key to our approach is the development of a required intermediate-level course that serves as an introduction to computer systems and parallel computing. It serves as a requirement for every CS major and minor and is a prerequisite to upper-level courses that expand on parallel and distributed computing topics in different contexts. With the addition of this new course, we are able to easily make room in upper-level courses to add and expand parallel and distributed computing topics. The goal of our curricular design is to ensure that every graduating CS major has exposure to parallel and distributed computing, with both a breadth and depth of coverage. Our curriculum is particularly designed for the constraints of a small liberal arts college, however, much of its ideas and its design are applicable to any undergraduate CS curriculum. (C) 2017 The Authors. Published by Elsevier Inc.

关键词： CS curriculum parallel and distributed computing

来源：评论

学校读者我要写书评

暂无评论

A Generic Framework for Building Heterogeneous Simulations of parallel and distributed computing Systems

引用

ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2017年第8期42卷 3357-3373页

作者： Dursun, Taner Dag, Hasan TUBITAK BILGEM UEKAE Gebze Kocaeli Turkey Kadir Has Univ Istanbul Turkey

There have been many systems available for parallel and distributed computing (PDC) applications such as grids, clusters, super-computers, clouds, peer-to-peer and volunteer computing systems. High-performance computing (HPC) has been an obvious candidate domain to take advantage of PDC systems. Most of the research on HPC has been conducted with simulations and has been generally focused on a specific type of PDC system. This paper, however, introduces a general purpose simulation model that can be easily enlarged for constructing simulations of many of the most well-known PDC system types. Although it might create a new vision for research activities in the simulation community, current simulation tools do not provide proper support for cooperation between software working in real-time and simulation time. In this paper, thus, we also present a promising approach for constructing hybrid simulations that offers great potential for many research areas. As a proof of concept, we implemented a prototype for our simulation model. Then, we are able to rely on this prototype to build simulations of various PDC systems. Thanks to hybrid simulation support of our model, we are able to combine and manage the simulated PDC systems with our previously developed policy-based management framework in simulation runs.

关键词： parallel and distributed computing High-performance computing Policy-based management Simulation

来源：评论

学校读者我要写书评

暂无评论

Introducing parallel and distributed computing concepts through the use of Flashcards and a Card Game

Introducing Parallel and Distributed Computing concepts thro...

引用

37th IEEE International parallel and distributed Processing Symposium (IPDPS)

作者： Smith, Mary L. Srivastava, Srishti Hawaii Pacific Univ Comp Sci Honolulu HI 96813 USA Univ Southern Indiana Comp Sci Evansville IN USA

ISBN: (纸本)9798350311990

This paper describes two active learning strategies to teach and review fundamental PDC concepts in early computer science courses. Questions were created based on eight PDC concept categories. In the first phase, flashcards were created for students to review the concepts. In the second phase, a card game called PDC Quest was created to allow groups of students to engage collaboratively in learning and reviewing the concepts.

关键词： parallel and distributed computing Student Engagement Active Learning Early Computer Science Undergraduate Curriculum Flash Cards Game

来源：评论

学校读者我要写书评

暂无评论

Integrating parallel and distributed computing Topics into an Undergraduate CS Curriculum at UESTC 29

Integrating Parallel and Distributed Computing Topics into a...

引用

29th IEEE International parallel and distributed Processing Symposium (IPDPS)

作者： Lu, Guoming Xu, Jie Liu, Jieyan Dai, Bo Gui, Shenglin Zhan, Siyu Univ Elect Sci & Technol China Sch Comp Sci & Engn Chengdu 611731 Peoples R China

ISBN: (纸本)9781467376846

In Fall 2013, we began participation in NSF/IEEE TCPP 2013 Early Adopters Program. This paper presents our efforts to incorporate parallel and distributed computing topics into our undergraduate computer science and engineering curriculum with the guide of the IEEE-TCPP model Curriculum. So far, TCPP recommended curriculum has been integrated eight courses, evaluations show our integration effort is successful. Evaluation also shows that practices such as lab/homework assignment effective improve students' conception, and contest club is a necessary complementarity of in-class courses.

关键词： parallel and distributed computing Curriculum reformation Computer Science undergraduate Curriculum

来源：评论

学校读者我要写书评

暂无评论

Lessons Learned after the Introduction of parallel and distributed computing Concepts into ECE Undergraduate Curricula at UTN-Bahia Blanca Argentina

Lessons Learned after the Introduction of Parallel and Distr...

引用

26th IEEE International parallel and distributed Processing Symposium (IPDPS) / Workshop on High Performance Data Intensive computing

作者： Iparraguirre, Javier Friedrich, Guillermo R. Coppo, Ricardo J. Univ Tecnol Nacl Dept Elect Engn Fac Reg Bahia Blanca Bahia Blanca Buenos Aires Argentina

ISBN: (纸本)9780769546766

In 2011 we introduced an elective course on parallel Processing into the ECE undergraduate curricula. UTN Bahia Blanca was one of the first Universities in Argentina that decided to teach OpenCL. During the same year, we also began participation in the NSF/IEEE TCCP 2011 Early Adopters Program. This work summarizes the lessons we learned in our endeavor of teaching parallel and distributed computing concepts. Additionally, it discusses future improvements to our teaching methods and proposes modifications to our initial curricula.

关键词： parallel and distributed computing Higher Education ECE undergraduate curricula

来源：评论

学校读者我要写书评

暂无评论

Teaching parallel and distributed computing Concepts in Simulation with WRENCH

Teaching Parallel and Distributed Computing Concepts in Simu...

引用

Workshop on Education for High Performance computing (EduHPC)

作者： Tanaka, Ryan da Silva, Rafael Ferreira Casanova, Henri Univ Hawaii Informat & Comp Sci Honolulu HI 96822 USA Univ Southern Calif Informat Sci Inst Marina Del Rey CA USA

ISBN: (纸本)9781728159751

Teaching topics related to high performance computing and parallel and distributed computing in a hands-on manner is challenging, especially at introductory, undergraduate levels. There is a participation challenge due to the need to secure access to a platform on which students can learn via hands-on activities, which is not always possible. There are also pedagogic challenges. For instance, any particular platform provided to students imposes constraints on which learning objectives can be achieved. These challenges become steeper as the topics being taught target more heterogeneous, more distributed, and/or larger platforms, as needed to prepare students for using and developing Cyberinfrastructure. To address the above challenges, we have developed a set of pedagogic activities that can be integrated piecemeal in university courses, starting at freshman levels. These activities use simulation so that students can experience hands-on any relevant application and platform scenarios. This is achieved by capitalizing on the capabilities of the WRENCH and SimGrid simulation frameworks. After describing our approach and the pedagogic activities currently available, we present results from an evaluation performed in an undergraduate university course.

关键词： Computer Science Education High Performance computing parallel and distributed computing Cyberinfrastructure Simulation

来源：评论

学校读者我要写书评

暂无评论

Impact of CUDA and OpenCL on parallel and distributed computing 8

Impact of CUDA and OpenCL on Parallel and Distributed Comput...

引用

8th International Conference on Electrical and Electronics Engineering (ICEEE)

作者： Abu Asaduzzaman Trent, Alec Osborne, S. Aldershof, C. Sibai, Fadi N. Wichita State Univ Elect Engn & Comp Sci Dept Wichita KS 67260 USA Prince Mohammad Bin Fahd Univ Dept Comp Engn Al Khobar Saudi Arabia

ISBN: (纸本)9781665440714

Along with high performance computer systems, the Application Programming Interface (API) used is crucial to develop efficient solutions for modern parallel and distributed computing. Compute Unified Device Architecture (CUDA) and Open computing Language (OpenCL) are two popular APIs that allow General Purpose Graphics Processing Unit (GPGPU, GPU for short) to accelerate processing in applications where they are supported. This paper presents a comparative study of OpenCL and CUDA and their impact on parallel and distributed computing. Mandelbrot set (represents complex numbers) generation, Marching Squares algorithm (represents embarrassingly parallelism), and Bitonic Sorting algorithm (represents distributed computing) are implemented using OpenCL (version 2.x) and CUDA (version 9.x) and run on a Linux-based High Performance computing (HPC) system. The HPC system uses an Intel i7-9700k processor and an Nvidia GTX 1070 GPU card. Experimental results from 25 different tests using the Mandelbrot Set generation, the Marching Squares algorithm, and the Bitonic Sorting algorithm are analyzed. According to the experimental results, CUDA performs better than OpenCL (up to 7.34x speedup). However, in most cases, OpenCL performs at an acceptable rate (CUDA speedup is less than 2x).

关键词： CUDA high performance computing OpenCL parallel and distributed computing performance analysis

来源：评论

学校读者我要写书评

暂无评论

An Undergraduate parallel and distributed computing Course in Multi-Core

An Undergraduate Parallel and Distributed Computing Course i...

引用

9th International Conference for Young Computer Scientists

作者： Li, Jianhua Guo, Weibin Zheng, Hong E China Univ Sci & Technol Dept Comp Sci & Engn Shanghai 200237 Peoples R China

ISBN: (纸本)9781424441983

Current undergraduate parallel and distributed computing course faces several problems such as neglecting the importance of the course, lack of programming practice, etc. As multi-core computers spreads, it is necessary to improve the course. The multi-core technology is included as an indispensable teaching material, parallel programming is enhanced and several practical projects are designed to help students in programming training. After the improvement, the course is more effective and suitable for the demands of the students.

关键词： parallel and distributed computing parallel programming multi-core undergraduate course

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：