检索结果-内蒙古大学图书馆

21st Asia-Pacific Network Operations and Management Symposium (APNOMS)

作者： Zheng, Weiwei Shen, Yanli Xiao, Taoshun China Acad Elect & Informat Technol 11 Shuangyuan RdHigh Tech Pk Beijing Peoples R China

ISBN: (纸本)9788995004388

Task allocation the problem of efficiently allocating a set of M tasks to a set of N nodes is a fundamental issue in distributed computing systems (DCSs). The problem is particularly challenging in the presence of fail-prone nodes. In this work, we design an adaptive task (re-)allocation mechanism, named Asocial. The Asocial allows us to optimize the utilization of system resources (including computing resources and network resources) while increasing service-level fault tolerance as well as failure resilience. In addition, we propose a cooperative game model based task (re-)allocation approach for cooperation among Physical Nodes (PNs). We consider both the performance states and reliability levels of candidate PNs when deploying tasks. Specifically, we exploit failure prediction techniques to evaluate PNs' reliability levels. As a result, we can utilize the resources efficiently and thus improve the service reliability (i.e., the probability of serving all the tasks before their delivery time). We show by means of numerical evaluations that the proposed Asocial can significantly improve service reliability, system availability as well as resource utilization. In particular, by using failure prediction result (F-measure is around 0.8), the application completion rate (ACR), the task completion rate (TCR) and the computing resource utilization (CRU) reach 85.20%, 85.67% and 78.34%, respectively. Compared with 67.30%, 70.07% and 65.79% of the initial allocation scheme, the performance achieves a significant improvement (26.60%, 22.26% and 19.08%, respectively).

关键词： Task re-allocation mechanism distributed computing systems failure prediction

来源：评论

学校读者我要写书评

暂无评论

SPSRG: a prediction approach for correlated failures in distributed computing systems

引用

CLUSTER computing-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS 2016年第4期19卷 1703-1721页

作者： Zheng, Weiwei Wang, Zhili Huang, Haoqiu Meng, Luoming Qiu, Xuesong Beijing Univ Posts & Telecommun State Key Lab Networking & Switching Technol Beijing Peoples R China

Failure instances in distributed computing systems (DCSs) have exhibited temporal and spatial correlations, where a single failure instance can trigger a set of failure instances simultaneously or successively within a short time interval. In this work, we propose a correlated failure prediction approach (CFPA) to predict correlated failures of computing elements in DCSs. The approach models correlated-failure patterns using the concept of probabilistic shared risk groups and makes a prediction for correlated failures by exploiting an association rule mining approach in a parallel way. We conduct extensive experiments to evaluate the feasibility and effectiveness of CFPA using both failure traces from Los Alamos National Lab and simulated datasets. The experimental results show that the proposed approach outperforms other approaches in both the failure prediction performance and the execution time, and can potentially provide better prediction performance in a larger system.

关键词： Correlated failures Failure prediction Probabilistic shared risk groups distributed computing systems

来源：评论

学校读者我要写书评

暂无评论

Fault tolerance methods for distributed computing systems

Fault tolerance methods for distributed computing systems

引用

International Conference on Actual Problems of Electronic Instrument Engineering (APEIE)

作者： P.V. Mishenko N.S. Tkachev Novosibirsk State Technical University Russia

The paper considers actual questions of organization of computing in distributed computing systems (DCS) which components are exposed to breakdowns. The consideration to terminology in the sphere of computing in DCS is given. The existing and expanding methods of computing process recovery after one of several nodes breakdown are discussing. The special attention is payed to the local checkpoints method and its realization in module of fault tolerance providing of NSTU computing Science department distributed computing system.

关键词： distributed computing systems parallel computing fault tolerance checkpoints

来源：评论

学校读者我要写书评

暂无评论

An Approach to Problem-Oriented Interfaces for Applications in distributed computing systems 4th

An Approach to Problem-Oriented Interfaces for Applications ...

引用

4th International Young Scientists Conference on Computational Science (YSC)

作者： Sorokin, Aleksei A. Korolev, Sergey P. Malkovsky, Sergey I. Tarasov, Alexei G. Mikhailov, Konstantin V. Russian Acad Sci Ctr Comp Far Eastern Branch Khabarovsk Russia

The paper describes the implementation of an efficient user interface for applied software in distributed computing systems. As part of this work, a software platform has been developed for the formation of problem-oriented interfaces for application software packages and components of distributed computing systems. The main purpose of the system is to simplify the input of technical settings, launch specific jobs if required and monitor all intermediate processes. Thus, it provides an intuitive user interface for working directly with an application system, and does not require knowledge of low-level operations. Using web services and modern information technology, the developed platform makes it possible to create a set of simple and convenient interfaces for researchers who use high-performance computer systems in their work. As an example, we describe the adaptation of the FHI98md code for a Grid system.

关键词： distributed computing systems problem-oriented interface database Representational State Transfer JavaScript Object Notation application programming interface web services Grid FHI98md

来源：评论

学校读者我要写书评

暂无评论

An Approach to Problem-oriented Interfaces for Applications in distributed computing systems

引用

Procedia Computer Science 2015年 66卷 458-467页

作者： Aleksei A. Sorokin Sergey P. Korolev Sergey I. Malkovsky Alexei G. Tarasov Konstantin V. Mikhailov Computing Center of the Far Eastern Branch Russian Academy of Sciences Khabarovsk Russia

关键词： distributed computing systems problem-oriented interface database Representational State Transfer JavaScript Object Notation application programming interface web services Grid FHI98md.

来源：评论

学校读者我要写书评

暂无评论

A Survey on Performance Modeling and Prediction for distributed DNN Training

引用

IEEE TRANSACTIONS ON PARALLEL AND distributed systems 2024年第12期35卷 2463-2478页

作者： Guo, Zhenhua Tang, Yinan Zhai, Jidong Yuan, Tongtong Jin, Jian Wang, Li Zhao, Yaqian Li, Rengang IEIT Syst Co Ltd Jinan 250101 Peoples R China Tsinghua Univ Beijing 100084 Peoples R China Beijing Univ Technol Beijing 100124 Peoples R China CAICT Beijing 100191 Peoples R China

The recent breakthroughs in large-scale DNN attract significant attention from both academia and industry toward distributed DNN training techniques. Due to the time-consuming and expensive execution process of large-scale distributed DNN training, it is crucial to model and predict the performance of distributed DNN training before its actual deployment, in order to optimize the design of distributed DNN training at low cost. This paper analyzes and emphasizes the importance of modeling and predicting the performance of distributed DNN training, categorizes and analyses the related state-of-the-art works, and discusses future challenges and opportunities for this research field. The objectives of this paper are twofold: first, to assist researchers in understanding and choosing suitable modeling and prediction tools for large-scale distributed DNN training, and second, to encourage researchers to propose more valuable research about performance modeling and prediction for distributed DNN training in the future.

关键词： Training Predictive models Computational modeling Optimization Costs Tensors Servers Pipelines Software Parallel processing distributed DNN training distributed computing systems large-scale machine learning performance modeling

来源：评论

学校读者我要写书评

暂无评论

Reliability of a distributed computing System With Performance Sharing

引用

IEEE TRANSACTIONS ON RELIABILITY 2022年第4期71卷 1555-1566页

作者： Xiao, Hui Yi, Kunxiang Peng, Rui Kou, Gang Southwestern Univ Finance & Econ Sch Stat Dept Management Sci & Engn Chengdu 611130 Peoples R China Hunan Univ Technol & Business Sch Management Changsha 410205 Peoples R China Beijing Univ Technol Sch Econ & Management Beijing 100124 Peoples R China Southwestern Univ Finance & Econ Sch Business Adm Fac Business Adm Chengdu 611130 Peoples R China

Existing research has been concentrated on improving the reliability of a distributed computing system through optimizing tasks allocation, providing software redundancy and providing hardware redundancy. None of these works considered the performance sharing mechanism in a distributed computing system. Different from other performance sharing systems whose reliability can be calculated directly, the reliability evaluation of a distributed computing system with performance sharing is more challenging since the reliability depends on the task execution time of each processor after performance sharing. This research considers a distributed computing system with performance sharing mechanism such that the computing power can be redistributed among different processors in the system. A reliability model is proposed to evaluate the distributed computing system with performance sharing. An optimization model is formulated to derive the optimal performance sharing policy such that the system reliability can be maximized. Both analytic examples and numerical examples are carried out to illustrate the proposed model and algorithm.

关键词： Reliability Task analysis distributed computing Computational modeling Optimization Resource management Computers Common bus performance sharing distributed computing systems optimization system reliability universal generating function (UGF)

来源：评论

学校读者我要写书评

暂无评论

Load Balancing Methods for distributed Data Storage: Challenges and Opportunities

Load Balancing Methods for Distributed Data Storage: Challen...

引用

International Conference on Current Problems of Applied Mathematics and Computer systems, CPAMCS 2023

作者： Shiriaev, Egor North Caucasus Federal University Stavropol Russia

ISBN: (纸本)9783031640094

The increased demand for big data processing has led to the development of distributed computing and data storage technologies. However, building an efficient distributed system is a rather difficult task and has a few problems. The problems of building a distributed system are related to its security and reliability. In this paper, research is carried out related to increasing the reliability of a distributed storage system. During the study, an analysis of load balancing methods was carried out. Based on the analysis, a hybrid load balancing method was compiled. The hybrid method is based on the Least Connection and Weighted Round Robin methods. This method allows you to effectively balance the load in distributed storage systems, which increases their reliability. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

关键词： Big Data distributed computing systems distributed Storage systems Least Connection Load Balancing Weighted Round Robin

来源：评论

学校读者我要写书评

暂无评论

Algorithm for Distributing Incoming Messages Among Handlers 2nd

Algorithm for Distributing Incoming Messages Among Handlers

引用

2nd International Conference on Information Technologies and Their Applications

作者： Zverev, Ivan Zykina, Anna Omsk State Tech Univ 11 Mira Prospect Omsk Russia

ISBN: (纸本)9783031734199;9783031734205

In modern digital world, the amount of information is increasing dramatically. All this information requires immediate processing which can be done by automated systems. To accelerate processing in automated systems, new models, methods and efficient algorithms for their implementation are needed. The article considers the problem of distributing incoming messages to handlers in an automated system of an organization. The classical assignment problem and known methods of its solution are the mathematical basis for solving the problem. A generalization of the assignment problem with invalid combinations of assignments is considered as a model. A solution algorithm is developed and a software product for solving the described problem in the Python language is implemented. Moreover, numerical experiments are carried out to verify the quality of the developed algorithm and check its feasibility. The applied problem posed in this paper is relevant as in terms of its practical application and as the study of the mathematical model of the assignment problem and methods of its solution. The developed algorithm allows us to calculate the system load and regulate the number of handlers in operation. The obtained results can serve as input parameters for the simulation model of the incoming message processing system which will allow experimenting with the load of such a system.

关键词： Assignment Problem Mathematical Modeling distributed computing systems Equivalent Transformations Simulation Modeling Python

来源：评论

学校读者我要写书评

暂无评论

Reliablity and Security for Fog computing systems

引用

INFORMATION 2024年第6期15卷 317页

作者： Shiriaev, Egor Ermakova, Tatiana Bezuglova, Ekaterina Lapina, Maria A. Babenko, Mikhail North Caucasus Fed Univ Fac Math & Comp Sci Dept Computat Math & Cybernet Stavropol 355017 Russia Univ Appl Sci Engn & Econ Hsch Tech & Wirtschaft Sch Comp Commun & Business D-10318 Berlin Germany North Caucasus Fed Univ Inst Digital Dev Dept Informat Secur Automated Syst Stavropol 355017 Russia

Fog computing (FC) is a distributed architecture in which computing resources and services are placed on edge devices closer to data sources. This enables more efficient data processing, shorter latency times, and better performance. Fog computing was shown to be a promising solution for addressing the new computing requirements. However, there are still many challenges to overcome to utilize this new computing paradigm, in particular, reliability and security. Following this need, a systematic literature review was conducted to create a list of requirements. As a result, the following four key requirements were formulated: (1) low latency and response times;(2) scalability and resource management;(3) fault tolerance and redundancy;and (4) privacy and security. Low delay and response can be achieved through edge caching, edge real-time analyses and decision making, and mobile edge computing. Scalability and resource management can be enabled by edge federation, virtualization and containerization, and edge resource discovery and orchestration. Fault tolerance and redundancy can be enabled by backup and recovery mechanisms, data replication strategies, and disaster recovery plans, with a residual number system (RNS) being a promising solution. Data security and data privacy are manifested in strong authentication and authorization mechanisms, access control and authorization management, with fully homomorphic encryption (FHE) and the secret sharing system (SSS) being of particular interest.

关键词： fog computing distributed computing systems reliability fault tolerance data security

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：