检索结果-内蒙古大学图书馆

Data Fusion of Observability Signals for Assisting Orchestration of distributed applications

SENSORS 2022年第5期22卷 2061-2061页

作者： Tzanettis, Ioannis Androna, Christina-Maria Zafeiropoulos, Anastasios Fotopoulou, Eleni Papavassiliou, Symeon Natl Tech Univ Athens Sch Elect & Comp Engn Athens 10682 Greece

Nowadays, various frameworks are emerging for supporting distributed tracing techniques over microservices-based distributed applications. The objective is to improve observability and management of operational problems of distributed applications, considering bottlenecks in terms of high latencies in the interaction among the deployed microservices. However, such frameworks provide information that is disjoint from the management information that is usually collected by cloud computing orchestration platforms. There is a need to improve observability by combining such information to easily produce insights related to performance issues and to realize root cause analyses to tackle them. In this paper, we provide a modern observability approach and pilot implementation for tackling data fusion aspects in edge and cloud computing orchestration platforms. We consider the integration of signals made available by various open-source monitoring and observability frameworks, including metrics, logs and distributed tracing mechanisms. The approach is validated in an experimental orchestration environment based on the deployment and stress testing of a proof-of-concept microservices-based application. Helpful results are produced regarding the identification of the main causes of latencies in the various application parts and the better understanding of the behavior of the application under different stressing conditions.

关键词： observability distributed tracing microservices distributed applications edge computing orchestration exemplars

来源：评论

学校读者我要写书评

暂无评论

Modeling and Verification of Symbolic distributed applications Through an Intelligent Monitoring Agent

引用

IEEE ACCESS 2022年 10卷 94443-94457页

作者： Augello, Andrea Gaglio, Salvatore Lo Re, Giuseppe Peri, Daniele Univ Palermo Dept Engn Palermo Italy Natl Res Council CNR Inst High Performance Comp & Networking ICAR I-90146 Palermo Italy

Wireless Sensor Networks (WSNs) represent a key component in emerging distributed computing paradigms such as IoT, Ambient Intelligence, and Smart Cities. In these contexts, the difficulty of testing, verifying, and monitoring applications in their intended scenarios ranges from challenging to impractical. Current simulators can only be used to investigate correctness at source code level and with limited accuracy. This paper proposes a system and a methodology to model and verify symbolic distributed applications running on WSNs. The approach allows to complement the distributed application code at a high level of abstraction in order to test and reprogram it, directly, on deployed network devices. The proposed intelligent architecture enables the execution of distributed applications and the verification of the supplied correctness conditions. This paper shows the feasibility of the proposed approach and its effectiveness even when networks include resource-constrained nodes with some sample applications and quantitative experiments measuring the overhead introduced by the monitoring operations.

关键词： Wireless sensor networks Monitoring Debugging Codes Embedded systems distributed processing Fault diagnosis Knowledge engineering Software maintenance distributed applications embedded systems fault detection Internet of Things knowledge based systems software monitoring wireless sensor networks

来源：评论

学校读者我要写书评

暂无评论

L3NS: Large Scale Network Simulation for Testing distributed applications 22nd

L3NS: Large Scale Network Simulation for Testing Distributed...

引用

22nd International Conference on Computational Science and its applications (ICCSA)

作者： Malevanniy, Daniil Iakushkin, Oleg Korkhov, Vladimir St Petersburg State Univ 7-9 Univ Skaya Nab St Petersburg 199034 Russia

ISBN: (纸本)9783031105425;9783031105418

Complex distributed applications are highly depended on the quality of service of the underlying networks connecting their components. Common approaches for testing these applications may not be sufficient to ensure stability of a distributed system during networking issues. In this paper we try to explore the possibility of using lightweight virtualization for distributed application testing. Our approach is to use a set of tools provided by the Docker containerization platform to build a virtual network model of arbitrary topology with the tested application running inside. We explore scalability of this approach both when using one or more computers for modelling and try to show how the use of the developed simulation system named L3NS can allow developers to test and benchmark large-scale distributed systems e.g. blockchain networks.

关键词： Network simulator Containerization distributed applications

来源：评论

学校读者我要写书评

暂无评论

A Flexible Heuristic to Schedule distributed Analytic applications in Compute Clusters

引用

IEEE TRANSACTIONS ON CLOUD COMPUTING 2023年第3期11卷 2217-2230页

作者： Pace, Francesco Venzano, Daniele Carra, Damiano Michiardi, Pietro Eurecom Data Sci Dept F-06904 Sophia Antipolis France Univ Verona Comp Sci Dept I-37129 Verona Italy

This work addresses the problem of scheduling user-defined analytic applications, which we define as high-level compositions of frameworks, their components, and the logic necessary to carry out work. The key idea in our application definition, is to distinguish classes of components, including core and elastic types: the first being required for an application to make progress, the latter contributing to reduced execution times. We show that the problem of scheduling such applications poses new challenges, which existing approaches address inefficiently. Thus, we present the design and evaluation of a novel, flexible heuristic to schedule analytic applications, that aims at high system responsiveness, by allocating resources efficiently. Our algorithm is evaluated using trace-driven simulations and with large-scale real system traces: our flexible scheduler outperforms current alternatives across a variety of metrics, including application turnaround times, and resource allocation efficiency. We also present the design and evaluation of a full-fledged system, which we have called Zoe, that incorporates the ideas presented in this paper, and report concrete improvements in terms of efficiency and performance, with respect to prior generations of our system.

关键词： Scheduling distributed applications distributed systems

来源：评论

学校读者我要写书评

暂无评论

Offloading distributed applications onto SmartNICs using iPipe 19

Offloading Distributed Applications onto SmartNICs using iPi...

引用

Conference of the ACM-Special-Interest-Group-on-Data-Communication (SIGCOMM)

作者： Liu, Ming Cui, Tianyi Schuh, Henry Krishnamurthy, Arvind Peter, Simon Gupta, Karan Univ Washington Seattle WA 98195 USA Univ Texas Austin Austin TX 78712 USA Nutanix San Jose CA USA

ISBN: (纸本)9781450359566

Emerging Multicore SoC SmartNICs, enclosing rich computing resources (e.g., a multicore processor, onboard DRAM, accelerators, programmable DMA engines), hold the potential to offload generic datacenter server tasks. However, it is unclear how to use a SmartNIC efficiently and maximize the offloading benefits, especially for distributed applications. Towards this end, we characterize four commodity SmartNICs and summarize the offloading performance implications from four perspectives: traffic control, computing capability, onboard memory, and host communication. Based on our characterization, we build iPipe, an actor-based framework for offloading distributed applications onto SmartNICs. At the core of iPipe is a hybrid scheduler, combining FCFS and DRR-based processor sharing, which can tolerate tasks with variable execution costs and maximize NIC compute utilization. Using iPipe, we build a real-time data analytics engine, a distributed transaction system, and a replicated key-value store, and evaluate them on commodity SmartNICs. Our evaluations show that when processing 10/25Gbps of application bandwidth, NIC-side offloading can save up to 3.1/2.2 beefy Intel cores and lower application latencies by 23.0/28.0 mu s.

关键词： SmartNIC distributed applications

来源：评论

学校读者我要写书评

暂无评论

Sheaf Theory as a Mathematical Foundation for distributed applications Involving Heterogeneous Data Sets 32

Sheaf Theory as a Mathematical Foundation for Distributed Ap...

引用

32nd IEEE International Conference on Advanced Information Networking and applications (IEEE AINA)

作者： Mansourbeigi, Seyed M-H Utah State Univ Coll Engn Dept Comp Sci Logan UT 84322 USA

ISBN: (纸本)9781538653951

The goal of the present article is to demonstrate a mathematical modeling for distributed applications. The present paper applies tools from topology and sheaf theory as an appropriate mathematical modeling to reflect interactions among elements of distributed applications resources. Simplicial complexes are topological models for the network structure. Behavior of the objects in distributed network system are represented by sheaves. This modelling is applied for the study of the wild fire threat.

关键词： distributed applications Sheaf Simplicial Complex Stalks Cosheaf Homology Sheaf Cohomology

来源：评论

学校读者我要写书评

暂无评论

A Comparative Study of Parallel Programming Frameworks for distributed GPU applications 19

A Comparative Study of Parallel Programming Frameworks for D...

引用

16th ACM International Conference on Computing Frontiers (CF)

作者： Gu, Ruidong Becchi, Michela North Carolina State Univ Dept Elect & Comp Engn Raleigh NC 27695 USA

ISBN: (纸本)9781450366854

Parallel programming frameworks such as MPI, OpenSHMEM, Charm++ and Legion have been widely used in many scientific domains (from bioinformatics, to computational physics, chemistry, among others) to implement distributed applications. While they have the same purpose, these frameworks differ in terms of programmability, performance, and scalability under different applications and cluster types. Hence, it is important for programmers to select the programming framework that is best suited to the characteristics of their application types (i.e. its computation and communication patterns) and the hardware setup of the target high-performance computing cluster. In this work, we consider several popular parallel programming frameworks for distributed applications. We first analyze their memory model, execution model, synchronization model and GPU support. We then compare their programmability, performance, scalability, and load-balancing capability on homogeneous computing cluster equipped with GPUs.

关键词： Parallel computing distributed applications Homogeneous cluster

来源：评论

学校读者我要写书评

暂无评论

ElasTest - An Open Source Project for Testing distributed applications with Failure Injection

ElasTest - An Open Source Project for Testing Distributed Ap...

引用

IEEE Conference Network Function Virtualization and Software Defined Networks (NFV-SDN)

作者： Gortazar, Francisco Gallego, Micael Garcia, Boni Carella, Giuseppe Antonio Pauls, Michael Gheorghe-Pop, Ilie-Daniel URJC Comp Sci Madrid Spain Tech Univ Berlin Berlin Germany Fraunhofer FOKUS Berlin Germany

ISBN: (纸本)9781538632857

Testing large complex distributed applications in cloud environments is a complex task. Developing tests to assess these kind of applications is time-consuming, and requires adapting and integrating many different tools for different purposes. The main objective of this demonstration is two-folded. First, it introduces ElasTest, a flexible open source testing platform aimed at simplifying end-to-end testing for different types of applications, allowing developers and testers to assess their cloud applications in a real environment, elastic, and integrated. Second, it demonstrates cloud native application testing on top of the ElasTest platform.

关键词： Cloud Computing End-to-End Tests Testing distributed applications Autoscaling SDN NFV

来源：评论

学校读者我要写书评

暂无评论

Reliable self-deployment of distributed cloud applications

引用

SOFTWARE-PRACTICE & EXPERIENCE 2017年第1期47卷 3-20页

作者： Etchevers, Xavier Salaun, Gwen Boyer, Fabienne Coupaye, Thierry De Palma, Noel Orange Labs Meylan France Univ Grenoble Alpes Grenoble France

Cloud applications consist of a set of interconnected software elements distributed over several virtual machines, themselves hosted on remote physical servers. Most existing solutions for deploying such applications require human intervention to configure parts of the system, do not conform to functional dependencies among elements that must be respected when starting them, and do not handle virtual machine failures that can occur when deploying an application. This paper presents a self-deployment protocol that was designed to automatically configure a set of software elements to be deployed on different virtual machines. This protocol works in a decentralized way, that is, there is no need for a centralized server. It also starts the software elements in a certain order, respecting important architectural invariants. This protocol supports virtual machine and network failures and always succeeds in deploying an application when faced with a finite number of failures. Designing such highly parallel management protocols is difficult;therefore, formal modeling techniques and verification tools were used for validation purposes. The protocol was implemented in Java and was used to deploy industrial applications. Copyright (c) 2016 John Wiley & Sons, Ltd.

关键词： distributed applications software components automatic deployment robustness and reliability

来源：评论

学校读者我要写书评

暂无评论

CDMCR: multi-level fault-tolerant system for distributed applications in cloud

引用

SECURITY AND COMMUNICATION NETWORKS 2016年第15期9卷 2766-2778页

作者： Qiang, Weizhong Jiang, Changqing Ran, Longbo Zou, Deqing Jin, Hai Huazhong Univ Sci & Technol Serv Comp Technol & Syst Lab Wuhan 430074 Peoples R China Huazhong Univ Sci & Technol Cluster & Grid Comp Lab Sch Comp Sci & Technol Wuhan 430074 Peoples R China

Cloud provides users with a new model of utilizing the computing infrastructure with the ability to perform parallel and distributed computations using elastic virtual cluster. However, the multi-level and complex features make cloud computing system more prone to failure. In this paper, we present a multi-level fault-tolerant system for distributed applications in cloud named distributed-application oriented Multi-level Checkpoint/Restart for Cloud (CDMCR). The CDMCR system backups the complete state of applications periodically with a snapshot-based distributed checkpointing protocol, including file system state. Thus, we cannot only recover processes but also rollback data. A multi-level recovery strategy is proposed, which includes process-level recovery, virtual machine recreation, and host rescheduling, enabling comprehensive and efficient fault tolerance for different components in cloud. We deploy CDMCR as PaaS, so that users can be liberated from node management and system configuration and get access to fault-tolerant service conveniently. We have implemented this system based on the Xen virtualization platform and the OpenNebula cloud platform. Experiments on the prototype demonstrate the correctness of the system. Analysis shows that CDMCR does not cause message loss or data loss, and the backup time remains nearly constant as the number of nodes increases on virtual cluster. Copyright (c) 2015 John Wiley & Sons, Ltd.

关键词： virtual cluster distributed applications fault-tolerant

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：