distributed deep reinforcement learning(DDRL) has been used in distributedsystems.to better improve the adaptability. However, DDRL-based systems.are also inevitably under the threat of Byzantine workers. There is an...
详细信息
ISBN:
(纸本)9781665451321
distributed deep reinforcement learning(DDRL) has been used in distributedsystems.to better improve the adaptability. However, DDRL-based systems.are also inevitably under the threat of Byzantine workers. There is an urgent need to enhance the resilience of the DDRL-based system against Byzantine failures. This paper proposes a resilient mechanism for mitigating the influence of Byzantine workers on DDRL-based systems. First, we formalize the DDRL-based system as a multi-armed bandit model for well capturing the collective effect of workers on the whole learning process, and then transforming the resilient mechanism design problem into the sampling policy optimization problem. Second, we propose a self-adaptation process for filtering out the harmful data generated by Byzantine workers and theoretically give a mathematical analysis of the understanding, demonstrating its effectiveness under ideal conditions. Third, based on a typical DDRL-based system (i.e., Asynchronous Advantage Actor-Critic, A3C), we implement a resilient distributed A3C (ReD-A3C). With extensive experiments on the DDRL benchmark tasks, we show that ReD-A3C outperforms available Byzantine tolerant approaches.
The effectiveness of a performant high-availability system can be measured by the transaction operations' execution speed and reliability metrics. The performance and reliability of traditional database interactio...
详细信息
The problem of replica coordination is fundamental to building Byzantine fault-tolerant (BFT) distributedsystems. Seminal BFT architectures for safety-critical real-time systems.from the eighties and nineties relied ...
详细信息
ISBN:
(数字)9781665453462
ISBN:
(纸本)9781665453462
The problem of replica coordination is fundamental to building Byzantine fault-tolerant (BFT) distributedsystems. Seminal BFT architectures for safety-critical real-time systems.from the eighties and nineties relied on custom processors and networks, and are hence not readily usable today. Modern-day deployments on cloud platforms do not "scale down" to embedded platforms and are not designed around timeliness. Recent work on real-time BFT protocols focuses on simulations and reliability analyses. In short, there exist no easily programmable BFT libraries that can be conveniently retrofitted onto real-time applications with deadlines and that perform well on embedded platforms. We propose In-ConcReTeS, a BFT key-value store designed for building highly reliable control applications on commodity embedded platforms. At its core, In-ConcReTeS is a real-time friendly redesign and an efficient implementation of a BFT protocol used by seminal fault-tolerant architectures. We evaluated In-ConcReTeS using an inverted pendulum simulation and an automotive benchmark on a cluster of four Raspberry Pis connected over Ethernet. Our results show that, unlike Redis and etcd, In-ConcReTeS can repeatedly synchronize hundreds of key-value pairs, while tolerating faults, every tens of milliseconds.
Modern large-scale and small-scale data applications and processing solutions depend primarily on the distributeddatabase system. distributeddatabase servers are the most commonly used structures that give data avai...
详细信息
The healthcare industry is not immune to the trend of adopting new IT systems. and this includes hospitals and doctors' offices. To store a patient's medical history (including diagnoses and treatments), medic...
详细信息
ISBN:
(纸本)9798350340235
The healthcare industry is not immune to the trend of adopting new IT systems. and this includes hospitals and doctors' offices. To store a patient's medical history (including diagnoses and treatments), medical history (including diagnostic pictures), and financial data (including demographics and insurance details), a computerised database known as an "Electronic Health Record" (EHR) is used. Because medical records are typically private and must be shielded from prying eyes, ensuring their secure transfer is a top priority for healthcare systems. Electronic health records (EHRs) are used in the proposed study to ensure the security of all sent medical data, including the Chest X-ray MedPix images. This article describes a blockchain-based solution that patients can use to keep all their data in one secure location. This system was built with the Ganache tool on the Ethereum network, making use of Solidity and *** as well as other languages, tools, and approaches. In this study, a systematic method is described wherein blockchain smart contracts are used to record patient information and execute tasks in a distributed environment. After a smart contract has been deployed, all transactional communication occurs within its encrypted confines, protecting both the parties and their personal information. As an added bonus, the validated and broadcasted changes intended by the transaction can be checked. To ensure that government agencies have quick access to protected records, there is a cryptocurrency wallet (MetaMask) that stores the information in an encrypted, decentralised manner. Both patients and physicians can use the wallet to log in. In addition, the system will manage and protect all of the doctor and patient's information. Things like the following are in scope for the proposed system: Users may now access the same information at the same time because to blockchain's distributed ledger capabilities, which boosts productivity, establishes trust, and lowe
Communication channel failures are a major concern for the developers of modern fault-tolerant systems. However, while tight bounds for process failures are well-established, extending them to include channel failures...
详细信息
ISBN:
(纸本)9798400718854
Communication channel failures are a major concern for the developers of modern fault-tolerant systems. However, while tight bounds for process failures are well-established, extending them to include channel failures has remained an open problem. We introduce generalized quorum systems.-- a framework that characterizes the necessary and sufficient conditions for implementing atomic registers, atomic snapshots, lattice agreement and consensus under arbitrary patterns of process-channel failures. Generalized quorum systems.relax the connectivity constraints of classical quorum systems. instead of requiring bidirectional reachability for every pair of write and read quorums, they only require some write quorum to be unidirectionally reachable from some read quorum. This weak connectivity makes implementing registers particularly challenging, because it precludes the traditional request/response pattern of quorum access, making classical solutions like ABD inapplicable. To address this, we introduce novel logical clocks that allow write and read quorums to reliably track state updates without relying on bidirectional connectivity.
This paper addresses the need for innovative strategies in the e-commerce industry to meet rising customer expectations. With a focus on improving scalability and performance, the paper advocates microservices-based a...
详细信息
ISBN:
(数字)9798350382501
ISBN:
(纸本)9798350382518
This paper addresses the need for innovative strategies in the e-commerce industry to meet rising customer expectations. With a focus on improving scalability and performance, the paper advocates microservices-based architectures in distributed web systems. This study examines the literature on e-commerce and microservices in detail. Microservices provide agility, fast development cycles, and fault isolation, ensuring that e-commerce companies can effectively adapt to market changes. The proposed microservices-based architecture consists of small, independent services that can work together to create a single, robust e commerce application. However, implementing this type of architecture presents several technical challenges. One of these is the robustness of the microservices implementation. This article proposes a series of practical steps to successfully build an e commerce store, emphasizing the importance of microservices and focusing on reliability and robustness without sacrificing the scalable approach. It also provides a concrete example of implementing a back-end application using the virtualization provided by containers and technologies such as Python programming language, Django framework, PostgreSQL database. Finally, this article not only provides a detailed analysis of the advantages of microservice-based architectures in distributed web systems. but also serves as a practical guide and analysis of the current e-commerce context.
Orchestration systems.are becoming a key component to automatically manage distributed computing resources in many fields with criticality requirements like Industry 4.0 (14.0). However, they are mainly linked to OS-l...
详细信息
ISBN:
(数字)9781665476799
ISBN:
(纸本)9781665476805
Orchestration systems.are becoming a key component to automatically manage distributed computing resources in many fields with criticality requirements like Industry 4.0 (14.0). However, they are mainly linked to OS-level virtualization, which is known to suffer from reduced isolation. In this paper, we propose RunPHI with the aim of integrating partitioning hypervisors, as a solution for assuring strong isolation, with OS-level orchestration systems. The purpose is to enable container orchestration in mixed-criticality systems.with isolation requirements through partitioned containers.
We present Orion, a distributedsoftware-Defined Networking platform deployed globally in Google's datacenter (Jupiter) and Wide Area (B4) networks. Orion was designed around a modular, micro-service architecture ...
详细信息
ISBN:
(纸本)9781939133212
We present Orion, a distributedsoftware-Defined Networking platform deployed globally in Google's datacenter (Jupiter) and Wide Area (B4) networks. Orion was designed around a modular, micro-service architecture with a central publish-subscribe database to enable a distributed, yet tightly coupled, software-defined network control system. Orion enables intent-based management and control, is highly scalable and amenable to global control hierarchies. Over the years, Orion has matured with continuously improving performance in convergence (up to 40x faster), throughput (handling up to 1.16 million network updates per second), system scalability (supporting 16x larger networks), and data plane availability (50x, 100x reduction in unavailable time in Jupiter and B4, respectively) while maintaining high development velocity with bi-weekly release cadence. Today, Orion enables Google's software-Defined Networks, defending against failure modes that are both generic to large scale production networks as well as unique to SDN systems.
The proceedings contain 13 papers. The special focus in this conference is on Benchmarking, Measuring, and Optimizing. The topics include: Artemis: An Automatic Test Suite Generator for Large Scale OLAP database;OStor...
ISBN:
(纸本)9783030710576
The proceedings contain 13 papers. The special focus in this conference is on Benchmarking, Measuring, and Optimizing. The topics include: Artemis: An Automatic Test Suite Generator for Large Scale OLAP database;OStoreBench: Benchmarking distributed Object Storage systems.Using Real-World Application Scenarios;ConfAdvisor: An Automatic Configuration Tuning Framework for NoSQL database Benchmarking with a Black-box Approach;Optimization of the Himeno Benchmark for SX-Aurora TSUBASA;Parallel Sorted Sparse Approximate Inverse Preconditioning Algorithm on GPU;preface;characterizing the Sharing Behavior of Applications Using software Transactional Memory;ComScribe: Identifying Intra-node GPU Communication;a Benchmark of Ocular Disease Intelligent Recognition: One Shot for Multi-disease Detection;MAS3K: An Open Dataset for Marine Animal Segmentation;benchmarking Blockchain Interactions in Mobile Edge Cloud softwaresystems.
暂无评论