The 2024 DEBS Grand Challenge addresses the topic of hard drive failure predictive maintenance, through analysis of data streams that contain SMART readings, reported by drives located in different groups of storage s...
详细信息
ISBN:
(纸本)9798400704437
The 2024 DEBS Grand Challenge addresses the topic of hard drive failure predictive maintenance, through analysis of data streams that contain SMART readings, reported by drives located in different groups of storage servers. This paper details the technical implementation of a solution that focuses primarily on parallelizing the data stream processing to obtain vertical scalability. When processing two queries concerning the addressed topic, and setting a threshold of a maximum 16 ms latency for responding, our solution obtained a throughput of about 57% out of the maximum possible when no processing is made on the data stream. We also describe an initial work-in-progress implementation of a distributed extension that relies on Apache Kafka, meant to further scale the throughput of the parallel solution and to address possible failure conditions of retrieving the input stream.
Based on Large Language Models (LLMs), AI chatbots are widely utilized in people's daily life. However, deploying general LLMs directly into domain-specific intelligent chatbots poses challenges due to their lack ...
详细信息
This paper studies an artificial intelligence cloud platform for the 5G era, specifically involving the fields of artificial intelligence, cloud computing and big data, including heterogeneous distributed cloud platfo...
详细信息
With the increasing penetration of inverter based renewable energy and distributed energy storages in nowadays' power systems, the system status and operation conditions are hard to track with traditional scheduli...
详细信息
ISBN:
(纸本)9798350378467;9798350367676
With the increasing penetration of inverter based renewable energy and distributed energy storages in nowadays' power systems, the system status and operation conditions are hard to track with traditional scheduling-based power system transient analysis approach, and more fast and efficient transient analysis methods are needed to address the power system dynamic security problems. This paper proposed a graph computing based power system transient analysis approach to achieve efficient and accurate solution for power system stability analysis. To overcome the data management challenges, a spatiotemporal graph model is constructed for efficient data management in power system transient analysis. Then, a graph computing based transient analysis method is proposed to leverage the parallelcomputing power to speed up the computational process. Finally, a power system transient analysis software is developed based on the graph computing based transient analysis method to validate the proposed approach.
For multiple distributed generation units (DG unit) parallel system, excessive fault current has adverse effects on the safe and stable operation of the utility grid. As a result, a fault current limitation control of...
详细信息
For multiple distributed generation units (DG unit) parallel system, excessive fault current has adverse effects on the safe and stable operation of the utility grid. As a result, a fault current limitation control of multiple DG units is developed in this paper to limit the fault current of related fault branch and ride through the associated fault conditions. The injection fault current amplitude and phase angle of each DG unit for grid-side converter are controlled through the point of common coupling (PCC) voltage support and fault current limitation to limit the total current amplitude at the corresponding fault location. The validity of the proposed control strategy has been verified by simulation and hardware-in-loop (HIL) experiment results. (c) 2022 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://***/licenses/by-nc-nd/4.0/).
We propose SCoOL, a programming model and its corresponding parallel runtime systems for implementing optimization problem solvers. In SCoOL, users specify what task is performed for a point in a given search space, a...
详细信息
ISBN:
(纸本)9798350383225
We propose SCoOL, a programming model and its corresponding parallel runtime systems for implementing optimization problem solvers. In SCoOL, users specify what task is performed for a point in a given search space, and what global information should be maintained during the search. The resulting optimization program is then efficiently executed in a BSP-style on a shared or distributed memory computers by a parallel runtime provided with the model. In the paper, we show details of our scalable runtime for distributed memory clusters, including algorithms for work stealing and tasks rebalancing. To benchmark the platform, we implement solutions to several optimization problems and provide performance analysis for Quadratic Assignment Problem, Parent Set Assignment, and Bayesian Networks Structure Learning. Our solvers show strong scaling on a cluster with 1,280 cores, significantly outperforming the current state-of-the-art solvers in Bayesian networks learning.
Cloud-edge collaborative computing paradigm is a promising solution to high-resolution video analytics systems. The key lies in reducing redundant data and managing fluctuating inference workloads effectively. Previou...
详细信息
ISBN:
(纸本)9798350386066;9798350386059
Cloud-edge collaborative computing paradigm is a promising solution to high-resolution video analytics systems. The key lies in reducing redundant data and managing fluctuating inference workloads effectively. Previous work has focused on extracting regions of interest (RoIs) from videos and transmitting them to the cloud for processing. However, a naive Infrastructure as a Service (IaaS) resource configuration falls short in handling highly fluctuating workloads, leading to violations of Service Level Objectives (SLOs) and inefficient resource utilization. Besides, these methods neglect the potential benefits of RoIs batching to leverage parallel processing. In this work, we introduce Tangram, an efficient serverless cloud-edge video analytics system fully optimized for both communication and computation. Tangram adaptively aligns the RoIs into patches and transmits them to the scheduler in the cloud. The system employs a unique "stitching" method to batch the patches with various sizes from the edge cameras. Additionally, we develop an online SLO-aware batching algorithm that judiciously determines the optimal invoking time of the serverless function. Experiments on our prototype reveal that Tangram can reduce bandwidth consumption and computation cost up to 74.30% and 66.35%, respectively, while maintaining SLO violations within 5% and the accuracy loss negligible.
As the world becomes more connected and new digital services emerge at a fast pace, the amount of network traffic increases rapidly. Consequently, processing requirements become more varied and drive the need for flex...
详细信息
ISBN:
(纸本)9798350363074;9798350363081
As the world becomes more connected and new digital services emerge at a fast pace, the amount of network traffic increases rapidly. Consequently, processing requirements become more varied and drive the need for flexible packet-processing designs, especially as in-network computing gains traction. Traditional approaches deploy hardware accelerators in a pipeline in the sequence that the associated tasks are supposed to be executed. Hence, they do not accommodate flows with different processing requirements and provide no possibility to remap flows to task sequences in runtime. In order to address these limitations, we propose FlexRoute, a fast, flexible and priority-aware packet-processing design that can process network traffic at a rate of over 100 Gbit/s on FPGAs. Our design consists of a reconfigurable parser and several processing engines that are arranged in a pipeline. The processing engines are equipped with processing units that execute specific tasks, flexible forwarding logic and priority-aware queuing/scheduling logic. We implement a prototype of FlexRoute in Verilog and evaluate it via cycle-accurate register-transfer level simulations. We also synthesize and implement our design on the Alveo U55C High Performance Compute Card and show its resource usage. The evaluation results demonstrate that FlexRoute can process packets of arbitrary size with different processing requirements at a traffic rate of about 70 Gbit/s significantly faster than two state-of-the-art flexible packet-processing designs.
In recent years, in order to accelerate the construction of new power systems, power companies have carried out a series of information system construction, generating a massive amount of power related business data, ...
详细信息
Extreme climate change is the major ecological crisis which mankind encounters at present. The core of coping with climate change is to reduce greenhouse gas emissions, among which is mainly carbon dioxide emissions f...
详细信息
Extreme climate change is the major ecological crisis which mankind encounters at present. The core of coping with climate change is to reduce greenhouse gas emissions, among which is mainly carbon dioxide emissions from fossil energy combustion. Energy substitution of large-scale new energy power generation is an effective solution to the problems. How to simulate and calculate such a large number of wind power generations for planning or stability analysis is a technical challenge, especially the detailed research on the interactive characteristics for hundreds of models with IGBT converter. In this technical field, inspired by the decentralized and distributed ideas of Ecological Marxism theory, decoupling and grid division calculation is carried out for the electromagnetic transient model of a large number of DFIGs. Through the design and development of the data-driven large-scale parallelcomputing framework, multi-stage high-speed task pipelined parallel calculation is realized. It effectively solves the calculation difficulties in matrix dimension disaster caused by the number increase of wind turbines, theoretically breaks the ceiling effect of fine-grain simulation for large-scale wind power generations, and also waveforms comparison verifies the feasibility and correctness. (C) 2022 The Author(s). Published by Elsevier Ltd.
暂无评论