As the parameter scale of large-scale models continues to increase, distributed model training imposes significant communication overhead in data centers, resulting in reduced training efficiency. To address this chal...
详细信息
Currently, the efficiency improvement of complex technical systems is an urgent scientific task, which in numerous cases is formalized via optimization problem and solved by some well-known optimization methods. Metah...
详细信息
Community detection is the problem of finding naturally forming clusters in networks. It is an important problem in mining and analyzing social and other complex networks. Community detection can be used to analyze co...
详细信息
ISBN:
(纸本)9783031785405;9783031785412
Community detection is the problem of finding naturally forming clusters in networks. It is an important problem in mining and analyzing social and other complex networks. Community detection can be used to analyze complex systems in the real world and has applications in many areas, including network science, data mining, and computational biology. Label propagation is a community detection method that is simpler and faster than other methods such as Louvain, InfoMap, and spectral-based approaches. Some real-world networks can be very large and have billions of nodes and edges. Sequential algorithms might not be suitable for dealing with such large networks. This paper presents distributed-memory and hybrid parallel community detection algorithms based on the label propagation method. We incorporated novel optimizations and communication schemes, leading to very efficient and scalable algorithms. We also discuss various load-balancing schemes and present their comparative performances. These algorithms have been implemented and evaluated using large high-performance computing systems. Our hybrid algorithm is scalable to thousands of processors and has the capability to process massive networks. This algorithm was able to detect communities in the Metaclust50 network, a massive network with 282 million nodes and 42 billion edges, in 654 s using 4096 processors.
Unmanned aerial vehicles are increasingly used in environments where human intervention is difficult, repetitive, and dangerous. They greatly improve mission quality, productivity, and safety. Mission management of th...
详细信息
ISBN:
(纸本)9798350310375
Unmanned aerial vehicles are increasingly used in environments where human intervention is difficult, repetitive, and dangerous. They greatly improve mission quality, productivity, and safety. Mission management of these increasingly complex autonomous vehicles requires independent and online decisions. Markov decision processes (MDPs) are the most widely used probabilistic decision models for describing, modeling, and solving decision-making problems under uncertainty. In order to take into account the physical constraints and safety requirements of the mission, parallel decision models are required with an increase in mission complexity. However, the parallel execution of several MDPs can lead to conflicts. This paper describes a self-adaptation method for resolving conflicts that arise during the mission of a UAV swarm modeled with Markov decision processes (MDPs). The decisions must be taken in priority by the UAV itself but in some cases, it does not have the global view to choose the most adapted to the mission. The proposed method is able to detect and resolve conflicts based on two main phases. The first is the detection of conflicting UAV members by the embedded edge devices. Second, each UAV adjusts its mission plan to avoid conflicts in the swarm. To illustrate the methodology, experimental results obtained with a UAV swarm system performing a target search and tracking mission are presented. Our solution has low overhead and significantly improves the swarm's lifetime, safety, and mission efficiency.
In this paper we describe a parallel solution to the problem of discovering breakout patterns in continuously evaluated exponential-moving averages (EMA) of financial tick data streams over tumbling windows, achieving...
详细信息
Scheduling problems are naturally formulated in terms of Constraint Programming (CP), yet the application of CP-based approaches for job scheduling on High-Performance Computing (HPC) clusters remains underexplored. T...
详细信息
ISBN:
(纸本)9798400704437
Scheduling problems are naturally formulated in terms of Constraint Programming (CP), yet the application of CP-based approaches for job scheduling on High-Performance Computing (HPC) clusters remains underexplored. This study aims to bridge this gap by analyzing the scheduling of diverse real workload traces using IBM ILOG CP Optimizer. The analysis considers not just the basic metrics Average Bounded Slowdown and Average Response Time, but also Area-Weighted Average Response Time and Level-2 Priority-Weighted Specific Time, which measure packing efficiency and fairness. For each workload trace and metric combination, schedules produced through optimizing the metric with CP Optimizer are compared against schedules generated by the variants of the list scheduling with backfilling that are most suitable for the metric. The CP-based scheduling improves scheduling quality in most of the examined cases. The analysis of the metrics that represent different scheduling goals uncovers several non-trivial insights. Presently, CP Optimizer still encounters scalability issues with large wait queues and non-linear objective functions. Nonetheless, it often demonstrates improvements in packing efficiency, which make CP techniques attractive, particularly in scenarios where high-maintenance clusters run a moderate number of large, rigid, well-characterized jobs.
The proceedings contain 68 papers. The topics discussed include: effect of the downstream blockage induced under-rib convection on oxygen feeding in a PEMFC with parallel flow field;simulation and analysis of the dete...
The proceedings contain 68 papers. The topics discussed include: effect of the downstream blockage induced under-rib convection on oxygen feeding in a PEMFC with parallel flow field;simulation and analysis of the detection effect of seafloor shallow thermal origin gas release by marine resistivity method;dual-objective optimal scheduling of grid-connected distributed photovoltaic systems considering life loss cost of energy storage;research on security protection strategies for household distributed photovoltaic clusters;short-term wind speed prediction based on time series trends and periodic characteristics;experimental research on heating performance of solar energy coupled with water source heat pump system;research on variable pressure oil supply servo system based on accumulator;and optimal scheduling of building integrated energy system considering the interaction of electric energy and heat energy.
Nowadays, the industrial market is characterised by high levels of competition, with customers increasingly demanding in terms of quality, delivery times, costs, etc.. However, with increasing demand and the need to i...
详细信息
ISBN:
(数字)9783031774263
ISBN:
(纸本)9783031774256;9783031774263
Nowadays, the industrial market is characterised by high levels of competition, with customers increasingly demanding in terms of quality, delivery times, costs, etc.. However, with increasing demand and the need to increase productivity, many companies in recent years have dedicated themselves to decentralising their factories, thus moving to distributed production. Today's manufacturing systems are distributed in the sense that there are several jobs that have to be carry out on machines located in different factories. This paper proposes a multi-objective distributed job shop scheduling model with unrelated parallel machines and sequence-dependent setup times. The transport time of raw materials to carry out a given job to a factory is also taken into account. Small instances of the problem were solved using NSGA-III with the aim of simultaneously minimising two objectives: the makespan and average completion time. Preliminary results show the validity of this approach.
Human activity recognition using inertial sensors has gained significant popularity and widespread adoption in various fields, while deep learning has emerged as the dominant approach, playing a pivotal role in enhanc...
详细信息
In the pursuit of precision agriculture, the integration of artificial intelligence (AI) for real-time plant disease detection holds a significant promise. This study investigates the application of edge computing on ...
详细信息
暂无评论