检索结果-内蒙古大学图书馆

DataLab as a Service: distributed computing Framework for Multi-Interactive Analysis Environments

IEEE ACCESS 2025年 13卷 22566-22577页

作者： Hoz, Aida Palacio Heredia Canales, Andres Cimadevilla Alvarez, Ezequiel Obregon Ruiz, Marta Lopez Garcia, Alvaro Inst Fis Cantabria IFCA CSIC UC Santander 39005 Spain

During the current data era, data analysis across multiple disciplines has become a critical task for researchers to obtain meaningful insights and solve complex problems that are immeasurable using traditional technologies. Big Data has led to the development of state-of-the-art technologies that have revolutionized the process of experimentation. These innovations span from automating the setup of the infrastructure required for data analysis to providing user-friendly interfaces that simplify coding and result visualization. However, managing and scaling these resources for large-scale data processing remains a challenge. In this work, we introduce a novel framework called Datalab as a Service which integrates cutting-edge and open-source technologies to offer an online platform designed for both resource providers and researchers. The platform enables users to easily and automatically deploy interactive environments tailored for data analysis, thereby streamlining the process of managing computational resources. Through DLaaS, users gain access to cloud-based infrastructures and distributed computing resources, which are essential for performing compute-intensive tasks on massive datasets. The framework ensures scalability, resource management and optimization, and high availability, all within an accessible and user-friendly platform. Furthermore, this paper presents several use cases where researchers have successfully utilized DLaaS resources, demonstrating its practical applications in real-world scenarios.

关键词： Cloud computing Microservice architectures Ecosystems Computer architecture Servers Scalability Libraries Complexity theory Codes Sparks distributed computing Kubernetes interactive environments cloud computing Jupyter notebooks

来源：评论

学校读者我要写书评

暂无评论

Nicaea: A Byzantine Fault Tolerant Consensus Under Unpredictable Message Delivery Failures for Parallel and distributed computing

引用

IEEE TRANSACTIONS ON COMPUTERS 2025年第3期74卷 915-928页

作者： Jing, Guanlin Zou, Yifei Xu, Minghui Zhang, Yanqiang Yu, Dongxiao Shan, Zhiguang Cheng, Xiuzhen Ranjan, Rajiv Shandong Univ Inst Intelligent Comp Sch Comp Sci & Technol Qingdao 266237 Peoples R China State Informat Ctr Dept Informatizat & Ind Dev Beijing 100804 Peoples R China Newcastle Univ Sch Comp Newcastle Upon Tyne NE1 7RU England

Byzantine fault-tolerant (BFT) consensus is a critical problem in parallel and distributed computing systems, particularly with potential adversaries. Most prior work on BFT consensus assumes reliable message delivery and tolerates arbitrary failures of up to n3 nodes out of n total nodes. However, many systems face unpredictable message delivery failures. This paper investigates the impact of unpredictable message delivery failures on the BFT consensus problem. We propose Nicaea, a novel protocol enabling consensus among loyal nodes when the number of Byzantine nodes is below a new threshold, given by: (2-rho)(1-rho)2n-2-1 /(2-rho)(1-rho)2n-2+1n, where rho denotes the message failure rate. Theoretical proofs and experimental results validate Nicaea's Byzantine resilience. Our findings reveal a fundamental trade-off: as message delivery instability increases, a system's tolerance to Byzantine failures decreases. The well-known n3 threshold under reliable message delivery is a special case of our generalized threshold when rho = 0. To the best of our knowledge, this work presents the first quantitative characterization of unpredictable message delivery failures' impact on Byzantine fault tolerance in parallel and distributed computing.

关键词： Protocols Reliability Fault tolerant systems Fault tolerance distributed computing Consensus protocol Computational modeling Electronic mail Consensus algorithm Computers Byzantine fault-tolerance message delivery failure parallel and distributed computing

来源：评论

学校读者我要写书评

暂无评论

Real Relative Encoding Genetic Algorithm for Workflow Scheduling in Heterogeneous distributed computing Systems

引用

IEEE TRANSACTIONS ON PARALLEL AND distributed SYSTEMS 2025年第1期36卷 1-14页

作者： Jiang, Junqiang Sun, Zhifang Lu, Ruiqi Pan, Li Peng, Zebo Hunan Inst Sci & Technol Sch Informat Sci & Engn Yueyang 414006 Peoples R China Hunan Univ Coll Comp Sci & Elect Engn Key Lab Embedded & Cyber Phys Syst Hunan Prov Changsha 410082 Peoples R China Linkoping Univ Dept Comp & Informat Sci IDA Embedded Syst Lab ESLAB SE-58183 Linkoping Sweden

This paper introduces a novel Real Relative encoding Genetic Algorithm (R(2)GA) to tackle the workflow scheduling problem in heterogeneous distributed computing systems (HDCS). R(2)GA employs a unique encoding mechanism, using real numbers to represent the relative positions of tasks in the schedulable task set. Decoding is performed by interpreting these real numbers in relation to the directed acyclic graph (DAG) of the workflow. This approach ensures that any sequence of randomly generated real numbers, produced by cross-over and mutation operations, can always be decoded into a valid solution, as the precedence constraints between tasks are explicitly defined by the DAG. The proposed encoding and decoding mechanism simplifies genetic operations and facilitates efficient exploration of the solution space. This inherent flexibility also allows R(2)GA to be easily adapted to various optimization scenarios in workflow scheduling within HDCS. Additionally, R(2)GA overcomes several issues associated with traditional genetic algorithms (GAs) and existing real-number encoding GAs, such as the generation of chromosomes that violate task precedence constraints and the strict limitations on gene value ranges. Experimental results show that R(2)GA consistently delivers superior performance in terms of solution quality and efficiency compared to existing techniques.

关键词： Genetic algorithms Encoding Scheduling Processor scheduling Biological cells Metaheuristics Quality of service Heuristic algorithms Genetic operators distributed computing Candidate task set directed acyclic graph (DAG) genetic algorithm real encoding workflow scheduling

来源：评论

学校读者我要写书评

暂无评论

On distributed computing: A View, Physical Versus Logical Objects, and a Look at Fully Anonymous Systems 26th

On Distributed Computing: A View, Physical Versus Logical Ob...

引用

26th International Symposium on Stabilization, Safety, and Security of distributed Systems

作者： Raynal, Michel Univ Rennes INRIA CNRS IRISA F-35042 Rennes France

ISBN: (纸本)9783031744976;9783031744983

This article presents a short (and partial) history of synchronization in systems made up of asynchronous sequential processes (automata). Among other points, it shows that synchronization (which consists in ordering operations issued by processes on shared objects) has a different flavor according to the fact that the objects are physical objects (such as a printer or a disk) or logical objects (immaterial objects represented by sequences of bits). It then follows from this physical/logical nature of computing objects that mutual exclusion is to physical objects what consensus is to logical objects. The article also addresses recent results on process synchronization in fully anonymous systems (systems in which processes cannot be distinguished one from the other, and where there is a disagreement on the addresses of the memory registers.

关键词： Agreement Algorithm Anonymity Asynchrony Atomicity Concurrency Consensus distributed computing Informatics Liveness Logical (immaterial) object Memory anonymity Mutual exclusion Parallel computing Process anonymity Physical object Safety Sequential process Sequential specification Synchronization Total order

来源：评论

学校读者我要写书评

暂无评论

A Novel Multi-hop Query Answering System Based on a Large Knowledge Graph and distributed computing

引用

ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING 2025年第3期24卷 1-28页

作者： Hong, Trung Phan Do, Phuc Hoa Sen Univ Ho Chi Minh City Vietnam Univ Informat Technol UIT VNU HCM Informat Technol Ho Chi Minh City Vietnam

An automated query answering system (QAS) is a very useful application in organizations. Therefore, there is a lot of research to build, develop and improve it. In this article, we present a method to build a multi-hop query answering system (MQAS) based on a large knowledge graph (KG), Bidirectional Encoder Represenprovides knowledge for MQAS. BERT is used to transform questions into vectors. KD-Tree helps find the right answers quickly. On the other hand, we also propose a solution for distributed indexing of large vector spaces by building a distributed indexing structure called distributed KD-Tree (DKD-Tree). In addition, we also present experiments and evaluation results to demonstrate the effectiveness of our solution.

关键词： Phrases Multi-hop query answering large knowledge graph BERT KD-Tree distributed computing

来源：评论

学校读者我要写书评

暂无评论

Inference method for power large-scale model operation based on distributed computing resource scheduling

Inference method for power large-scale model operation based...

引用

2024 International Conference on Physics, Photonics, and Optical Engineering, ICPPOE 2024

作者： Huang, Xiaoguang Qin, Yu Liu, Yaqing Cui, Yingbao Guo, Ting Gu, Qingtong State Grid Information and Communication Industry Group Co. Ltd Beijing102211 China

ISBN: (数字)9781510689121

ISBN: (纸本)9781510689114

Electric power computing resources are distributed in the respective regions of provincial data centers and transmission and transformation equipment, and the scheduling efficiency of computing resources is limited by conditions such as long distribution locations. Composite data model inference has been widely used in power equipment maintenance analysis, and large-scale model inference requires the use of distributed computing resources. In order to improve the scheduling and fusion efficiency of distributed computing power resources, this paper adopts a lightweight language model to infer and calculate the scheduling parameters of computing power resources in different regions. At the same time, in order to make more rational use of computing power resources, the intelligent models and algorithms used for power equipment maintenance are optimized. Configure the adaptation parameters of the model according to different application scenarios, and adjust the fusion method of input data for the fault diagnosis model and the classification strategy for the fault prediction model separately. Using a fine-tuning language model to map the predicted results to the semantics of power business, and then enhancing the rationality and interoperability of the answer results based on historical knowledge memory, ultimately pushing the reasoning results of the reasons and the classification results of the equipment defect diagnosis classifier to the equipment diagnosis designer. © 2025 SPIE.

关键词： Data modeling distributed computing Education and training Video Machine learning Semantics Video coding Instrument modeling Power grids Target detection

来源：评论

学校读者我要写书评

暂无评论

Traquest Model 2.0 - A Model for Faster ACID distributed computing 21st

Traquest Model 2.0 - A Model for Faster ACID Distributed ...

引用

21st International Symposium on distributed computing and Artificial Intelligence, DCAI 2024

作者： B. Rátai, Dániel Horváth, Zoltán Porkoláb, Zoltán Tóth, Melinda ELTE Eötvös Loránd University Faculty of Informatics Budapest Hungary

ISBN: (纸本)9783031809453

The global state of a distributed system is most commonly stored in databases. Databases are responsible for ensuring that the data is available, durable, and correct at some level of consistency. However, this approach has its limitations. The computing nodes responsible for the application tier need to constantly communicate over the network to be able to interact with the global state and this comes with a performance limitation. Our Traquest model concept allows us to manage the data and even provide full ACID properties on the application tier level instead of the database level. In most cases, the data can be stored right next to the computation even in the same runtime environment. Our prototype measurements imply, that in some cases a Traquest model-based distributed system can provide even magnitudes larger throughput than the fastest in-memory databases today. The Traquest model also introduces a workaround for the famous CAP theorem by introducing temporary availability. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： ACID CAP theorem distributed computing fault tolerance transaction

来源：评论

学校读者我要写书评

暂无评论

Preface for the special issue on selected software artifacts from DisCoTec 2023-the 18th International Federated Conference on distributed computing Techniques

引用

SCIENCE OF COMPUTER PROGRAMMING 2025年 243卷

作者： Casadei, Roberto Cogo, Vinicius Vielmo van Dijk, Tom Scalas, Alceste Alma Mater Studiorum Univ Bologna Bologna Italy Univ Lisbon Lisbon Portugal Univ Twente Twente Netherlands Tech Univ Denmark Lyngby Denmark

This special issue includes a selection of the artefacts presented at the 18th International Federated Conference on distributed computing Techniques (DiScoTec 2023), held at the NOVA University Lisbon (Lisbon, Portugal), in June 18-23, 2023. The federated conference included: COORDINATION 2023, the 25th International Conference on Coordination Models and Languages);DAIS 2023, the 23rd International Conference on distributed Applications and Interoperable Systems;and FORTE 2023, the 43rd International Conference on Formal Techniques for distributed Objects, Components, and Systems. All the three conferences welcomed submissions describing technological artefacts, including innovative prototypes supporting the modelling, development, analysis, simulation, or testing of systems in the broad spectrum of distributed computing subjects. The artefact evaluation chairs have selected a subset of high- quality accepted artefacts to be invited for submission to this special issue. Following the revision process, nine artefacts have been accepted to be part of this special issue. The published contributions include different types of artefacts, including programming libraries, frameworks, as well as tools for the analysis, verification, and simulation of distributed systems.

关键词： distributed computing distributed systems distributed applications Coordination Formal methods Programming languages Software Tools Simulators Analysis Model checkers Machine learning

来源：评论

学校读者我要写书评

暂无评论

On the Performance of Specialized distributed computing Systems Using Multiple Parallel Task Queues

On the Performance of Specialized Distributed Computing Syst...

引用

Systems of Signals Generating and Processing in the Field of on Board Communications

作者： I. M. Gostev S. V. Bolovtsov Russian Scientific and Technical Society of Radio Engineering Electronics and Communications named after A.S. Popov Moscow Russia Russian Presidential Academy of National Economy and Public Administration (RANEPA) Moscow Russia

ISBN: (数字)9798331532635

ISBN: (纸本)9798331532642

Three variants of models of specialized distributed computing systems containing one, two and four parallel task queues are considered. Such systems are characterized by continuous non-stationary internal task flows. In these systems, the input tasks are parallelized into an a priori unknown number of data-independent subtasks. And when a certain subtask containing a solution is completed, all other branches of this task are deleted. The aim of the work was to study the behavior of such systems when they are organized with several parallel queues. The issues of changing the efficiency and performance of such systems with an increase in the number of queues are considered. Studies have shown that the use of several queues makes it possible to increase productivity without increasing computing resources.

关键词： Productivity Computational modeling System performance Planning distributed computing

来源：评论

学校读者我要写书评

暂无评论

Enhancing Security in VANETs using distributed computing: A Review

Enhancing Security in VANETs using Distributed Computing: A ...

引用

IEEE Annual computing and Communication Workshop and Conference (CCWC)

作者： Vamsi Krishna Pavuluri Abinash Borah Anirudh Paranjothi Mohammad S. Khan Department of Computer Science Oklahoma State University Stillwater Oklahoma USA Department of Computing East Tennessee State University Johnson City Tennessee USA

ISBN: (数字)9798331507695

ISBN: (纸本)9798331507701

Vehicular Ad-Hoc Networks (VANETs) are a cornerstone of intelligent transportation systems, enabling vehicles to communicate with each other and roadside infrastructure to enhance traffic safety and efficiency. Securing VANETs remains a critical challenge due to the dynamic and decentralized nature of vehicular communications. This paper reviews and analyzes various distributed technologies-blockchain, fog computing, and federated learning-deployed for enhancing VANET security. Each technology's efficacy in addressing some of the security issues is assessed, revealing its strengths in improving data integrity and trustworthiness. However, challenges such as scalability limitations, high computational overheads, and susceptibility to single point of failure persist. Future research directions are proposed to bolster fault tolerance, load balancing, and scalability, aiming to advance the resilience and efficiency of distributed VANET security solutions.

关键词： Fault tolerance Reviews Scalability Fault tolerant systems Vehicular ad hoc networks Transportation Load management Security distributed computing Vehicle dynamics

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：