With the increasingly sophisticated algorithms of simultaneous localization and mapping (SLAM), it is difficult for mobile terminals with limited resources to exploit the performance of SLAM algorithms fully. Traditio...
With the increasingly sophisticated algorithms of simultaneous localization and mapping (SLAM), it is difficult for mobile terminals with limited resources to exploit the performance of SLAM algorithms fully. Traditional deep reinforcement learning (DRL)-based approaches have offloaded SLAM tasks to servers. However, existing solutions suffer from low data efficiency and poor generalization problems. This paper proposes a novel approach based on recent advances in rewardless active inference for SLAM back-end optimization. Specifically, the reward function is replaced with simple rewardless guidance in active inference. In addition, instead of simply considering the SLAM task as a whole, we delve into the sub-tasks of back-end optimization of SLAM for offloading and resource allocation. Simulation results show the superior performance of the proposed scheme.
This research aimed to reveal the information process in the brain of the patients who suffered from mild cognitive impairment (MCI) using the power spectra and timelag analysis in electroencephalogram (EEG). The pati...
详细信息
AI's revolutionary potential in higher education is examined in this proposal, including how it could revolutionize teaching, learning, administration, and research. Adaptive learning platforms, intelligent tutori...
详细信息
In this paper the problem of testing decision making systems for MEC platforms was formulated. Methods and means of organizing the introduction of network delays as part of the emulation system of MEC platforms LWMECP...
In this paper the problem of testing decision making systems for MEC platforms was formulated. Methods and means of organizing the introduction of network delays as part of the emulation system of MEC platforms LWMECPS were analyzed. Test applications mec-test-app and mec-test-client are developed for testing and evaluation of the introduced network delays. Developed mec-orch-app to provide test application management and metrics collection. Experiments have been conducted to estimate the insertion latency and manage the test applications using mec-orch-app. Special attention was paid to the organization of all parts of the system as a future laboratory bench for testing decision systems using reinforcement learning machine learning algorithms.
As the research and applications of large language model (LLM) become increasingly sophisticated, it is difficult for resource-limited mobile terminals to run large-model inference tasks efficiently. Traditional deep ...
As the research and applications of large language model (LLM) become increasingly sophisticated, it is difficult for resource-limited mobile terminals to run large-model inference tasks efficiently. Traditional deep reinforcement learning (DRL) based approaches have been used to offload LLM inference tasks to servers. However, existing solutions suffer from data inefficiency, insensitivity to latency requirements, and non-adaptability to task load variations. In this paper, we propose an active inference with rewardless guidance algorithm using expected future free energy for offloading decisions and allocating resources for the LLM inference task offloading and resource allocation problem of cloud-edge networks systems. Experimental results show that our proposed method has superior performance over mainstream DRLs, improves in data utilization efficiency, and is more adaptable to changing task load scenarios.
In the Internet of Audio Things, communication security of the audio control terminal is vulnerable to copy-move threats, and detecting and locating audio copy-move forgery remains challenging nowadays. The forgery de...
详细信息
Quantum reinforcement learning (QRL) can outperform classical reinforcement learning (RL) by utilizing quantum parallel theory and quantum phenomena such as superposition and entanglement. Although some excellent work...
Quantum reinforcement learning (QRL) can outperform classical reinforcement learning (RL) by utilizing quantum parallel theory and quantum phenomena such as superposition and entanglement. Although some excellent work has been done on QRL, most existing works either fail to show the exponential advantage of quantum computation over classical computation in terms of performance or are too demanding on quantum devices. In this paper, we provide a novel perspective on combining quantum computing and RL with faster convergence speed and relatively relaxed demands on quantum devices. Specifically, we propose a method to construct a world model with quantum circuit that allows it to interact in a quantum way. In addition, we use Grover's algorithm to efficiently extract high-value information from the quantum world model. Extensive simulation results show that the proposed method can have superior performance compared to classical RL algorithms.
Process discovery algorithms incorporating domain knowledge can have varying levels of user involvement. It ranges from fully automated algorithms to interactive approaches where the user makes critical decisions abou...
Process discovery algorithms incorporating domain knowledge can have varying levels of user involvement. It ranges from fully automated algorithms to interactive approaches where the user makes critical decisions about the process model. Designing domain knowledge using process discovery techniques faces various challenges. These challenges could cause some issues with existing approaches. Acquiring domain knowledge with domain experts, integrating domain knowledge with process data, scalability to handle large complex data sets, and ensuring data quality are examples of these challenges. In this survey, we assess recent work with varying levels of automation in process discovery to enhance the analysis and understanding of business processes within an organization. Current work can be classified into two categories: fully automated or semi-automated process discovery. We conclude that semi-automated process discovery gives a better opportunity for involving users. Also, the use of deep learning algorithms in automation gives better performance than machine learning algorithms.
Problems and failures that emerge in Cyber-Physical systems (CPSs), particularly in robotic applications, may originate from various sources, including software bugs, security incidents, hardware malfunctions, and hum...
详细信息
ISBN:
(数字)9798331537951
ISBN:
(纸本)9798331537968
Problems and failures that emerge in Cyber-Physical systems (CPSs), particularly in robotic applications, may originate from various sources, including software bugs, security incidents, hardware malfunctions, and human errors. As robotic systems are deployed in various domains and application contexts, such as manufacturing sites, shop floors, agriculture, and autonomous vehicles, ensuring their safe and secure operation is a crucial aspect. While high-fidelity simulations are frequently used to validate system behavior and to perform tests, the “simulator-to-reality gap” presents significant challenges, requiring additional field testing to validate a system under realistic conditions. As simulations alone are insufficient for performing comprehensive testing and for ensuring adherence to both functional and non-functional requirements, real-world field testing helps to alleviate these issues. However, compared to wellestablished unit testing approaches, field testing typically is still a rather ad hoc process, with insufficient support from tools and frameworks. Field tests often heavily rely on human observations, hence risking overlooking critical issues. There is a pressing need for structured, guided field-testing processes combined with adaptive runtime monitoring to capture the data required for effective error diagnosis and analysis. This paper introduces initial concepts for the Smart Unified Runtime Monitoring Infrastructure for Guided Field-Testing (SMURF) framework designed for robotic applications, combining structured test execution with automated, adaptable monitors, to ensure the efficient collection of data required for post-test analysis. Building on prior efforts in drone field-testing frameworks, we extend our scope to identify essential features for testing and monitoring ROS-based systems. Future work shall further refine this process and implement a practical framework to support developers and testers in achieving reliable, safe, and secure
Access to building data is crucial for creating portable applications and improving building operation and energy efficiency. Ensuring data transmutability is essential for facilitating research and overcoming the div...
详细信息
ISBN:
(数字)9798350356717
ISBN:
(纸本)9798350356724
Access to building data is crucial for creating portable applications and improving building operation and energy efficiency. Ensuring data transmutability is essential for facilitating research and overcoming the diverse data representation, management, and collection methods across various building management systems (BMSs). Different BMSs use multiple interfaces for data exchange. Some BMSs provide Application Programming Interfaces (APIs) for data exchanges, while others have gateways connecting to cloud services for application subscription and data access. This study introduces a five-layered architecture that describes how client applications, researchers, and other interested stakeholders can exchange data with different BMSs. Our objective is to help researchers and practitioners understand the various ways of accessing transmutable (capable of being transformed into a compatible format) data from BMSs, regardless of the building management system a building uses. Through transmutable access to building systems’ data, we aim to enable transferable energy-efficient-related applications for buildings. We evaluate our work with a building model of the Varennes Library in Varennes, QC, Canada. The building model includes information about the building, floors, rooms, electric meter and historical time series data of the meter, weather station and its historical time series data. The model also has carbon dioxide concentration sensors, temperature sensors, humidity sensors, and historical time series data of the sensors. We include two test client programs to show how they access the transmutable data of the building through a model. We conclude that the five-layered architecture facilitates the exchange of transmutable data across diverse BMSs, making it a valuable tool for researchers and practitioners.
暂无评论