With the development of Intelligent Reflecting Surface (IRS) technology, the networkperformance of the control channel has an increasing impact on IRS systems. This paper presents a hardware-in-the-loop (HiL) simulat...
详细信息
ISBN:
(纸本)9783982039732
With the development of Intelligent Reflecting Surface (IRS) technology, the networkperformance of the control channel has an increasing impact on IRS systems. This paper presents a hardware-in-the-loop (HiL) simulation methodology for the IRS controller using real network devices. We demonstrate the behaviour of a control channel connected to the simulated IRS-based communication platform. This provides test results that correlate with wired and wireless network connection. In addition, previous work has investigated the mobile user tracking (UT) scheme and proposed methods to achieve a higher signal-to-noise ratio (SNR) in the downlink case, which will provide a theoretical upper bound. Our experimental results are analysed and compared with previous simulation methods. The results show that the proposed HiL simulation methodology can validate the functionality of the UT scheme and emphasise the importance of considering the impact of the non-ideal control link on the IRS system.
controlling voltage source inverters (VSIs) is crucial for ensuring the efficient operation of inverter-based systems. Model predictive control (MPC), notably finite control set MPC (FCS-MPC), is increasingly recogniz...
详细信息
Now a days, physics-based models are extensively employed across diverse domains to accurately replicate the real-world physics of systems. These systems use mathematical equations and rules derived from physics laws....
详细信息
ISBN:
(纸本)9798350375480;9798350375497
Now a days, physics-based models are extensively employed across diverse domains to accurately replicate the real-world physics of systems. These systems use mathematical equations and rules derived from physics laws. However, the deployment of physics-based models in simulation environment poses significant challenges because they are high fidelity and computationally complex models. There is a need to leverage these models in control and validation environments to ensure accuracy, stability, and optimal performance. One approach to leverage these models is through the use of Functional Mockup Interface (FMI) standards, which bridges the gap between physical modeling and control system design. But there are also challenges while deploying them in a simulation environment. To address the challenges associated with it, a new approach of data driven modeling using neural network has been studied in this paper. The developed neural network model aims to capture the dynamic behavior of the Air-vented dryer system, enabling smooth integration with MATLAB for Model-In-Loop and Hardware-In-Loop simulation. This approach helps better for simulating high fidelity systems, benefiting various industries which need dynamic system simulations.
Multiphase queuing systems are suitable model for evaluating the performance of wireless networks with linear topology. Analytical studies of such queuing systems had been provided in previous researches. However, for...
详细信息
In this study, we propose a reinforcement learning (RL) based position control method for a one-degree-of-freedom (1-DOF) rotational hydraulic actuator. controlling hydraulic actuators is challenging due to their nonl...
详细信息
ISBN:
(纸本)9798331517939;9788993215380
In this study, we propose a reinforcement learning (RL) based position control method for a one-degree-of-freedom (1-DOF) rotational hydraulic actuator. controlling hydraulic actuators is challenging due to their nonlinear characteristics and complex structure. Reinforcement learning offers the advantage of enabling control through learning without requiring a detailed understanding of the model, using virtual environments. However, simulators do not perfectly replicate real-world conditions. To address this, we aim to enhance the fidelity of the simulation and improve the performance of reinforcement learning-based controllers by integrating real-world data into the simulation using deep neural networks (DNN). The reinforcement learning is trained using the Proximal Policy Optimization (PPO) algorithm, and it is validated through experiments with step and sine inputs.
As the economy develops and the environmental impact of the greenhouse effect becomes more apparent, the need for precise measurement of specific gas concentrations in the air has become increasingly pressing. Neverth...
详细信息
As the economy develops and the environmental impact of the greenhouse effect becomes more apparent, the need for precise measurement of specific gas concentrations in the air has become increasingly pressing. Nevertheless, as a representative of greenhouse gases, CO2 gas detectors are susceptible to environmental temperature fluctuations, which impairs the accuracy of detection. To address this issue, the research team innovatively combined the genetic algorithm (GA) and the wavelet neural network (WNN) to develop a solution for the temperature compensation problem of the infrared CO2 gas sensor. The non-dominant sorted genetic algorithm ii (NSGA-ii) was integrated into the GA to achieve a balance between the accuracy, complexity, and temperature performance of the model through multi-objective optimization. The results showed that compared with other existing models, the GA-WNN model proposed in this study can significantly reduce the difference between the detected values and the actual environmental values under various temperature conditions when processing data. Especially at an ambient temperature of 49 degrees C, for a true CO2 concentration of 2000 ppm, the detection value processed by the GA-WNN algorithm was 2046 ppm, with a relative error of only 2.3 %, far lower than the 9.8 % of Faster RCNN algorithm and 11.5 % of WNN algorithm. The contribution of the research is the proposal of a novel temperature compensation method that significantly enhances the precision of infrared CO2 gas sensors. This is of paramount importance for enhancing the accuracy of gas detection in environmental monitoring and industrial control.
This paper focuses on utilizing deep reinforcement learning (DRL) to achieve the precision landing of an autonomous parafoil system. Specifically, we present an integrated guidance and control algorithm realized by a ...
详细信息
ISBN:
(纸本)9798350304626
This paper focuses on utilizing deep reinforcement learning (DRL) to achieve the precision landing of an autonomous parafoil system. Specifically, we present an integrated guidance and control algorithm realized by a policy network, which maps the state observation collected by the onboard sensor to the flap deflection control command. The reward function is designed to guide the policy network in minimizing both the touchdown error and the terminal anti-wind angle of the parafoil system. To ensure a smooth control profile during the time interval, an action space parameterization method based on Lagrange interpolation is proposed. On this basis, the policy network is trained by the proximal policy optimization algorithm, a type of on-policy DRL method. The parafoil dynamics are described using the six-degree-of-freedom model. Randomly distributed initial conditions are considered to account for the accumulated guidance error prior to terminal landing. Additionally, the Dryden wind disturbance is incorporated to account for the uncertainty of the wind field. The numerical results demonstrate that: i) The trained policy network effectively provides a smooth control profile for the autonomous parafoil system;ii) the policy network exhibits the potential to provide real-time command;iii) The integrated guidance and control algorithm based on DRL successfully enables precise terminal landing of the parafoil system, with a mean touchdown error smaller than 100m. The findings from this study will benefit the design of guidance and control algorithms for future autonomous parafoil systems employed in payload recovery missions or space exploration missions.
Software-Defined Wide Area networks (SD-WANs) have emerged as a promising solution to address the connectivity demands of modern distributed enterprises. However, the effective application of the Software Defined Netw...
详细信息
Software-Defined Wide Area networks (SD-WANs) have emerged as a promising solution to address the connectivity demands of modern distributed enterprises. However, the effective application of the Software Defined networking (SDN) paradigm in such broad and dynamic environments remains a significant challenge. In this paper, we present two novel contributions. First, we design a decentralized control plane for SD-WANs that leverages edge-based network monitoring and overlays' configuration. Then we present a Reinforcement Learning-based orchestration plane that leverages local information for the enforcement of SD-WAN policies. Since traditional approaches suffer either a lack of scalability due to the problem's complexity or suboptimal performance due to isolated decision-making, the proposed approach leverages a cooperative Multi -Agent Reinforcement Learning framework. Our novel cooperative approach is based on per-site agents that exchange a small amount of information to enhance performance while preserving scalability. To validate the efficacy of our proposed approach, we conducted an extensive experimental evaluation considering diverse SD-WAN scenarios. Results show that our framework is able to satisfy global network policies for a multi-site SD-WAN with different QoS requirements and cost constraints.
The significant roles, technical advantages, and high efficiency of High Voltage Direct Current (HVDC) systems have led to their global application. In most cases, the HVDC network improves the utilization of HVAC sys...
详细信息
In this work, we demonstrate the effectiveness of nonlinear model predictive control (NMPC) approximation based on deep neural network (DNN). MPC has been widely adopted in autonomous driving control problems to handl...
详细信息
ISBN:
(纸本)9798331517939;9788993215380
In this work, we demonstrate the effectiveness of nonlinear model predictive control (NMPC) approximation based on deep neural network (DNN). MPC has been widely adopted in autonomous driving control problems to handle multiple objectives and constraints. We first design the implicit NMPC for the forward and backward motions of a truck-trailer (TT) system, which follows the reference path while maintaining safety between the head truck (HT) and the trailer (TR). However, the computational load in implicit MPC makes it a challenge for real-time implementations. To alleviate the computational burden in implicit NMPC online, an NMPC approximation approach based on DNN is adopted in this study to achieve a parametric function approximation. We conduct a comparative study on the proposed approach and a baseline controller for controlperformance analysis, and the computational load is evaluated on a hardware-in-the-loop (HIL) experimental system.
暂无评论