The use of the reinforcement learning algorithm DQN(Deep Q-network) can increase the design variables and offers the advantage of enabling more versatile motor optimization design. This paper evaluates the potential a...
详细信息
The attitude control problem of hypersonic flight vehicles (HFV) in the presence of bias faults is addressed in this paper, and an intelligent fault-tolerant control strategy using Adaptive Dynamic Programming (ADP) i...
详细信息
In recent years, IP-fabric has often been used in data center networks, which is a set of network equipment (usually switches) interacting via control protocols, which provides unified addressing, security, etc. servi...
详细信息
With the rise of artificial intelligence, neural network simulations of biological neuron models are being explored to reduce the footprint of learning and inference in resource-constrained task scenarios. A mainstrea...
详细信息
ISBN:
(纸本)9798350377217;9798350377200
With the rise of artificial intelligence, neural network simulations of biological neuron models are being explored to reduce the footprint of learning and inference in resource-constrained task scenarios. A mainstream type of such networks are spiking neural networks (SNNs) based on simplified Integrate and Fire models for which several hardware accelerators have emerged. Among them, the "ReckOn" chip was introduced as a recurrent SNN allowing for both online training and execution of tasks based on arbitrary sensory modalities, demonstrated for vision, audition, and navigation. As a fully digital and open-source chip, we adapted ReckOn to be implemented on a Xilinx Multiprocessor System on Chip system (MPSoC), facilitating its deployment in embedded systems and increasing the setup flexibility. We present an overview of the system, and a Python framework to use it on a Pynq ZU platform. We validate the architecture and implementation in the new scenario of robotic arm control, and show how the simulated accuracy is preserved with a peak performance of 3.8M events processed per second.
An open research question in robotics is how to combine the benefits of model-free reinforcement learning (RL)-known for its strong task performance and flexibility in optimizing general reward formulations-with the r...
详细信息
ISBN:
(纸本)9798350384581;9798350384574
An open research question in robotics is how to combine the benefits of model-free reinforcement learning (RL)-known for its strong task performance and flexibility in optimizing general reward formulations-with the robustness and online replanning capabilities of model predictive control (MPC). This paper provides an answer by introducing a new framework called Actor-Critic Model Predictive control. The key idea is to embed a differentiable MPC within an actor-critic RL framework. The proposed approach leverages the short-term predictive optimization capabilities of MPC with the exploratory and end-to-end training properties of RL. The resulting policy effectively manages both short-term decisions through the MPC-based actor and long-term prediction via the critic network, unifying the benefits of both model-based control and end-to-end learning. We validate our method in both simulation and the real world with a quadcopter platform across various high-level tasks. We show that the proposed architecture can achieve real-time controlperformance, learn complex behaviors via trial and error, and retain the predictive properties of the MPC to better handle out of distribution behaviour.
Active noise controlsystems use multi-channel references to increase coherence. Additionally, multiple speakers are used to control multiple control positions and broad band frequency. Because of this, even though th...
详细信息
Active noise controlsystems use multi-channel references to increase coherence. Additionally, multiple speakers are used to control multiple control positions and broad band frequency. Because of this, even though the control filter update operation is performed in the frequency domain, the amount of calculation is very large, so an expensive and high-performance DSP must be used. If the control filter update operation, which is performed by the controller mounted on the vehicle, is calculated on the server, low-specification DSP can be used in the local vehicle, thereby reducing costs. Moreover, it has the advantage of being able to freely apply performance improvement algorithms using the server's abundant computing power. In this study, considering a wireless network real-time control system, the maximum delay time is analyzed to maintain controlperformance. When network speed is low and data errors occurred, we studied countermeasures to correct data errors at the receiving location. Accelerometer and microphone sensor signals are transmitted from the local controller to the server using a commercial wireless network service, and the server receives them and generates an updated control filter through a control algorithm. The generated control filter is transmitted from the server to the local controller and can be applied to the control sound generation algorithm to increase controlperformance. In addition, we developed a system that allows tuning of control variables and analysis of convergence performance when creating a control filter in the server. In this study, we developed a server-based active noise control system that updates control filters on a server based on wireless network, thereby reducing the cost of in-vehicle controllers, expanding control flexibility, and securing a foundation for performance improvement, thereby establishing a foundation for expanding application of active noise control technology to other vehicles which is limited due t
The proceedings contain 202 papers. The special focus in this conference is on Chinese Intelligent systems. The topics include: Modeling of Interval Type-2 Fuzzy Logic System by Semi-tensor Product;Robust Ad...
ISBN:
(纸本)9789819786572
The proceedings contain 202 papers. The special focus in this conference is on Chinese Intelligent systems. The topics include: Modeling of Interval Type-2 Fuzzy Logic System by Semi-tensor Product;Robust Adaptive control of Missiles Based on Fuzzy RBF Neural network;deep Reinforcement Learning of Physically Simulated Character control;the Game of Degree of Target-Attacker-Defender Game With Non-zero Capture Radius;Visual Inertial 3D Reconstruction System Based on KLT Optical Flow and Voxel Hash;analysis of Students’ Class Status Based on Deep Learning;fault-Tolerant Attitude control of Hypersonic Flight Vehicles Based on Extended Adaptive Iterative Learning;predefined-Time control of Robot systems with Prescribed performance Guarantees;dynamic Coverage of Unicycle Robots with Anisotropic Sensing for Time-Priority;method for Evaluating the Multi-factor Decision-Making Efficiency Based on Dynamic Bayesian network;submarine Cable Target Search Based on Improved Biological Neural network;end-to-End mmWave-Based Human Pose Estimation from Raw Signal;urban Sewage Treatment Plant Simulation System Based on Industrial Internet;Load Matching Design and Multi-objective Optimization of Helicopter EHA;Testability Design and Verification of Typical Functional Links of CNI System;adaptive Sliding Mode Tracking control for Multiple High-Speed Trains with Actuator Saturation and Parameter Uncertainties;Abnormal Data Detection Based on Dual-Factor Weighted SVDD for Multimode Batch Processes;dual-Branch Attention Dense Residual network Based on Negative Image for Image Denoising;Research on Testability Work Planning Technology for Aviation Equipment Based on DoDAF;aero Engine Instability Prediction and Detection Method Based on Gated Recurrent Neural networks;Seven-Degrees-of-Freedom Robotic Arm Path Planning Based on Improved RRT;dynamic Event-Triggered Based Coherent Formation control for Multi-robot systems;adaptive Prescribed Time Prescribed performancecontrol for High-Order No
In the past decade, Vehicular Communication (VC) has been a main subject of research in the Intelligent Transportation systems (ITSs);particularly, with many emerging communication technologies such as DSRC and cellul...
详细信息
ISBN:
(纸本)9798350373141;9798350373158
In the past decade, Vehicular Communication (VC) has been a main subject of research in the Intelligent Transportation systems (ITSs);particularly, with many emerging communication technologies such as DSRC and cellular networks. Through the exchange of messages in a timely manner, these networks are anticipated to improve ITS functionality and driving experience on roads. Several dissemination algorithms have been created in order to achieve high accuracy and efficiency while minimizing redundant transmissions in VC networks. However, recent cyberattacks on automobiles have introduced cybersecurity as a new dimension in the performance of dissemination protocols. In this paper, delay-based, probability-based, and flooding-based dissemination algorithms are compared in terms of performance them evaluated against different types of cyberattacks using NS-3 and SUMO. According to the results, delay-based dissemination performs better than probability- and flooding-based dissemination in terms of network load, and hop count, for single and multiple packet transmissions. However, probability-based dissemination had superior performance over the delay-based dissemination by around 60% in terms of end-to-end delay. From security perspective, flooding, delay-, and probability-based algorithms had no defense against message falsification and Denial of Service (DoS) attacks, due to the lack of a content verification procedures. Yet, in position falsification attack, the number of relay nodes increased by 70% and the network load increased by 62.2% in both DBD and PBD.
Federated Learning (FL) has gained attention across various industries for its capability to train machine learning models without centralizing sensitive data. While this approach offers significant benefits such as p...
详细信息
Federated Learning (FL) has gained attention across various industries for its capability to train machine learning models without centralizing sensitive data. While this approach offers significant benefits such as privacy preservation and decreased communication overhead, it presents several challenges, including deployment complexity and interoperability issues, particularly in heterogeneous scenarios or resource-constrained environments. Over-the-air (OTA) FL was introduced to tackle these challenges by disseminating model updates without necessitating direct device-to-device connections or centralized servers. However, OTA-FL brought forth limitations associated with heightened energy consumption and network latency. In this article, we propose a multi-attribute client selection framework employing the grey wolf optimizer (GWO) to strategically control the number of participants in each round and optimize the OTA-FL process while considering accuracy, energy, delay, reliability, and fairness constraints of participating devices. We evaluate the performance of our multi-attribute client selection approach in terms of model loss minimization, convergence time reduction, and energy efficiency. In our experimental evaluation, we assessed and compared the performance of our approach against the existing state-of-the-art methods. Our results demonstrate that the proposed GWO-based client selection outperforms these baselines across various metrics. Specifically, our approach achieves a notable reduction in model loss, accelerates convergence time, and enhances energy efficiency while maintaining high fairness and reliability indicators.
At present, the intelligent auxiliary control system of smart substations lacks a unified and clear technical specification for entering the network, and the quality of products from various manufacturers varies, whic...
详细信息
暂无评论