Traffic Signal control (TSC) optimization is vital for efficient traffic flow in urban intersections. Recent research has explored the application of Reinforcement Learning (RL) agents to tackle TSC challenges. Howeve...
Traffic Signal control (TSC) optimization is vital for efficient traffic flow in urban intersections. Recent research has explored the application of Reinforcement Learning (RL) agents to tackle TSC challenges. However, the selection of an appropriate reward function in RL agent training still relies on subjective judgment and experience. To address this issue, an Inverse Reinforcement Learning (IRL) integrated RL algorithm is proposed. In the IRL learning section, expert trajectory data are collected and analyzed by Relative Entropy IRL (REIRL). The latent reward of expert policy is reconstructed and utilized in RL agent training process. In the RL control section, a Double Dueling Deep Q Network is applied under a cycle control framework. As verified in simulations, the introduction of expert experience improves the performance of the RL agent to the expert level and concurrently enables robustness to expert policy noises.
This paper studies the detection and identification problem of malicious network traffic and proposes a rule extraction algorithm based on interpretable models. The algorithm utilizes interpretable greedy trees as the...
详细信息
ISBN:
(数字)9798331518493
ISBN:
(纸本)9798331518509
This paper studies the detection and identification problem of malicious network traffic and proposes a rule extraction algorithm based on interpretable models. The algorithm utilizes interpretable greedy trees as the foundational model and extends its applicability to handle multi-classification problems, thereby enhancing interpretability and detection accuracy. This methodology furnishes a more dependable and secure framework for discerning attack categories within the domain of network security. The experiment results show that the proposed algorithm achieves better balance between interpretability and identification precision.
In this paper, we propose a novel event-triggered near-optimal control for nonlinear continuoustime systems. The receding horizon principle is utilized to improve the system robustness and obtain better dynamic contro...
详细信息
In this paper, we propose a novel event-triggered near-optimal control for nonlinear continuoustime systems. The receding horizon principle is utilized to improve the system robustness and obtain better dynamic control performance. In the proposed structure, we first decompose the infinite horizon optimal control into a series of finite horizon optimal problems. Then a learning strategy is adopted, in which an actor network is employed to approximate the cost function and an critic network is used to learn the optimal control law in each finite horizon. Furthermore, in order to reduce the computational cost and transmission cost, an event-triggered strategy is applied. We design an adaptive trigger condition, so that the signal transmissions and controller updates are conducted in an aperiodic way. Detailed stability analysis shows that the nonlinear system with the developed event-triggered optimal control policy is asymptotically *** results on a single-link robot arm with different noise types have demonstrated the effectiveness of the proposed method.
This article studies adaptive traffic signal control problem of single intersection in dynamic environment. A novel cycle-based signal timing method with traffic flow prediction (CycleRL) is proposed to improve the tr...
详细信息
One of the key problems in 3D object detection is to reduce the accuracy gap between methods based on LiDAR sensors and those based on monocular cameras. A recently proposed framework for monocular 3D detection based ...
详细信息
Due to the mutual occlusion, severe scale variation, and complex spatial distribution, the current multi-person mesh recovery methods cannot produce accurate absolute body poses and shapes in large-scale crowded scene...
Due to the mutual occlusion, severe scale variation, and complex spatial distribution, the current multi-person mesh recovery methods cannot produce accurate absolute body poses and shapes in large-scale crowded scenes. To address the obstacles, we fully exploit crowd features for reconstructing groups of people from a monocular image. A novel hypergraph relational reasoning network is proposed to formulate the complex and high-order relation correlations among individuals and groups in the crowd. We first extract compact human features and location information from the original high-resolution image. By conducting the relational reasoning on the extracted individual features, the underlying crowd collectiveness and interaction relationship can provide additional group information for the reconstruction. Finally, the updated individual features and the localization information are used to regress human meshes in camera coordinates. To facilitate the network training, we further build pseudo ground-truth on two crowd datasets, which may also promote future research on pose estimation and human behavior understanding in crowded scenes. The experimental results show that our approach outperforms other baseline methods both in crowded and common scenarios. The code and datasets are publicly available at https://***/boycehbz/GroupRec.
To solve the problem of pose distortion in the forward propagation of pose features in existing methods, this paper proposes a Dual-Side Feature Fusion Network for pose transfer (DSFFNet). Firstly, a fixed-length pose...
详细信息
LiDAR-based 3D object detection is essential for autonomous driving systems. However, LiDAR point clouds may appear to have sparsity, uneven distribution, and incomplete structures, significantly limiting the detectio...
详细信息
With the vigorous development of computer vision, oriented object detection has gradually been featured. In this paper, a novel differentiable angle coder named phase-shifting coder (PSC) is proposed to accurately pre...
With the vigorous development of computer vision, oriented object detection has gradually been featured. In this paper, a novel differentiable angle coder named phase-shifting coder (PSC) is proposed to accurately predict the orientation of objects, along with a dual-frequency version (PSCD). By mapping the rotational periodicity of different cycles into the phase of different frequencies, we provide a unified framework for various periodic fuzzy problems caused by rotational symmetry in oriented object detection. Upon such a framework, common problems in oriented object detection such as boundary discontinuity and square-like problems are elegantly solved in a unified form. Visual analysis and experiments on three datasets prove the effectiveness and the potentiality of our approach. When facing scenarios requiring high-quality bounding boxes, the proposed methods are expected to give a competitive performance. The codes are publicly available at https://***/open-mmlab/mmrotate.
In this study, we investigate the control problem of electronic throttle systems in the presence of practical challenges such as disturbances and measurement noises. To address these challenges, we propose an adaptive...
In this study, we investigate the control problem of electronic throttle systems in the presence of practical challenges such as disturbances and measurement noises. To address these challenges, we propose an adaptive augmented Kalman filter (AAKF) based control approach that combines the strengths of extended state observer in disturbance estimation and adaptive Kalman fil-ter in adaptive noise filtering. The outputs of AAKF are integrated into the Backstepping control design, resulting in a composite control that concurrently achieves fast disturbance rejection and noise suppression. We conduct a comparative simulation study against conventional methods without adaptive filtering to validate the effectiveness of the proposed AAKF-based control strat-egy, which exhibits superior position control accuracy and disturbance attenuation performance. We envision that our proposed control strategy will contribute to improving vehicle power, fuel economy, and emission performance.
暂无评论