Exploration strategy design is a challenging problem in reinforcement learning(RL),especially when the environment contains a large state space or sparse *** exploration,the agent tries to discover unexplored(novel)ar...
详细信息
Exploration strategy design is a challenging problem in reinforcement learning(RL),especially when the environment contains a large state space or sparse *** exploration,the agent tries to discover unexplored(novel)areas or high reward(quality)*** existing methods perform exploration by only utilizing the novelty of *** novelty and quality in the neighboring area of the current state have not been well utilized to simultaneously guide the agent’s *** address this problem,this paper proposes a novel RL framework,called clustered reinforcement learning(CRL),for efficient exploration in *** adopts clustering to divide the collected states into several clusters,based on which a bonus reward reflecting both novelty and quality in the neighboring area(cluster)of the current state is given to the *** leverages these bonus rewards to guide the agent to perform efficient ***,CRL can be combined with existing exploration strategies to improve their performance,as the bonus rewards employed by these existing exploration strategies solely capture the novelty of *** on four continuous control tasks and six hard-exploration Atari-2600 games show that our method can outperform other state-of-the-art methods to achieve the best performance.
This research aims to develop a new approach to increase the safety and reliability of Autonomous Vehicle (AV) through the proposed risk assessment framework, supported by the trust evaluation approach derived from a ...
详细信息
This research proposes a novel hybrid optimisation method called brave-hunting optimisation (BHO) inspired by lion optimisation (LO) and coyote optimisation (CO). The BHO algorithm is employed to fine-tune the SVM par...
详细信息
Traffic rerouting is a technique used to optimize traffic flow and reduce congestion by redirecting vehicles to alternate routes. The work done in this research focuses on a specific case scenario covering a 25 k...
详细信息
This paper investigates an unmanned aerial vehicle(UAV)-assisted multi-object offloading scheme for blockchain-enabled Vehicle-to-Everything(V2X)*** to the presence of an eavesdropper(Eve),the system’s com-munication...
详细信息
This paper investigates an unmanned aerial vehicle(UAV)-assisted multi-object offloading scheme for blockchain-enabled Vehicle-to-Everything(V2X)*** to the presence of an eavesdropper(Eve),the system’s com-munication links may be *** paper proposes deploying an intelligent reflecting surface(IRS)on the UAV to enhance the communication performance of mobile vehicles,improve system flexibility,and alleviate eavesdropping on communication *** links for uploading task data from vehicles to a base station(BS)are protected by IRS-assisted physical layer security(PLS).Upon receiving task data,the computing resources provided by the edge computing servers(MEC)are allocated to vehicles for task *** blockchain-based computation offloading schemes typically focus on improving network performance,such as minimizing energy consumption or latency,while neglecting the Gas fees for computation offloading and the costs required for MEC computation,leading to an imbalance between service fees and resource *** paper uses a utility-oriented computation offloading scheme to balance costs and *** paper proposes alternating phase optimization and power optimization to optimize the energy consumption,latency,and communication secrecy rate,thereby maximizing the weighted total utility of the *** results demonstrate a notable enhancement in the weighted total system utility and resource utilization,thereby corroborating the viability of our approach for practical applications.
Automated speaker identification is an important research topic in recent advanced technologies. This process helps to analyze the speakers in their emergencies. Various existing approaches are used for speaker identi...
详细信息
The Intelligent Surveillance Support System(ISSS) is an innovative software solution that enables real-time monitoring and analysis of security footage to detect and identify potential threats. This system incorporate...
详细信息
Machine learning(ML)is increasingly applied for medical image processing with appropriate learning *** applications include analyzing images of various organs,such as the brain,lung,eye,etc.,to identify specific flaws...
详细信息
Machine learning(ML)is increasingly applied for medical image processing with appropriate learning *** applications include analyzing images of various organs,such as the brain,lung,eye,etc.,to identify specific flaws/diseases for *** primary concern of ML applications is the precise selection of flexible image features for pattern detection and region *** of the extracted image features are irrelevant and lead to an increase in computation ***,this article uses an analytical learning paradigm to design a Congruent Feature Selection Method to select the most relevant image *** process trains the learning paradigm using similarity and correlation-based features over different textural intensities and pixel *** similarity between the pixels over the various distribution patterns with high indexes is recommended for disease ***,the correlation based on intensity and distribution is analyzed to improve the feature selection ***,the more congruent pixels are sorted in the descending order of the selection,which identifies better regions than the ***,the learning paradigm is trained using intensity and region-based similarity to maximize the chances of ***,the probability of feature selection,regardless of the textures and medical image patterns,is *** process enhances the performance of ML applications for different medical image *** proposed method improves the accuracy,precision,and training rate by 13.19%,10.69%,and 11.06%,respectively,compared to other models for the selected *** mean error and selection time is also reduced by 12.56%and 13.56%,respectively,compared to the same models and dataset.
作者:
Mazhr, AhmedMougy, Amr El
Computer Engineering Department Cairo Egypt
Department of Computer Science and Engineering Cairo Egypt
This paper investigates the integration of monocular thermal imaging cameras into autonomous vehicles to address challenges faced by conventional sensors in adverse conditions. This study explores the performance of t...
详细信息
Advances in Internet-of-Things (IoT) wearable sensors and Edge-Artificial Intelligence (Edge-AI) have enabled practical realizations of Machine Learning (ML)-enabled mobile sensing applications like Human Activity Rec...
详细信息
暂无评论