Exploration strategy design is a challenging problem in reinforcement learning(RL),especially when the environment contains a large state space or sparse *** exploration,the agent tries to discover unexplored(novel)ar...
详细信息
Exploration strategy design is a challenging problem in reinforcement learning(RL),especially when the environment contains a large state space or sparse *** exploration,the agent tries to discover unexplored(novel)areas or high reward(quality)*** existing methods perform exploration by only utilizing the novelty of *** novelty and quality in the neighboring area of the current state have not been well utilized to simultaneously guide the agent’s *** address this problem,this paper proposes a novel RL framework,called clustered reinforcement learning(CRL),for efficient exploration in *** adopts clustering to divide the collected states into several clusters,based on which a bonus reward reflecting both novelty and quality in the neighboring area(cluster)of the current state is given to the *** leverages these bonus rewards to guide the agent to perform efficient ***,CRL can be combined with existing exploration strategies to improve their performance,as the bonus rewards employed by these existing exploration strategies solely capture the novelty of *** on four continuous control tasks and six hard-exploration Atari-2600 games show that our method can outperform other state-of-the-art methods to achieve the best performance.
This paper demonstrates the novel approach of sub-micron-thick InGaAs broadband photodetectors(PDs)designed for high-resolution imaging from the visible to short-wavelength infrared(SWIR)*** approaches encounter chall...
详细信息
This paper demonstrates the novel approach of sub-micron-thick InGaAs broadband photodetectors(PDs)designed for high-resolution imaging from the visible to short-wavelength infrared(SWIR)*** approaches encounter challenges such as low resolution and crosstalk issues caused by a thick absorption layer(AL).Therefore,we propose a guided-mode resonance(GMR)structure to enhance the quantum efficiency(QE)of the InGaAs PDs in the SWIR region with only sub-micron-thick *** TiOx/Au-based GMR structure compensates for the reduced AL thickness,achieving a remarkably high QE(>70%)from 400 to 1700 nm with only a 0.98μm AL InGaAs PD(defined as 1μm AL PD).This represents a reduction in thickness by at least 2.5 times compared to previous results while maintaining a high ***,the rapid transit time is highly expected to result in decreased electrical *** effectiveness of the GMR structure is evident in its ability to sustain QE even with a reduced AL thickness,simultaneously enhancing the transit *** breakthrough offers a viable solution for high-resolution and low-noise broadband image sensors.
Identifying cyberattacks that attempt to compromise digital systems is a critical function of intrusion detection systems (IDS). Data labeling difficulties, incorrect conclusions, and vulnerability to malicious data i...
详细信息
Perovskite solar cells have shown great potential in the field of underwater solar cells due to their excellent optoelectronic properties;however,their underwater performance and stability still hinder their practical...
详细信息
Perovskite solar cells have shown great potential in the field of underwater solar cells due to their excellent optoelectronic properties;however,their underwater performance and stability still hinder their practical *** this research,a 1H,1H,2H,2H-heptadecafluorodecyl acrylate(HFDA)anti-reflection coating(ARC)was introduced as a high-transparent material for encapsulating perovskite solar modules(PSMs).Optical characterization results revealed that HFDA can effectively reduce reflection of light below 800 nm,aiding in the absorption of light within this wavelength range by underwater solar ***,a remarkable efficiency of 14.65%was achieved even at a water depth of 50 ***,the concentration of Pb^(2+)for HFDA-encapsulated film is significantly reduced from 186 to 16.5 ppb after being immersed in water for 347 ***,the encapsulated PSMs still remained above 80%of their initial efficiency after continuous underwater illumination for 400 ***,being exposed to air,the encapsulated PSMs maintained 94%of their original efficiency after 1000 h light *** highly transparent ARC shows great potentials in enhancing the stability of perovskite devices,applicable not only to underwater cells but also extendable to land-based photovoltaic devices.
This study focuses on creating an accurate reflection prediction model that will guide the design of filters with multilayer Anti-Reflection Coating (ARC) to optimize the thickness parameters using Machine Learning (M...
详细信息
This study focuses on creating an accurate reflection prediction model that will guide the design of filters with multilayer Anti-Reflection Coating (ARC) to optimize the thickness parameters using Machine Learning (ML) and Deep Learning (DL) techniques. This model aims to shed light on the design process of a multilayer optical filter, making it more cost-effective by providing faster and more precise production. In creating this model, a dataset containing data obtained from 3000 (1500 Ge–Al2O3, 1500 Ge–SiO2) simulations previously performed on a computer based on the thicknesses of multilayer structural materials was used. The data are generated using Computational Electromagnetic simulation software based on the Finite-Difference Time-Domain method. To understand the mechanism of the proposed model, two different two-layer coating simulations were studied. While Ge was used as the substrate in both coatings, Al2O3 and SiO2 were used as the second layers. The data set consists of the 3–5 µm and 8–12 µm bands typical for the mid-wave infrared (MWIR) and long-wave infrared (LWIR) bands and includes reflectance values for wavelengths ranging between these spectra. In the specified 2-layer data set, the average reflectance was obtained with a minimum of 0.36 at 515 nm Ge and 910 nm SiO2 thicknesses. This value can be increased by adapting the proposed model to more than 2 layers. Six ML algorithms and a DL model, including artificial neural networks and convolutional neural networks, are evaluated to determine the most effective approach for predicting reflectance properties. Furthermore, in the proposed model, a hyperparameter tuning phase is used in the study to compare the efficiency of ML and DL methods to generate dual-band ARC and maximize the prediction accuracy of the DL algorithm. To our knowledge, this is the first time this has been implemented in this field. The results show that ML models, particularly decision tree (MSE: 0.00000069, RMSE: 0.00083), rand
Drug-target interactions(DTIs) prediction plays an important role in the process of drug *** computational methods treat it as a binary prediction problem, determining whether there are connections between drugs and t...
详细信息
Drug-target interactions(DTIs) prediction plays an important role in the process of drug *** computational methods treat it as a binary prediction problem, determining whether there are connections between drugs and targets while ignoring relational types information. Considering the positive or negative effects of DTIs will facilitate the study on comprehensive mechanisms of multiple drugs on a common target, in this work, we model DTIs on signed heterogeneous networks, through categorizing interaction patterns of DTIs and additionally extracting interactions within drug pairs and target protein pairs. We propose signed heterogeneous graph neural networks(SHGNNs), further put forward an end-to-end framework for signed DTIs prediction, called SHGNN-DTI,which not only adapts to signed bipartite networks, but also could naturally incorporate auxiliary information from drug-drug interactions(DDIs) and protein-protein interactions(PPIs). For the framework, we solve the message passing and aggregation problem on signed DTI networks, and consider different training modes on the whole networks consisting of DTIs, DDIs and PPIs. Experiments are conducted on two datasets extracted from Drug Bank and related databases, under different settings of initial inputs, embedding dimensions and training modes. The prediction results show excellent performance in terms of metric indicators, and the feasibility is further verified by the case study with two drugs on breast cancer.
In blockchain networks, transactions can be transmitted through channels. The existing transmission methods depend on their routing information. If a node randomly chooses a channel to transmit a transaction, the tran...
详细信息
In blockchain networks, transactions can be transmitted through channels. The existing transmission methods depend on their routing information. If a node randomly chooses a channel to transmit a transaction, the transmission may be aborted due to insufficient funds(also called balance) or a low transmission rate. To increase the success rate and reduce transmission delay across all transactions, this work proposes a transaction transmission model for blockchain channels based on non-cooperative game *** balance, channel states, and transmission probability are fully considered. This work then presents an optimized channel transaction transmission algorithm. First, channel balances are analyzed and suitable channels are selected if their balance is sufficient. Second, a Nash equilibrium point is found by using an iterative sub-gradient method and its related channels are then used to transmit transactions. The proposed method is compared with two state-of-the-art approaches: Silent Whispers and Speedy Murmurs. Experimental results show that the proposed method improves transmission success rate, reduces transmission delay,and effectively decreases transmission overhead in comparison with its two competitive peers.
Due to the fact that a memristor with memory properties is an ideal electronic component for implementation of the artificial neural synaptic function,a brand-new tristable locally active memristor model is first prop...
详细信息
Due to the fact that a memristor with memory properties is an ideal electronic component for implementation of the artificial neural synaptic function,a brand-new tristable locally active memristor model is first proposed in this ***,a novel four-dimensional fractional-order memristive cellular neural network(FO-MCNN)model with hidden attractors is constructed to enhance the engineering feasibility of the original CNN model and its ***,its hardware circuit implementation and complicated dynamic properties are investigated on multi-simulation ***,it is used toward secure communication application *** it as the pseudo-random number generator(PRNG),a new privacy image security scheme is designed based on the adaptive sampling rate compressive sensing(ASR-CS)***,the simulation analysis and comparative experiments manifest that the proposed data encryption scheme possesses strong immunity against various security attack models and satisfactory compression performance.
GPT is widely recognized as one of the most versatile and powerful large language models, excelling across diverse domains. However, its significant computational demands often render it economically unfeasible for in...
详细信息
The Gannet Optimization Algorithm (GOA) and the Whale Optimization Algorithm (WOA) demonstrate strong performance;however, there remains room for improvement in convergence and practical applications. This study intro...
详细信息
The Gannet Optimization Algorithm (GOA) and the Whale Optimization Algorithm (WOA) demonstrate strong performance;however, there remains room for improvement in convergence and practical applications. This study introduces a hybrid optimization algorithm, named the adaptive inertia weight whale optimization algorithm and gannet optimization algorithm (AIWGOA), which addresses challenges in enhancing handwritten documents. The hybrid strategy integrates the strengths of both algorithms, significantly enhancing their capabilities, whereas the adaptive parameter strategy mitigates the need for manual parameter setting. By amalgamating the hybrid strategy and parameter-adaptive approach, the Gannet Optimization Algorithm was refined to yield the AIWGOA. Through a performance analysis of the CEC2013 benchmark, the AIWGOA demonstrates notable advantages across various metrics. Subsequently, an evaluation index was employed to assess the enhanced handwritten documents and images, affirming the superior practical application of the AIWGOA compared with other algorithms.
暂无评论