The goal-reaching tasks with safety constraints are common control problems in real world, such as intelligent driving and robot manipulation. The difficulty of this kind of problem comes from the exploration terminat...
详细信息
The goal-reaching tasks with safety constraints are common control problems in real world, such as intelligent driving and robot manipulation. The difficulty of this kind of problem comes from the exploration termination caused by safety constraints and the sparse rewards caused by goals. The existing safe RL avoids unsafe exploration by restricting the search space to a feasible region, the essence of which is the pruning of the search space. However, there are still many ineffective explorations in the feasible region because of the ignorance of the goals. Our approach considers both safety and goals;the policy space pruning is achieved by a function called feasible reachable function, which describes whether there is a policy to make the agent safely reach the goals in the finite time domain. This function naturally satisfies the self-consistent condition and the risky Bellman equation, which can be solved by the fixed point iteration method. On this basis, we propose feasible reachable policy iteration (FRPI), which is divided into three steps: policy evaluation, region expansion, and policy improvement. In the region expansion step, by using the information of agent to reach the goals, the convergence of the feasible region is accelerated, and simultaneously a smaller feasible reachable region is identified. The experimental results verify the effectiveness of the proposed FR function in both improving the convergence speed of better or comparable performance without sacrificing safety and identifying a smaller policy space with higher sample efficiency. Copyright 2024 by the author(s)
data transport volume and scope on networks are growing daily due to the quick advancements in network technology. It is challenging for cybersecurity specialists to keep track of every action taking place on the netw...
详细信息
We employed several algorithms with high efficacy to analyze the public transcriptomic data,aiming to identify key transcription factors(TFs)that regulate regeneration in Arabidopsis ***,we utilized CollaborativeNet,a...
详细信息
We employed several algorithms with high efficacy to analyze the public transcriptomic data,aiming to identify key transcription factors(TFs)that regulate regeneration in Arabidopsis ***,we utilized CollaborativeNet,also known as TF-Cluster,to construct a collaborative network of all TFs,which was subsequently decomposed into many subnetworks using the Triple-Link and Compound Spring Embedder(CoSE)*** analysis of these subnetworks led to the identification of nine subnetworks closely associated with *** further applied principal component analysis and gene ontology(GO)enrichment analysis to reduce the subnetworks from nine to three,namely subnetworks 1,12,and *** for TF-binding sites in the promoters of the co-expressed and co-regulated(CCGs)genes of all TFs in these three subnetworks and Triple-Gene Mutual Interaction analysis of TFs in these three subnetworks with the CCGs involved in regeneration enabled us to rank the TFs in each ***,six potential candidate TFs-WOx9A,LEC2,PGA37,WIP5,PEI1,and AIL1 from subnetwork 1-were identified,and their roles in somatic embryogenesis(GO:0010262)and regeneration(GO:0031099)were discussed,so were the TFs in Subnetwork 12 and 17 associated with *** TFs identified were also assessed using the CIS-BP database and Expression *** analyses suggest some novel TFs that may have regulatory roles in regeneration and embryogenesis and provide valuable data and insights into the regulatory mechanisms related to *** tools and the procedures used here are instrumental for analyzing high-throughput transcriptomic data and advancing our understanding of the regulation of various biological processes of interest.
As the use of web browsers continues to grow, the potential for cybercrime and web-related criminal activities also increases. Digital forensic investigators must understand how different browsers function and the cri...
详细信息
For the past decade, cardiac infection is the important source of death for several populations around world. Nowadays, heart attacks occurring in the younger generation are becoming common. The factors leading to hea...
详细信息
Full-marathon and Half-marathon distances are categorized as road running. Full-marathon running is becoming increasingly popular, and Half-marathon is increasing worldwide in both sexes and all age groups. Some aspec...
详细信息
The volume of academic literature,such as academic conference papers and journals,has increased rapidly worldwide,and research on metadata extraction is ***,high-performing metadata extraction is still challenging due...
详细信息
The volume of academic literature,such as academic conference papers and journals,has increased rapidly worldwide,and research on metadata extraction is ***,high-performing metadata extraction is still challenging due to diverse layout formats according to journal *** accommodate the diversity of the layouts of academic journals,we propose a novel LAyout-aware Metadata Extraction(LAME)framework equipped with the three characteristics(e.g.,design of automatic layout analysis,construction of a large meta-data training set,and implementation of metadata extractor).In the framework,we designed an automatic layout analysis using PDF *** on the layout analysis,a large volume of metadata-separated training data,including the title,abstract,author name,author affiliated organization,and keywords,were automatically ***,we constructed a pre-trainedmodel,Layout-Meta BERT,to extract the metadata from academic journals with varying layout *** experimental results with our metadata extractor exhibited robust performance(Macro-F1,93.27%)in metadata extraction for unseen journals with different layout formats.
One of the most significant contributors to morbidity in the global population is the ability to forecast a heart attack. Clinical data analysis is considered one of the most significant aspects for making a forecast,...
详细信息
This article aims to investigate the leaf spot disease in rice, a condition that has been observed to cause substantial reductions in crop yield, ranging from 10% to 50%. The disease is characterized by the appearance...
详细信息
The proliferation of social media has made sites like Twitter a treasure trove of information for diagnosing mental health problems like depression. By examining trends in user-generated material, this research presen...
详细信息
暂无评论