检索结果-内蒙古大学图书馆

MULTI-STAGE EPISODIC CONTROL FOR STRATEGIC EXPLORATION IN TEXT GAMES

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Tuyls, Jens Yao, Shunyu Kakade, Sham Narasimhan, Karthik Department of Computer Science Princeton University United States John A. Paulson School of Engineering and Applied Sciences Harvard University United States

Text adventure games present unique challenges to reinforcement learning methods due to their combinatorially large action spaces and sparse rewards. The interplay of these two factors is particularly demanding because large action spaces require extensive exploration, while sparse rewards provide limited feedback. This work proposes to tackle the explore-vs-exploit dilemma using a multi-stage approach that explicitly disentangles these two strategies within each episode. Our algorithm, called eXploit-Then-eXplore (XTX), begins each episode using an exploitation policy that imitates a set of promising trajectories from the past, and then switches over to an exploration policy aimed at discovering novel actions that lead to unseen state spaces. This policy decomposition allows us to combine global decisions about which parts of the game space to return to with curiosity-based local exploration in that space, motivated by how a human may approach these games. Our method significantly outperforms prior approaches by 27% and 11% average normalized score over 12 games from the Jericho benchmark (Hausknecht et al., 2020) in both deterministic and stochastic settings, respectively. On the game of Zork1, in particular, XTX obtains a score of 103, more than a 2x improvement over prior methods, and pushes past several known bottlenecks in the game that have plagued previous state-of-the-art methods.1 Copyright © 2022, The Authors. All rights reserved.

关键词： Stochastic systems

Ferroelectric AlBN Films by Molecular Beam Epitaxy

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Savant, Chandrashekhar Gund, Ved Nomoto, Kazuki Maeda, Takuya Jadhav, Shubham Lee, Joongwon Ramesh, Madhav Kim, Eungkyun Nguyen, Thai-Son Chen, Yu-Hsin Casamento, Joseph Rana, Farhan Lal, Amit Xing, Huili Grace Jena, Debdeep Department of Materials Science and Engineering Cornell University IthacaNY14853 United States School of Electrical and Computer Engineering Cornell University IthacaNY14853 United States Kavli Institute Cornell for Nanoscale Science Cornell University IthacaNY14853 United States School of Applied and Engineering Physics Cornell University IthacaNY14853 United States

We report the properties of molecular beam epitaxy deposited AlBN thin films on a recently developed epitaxial nitride metal electrode Nb2N. While a control AlN thin film exhibits standard capacitive behavior, distinct ferroelectric switching is observed in the AlBN films with increasing Boron mole fraction. The measured remnant polarization Pr ∼ 15 µC/cm2 and coercive field Ec ∼ 1.45 MV/cm in these films are smaller than those recently reported on films deposited by sputtering, due to incomplete wake-up, limited by current leakage. Because AlBN preserves the ultrawide energy bandgap of AlN compared to other nitride hi-K dielectrics and ferroelectrics, and it can be epitaxially integrated with GaN and AlN semiconductors, its development will enable several opportunities for unique electronic, photonic, and memory devices. © 2024, CC BY-NC-ND.

关键词： III-V semiconductors

Unbiased Approximations for Stationary Distributions of McKean-Vlasov SDEs

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Awadelkarim, Elsiddig Chada, Neil K. Jasra, Ajay Applied Mathematics and Computational Science Program Computer Electrical and Mathematical Sciences and Engineering Division King Abdullah University of Science and Technology Thuwal23955-6900 Saudi Arabia Department of Mathematics City University of Hong Kong Hong Kong School of Data Science The Chinese University of Hong Kong Shenzhen Shenzhen China

We consider the development of unbiased estimators, to approximate the stationary distribution of Mckean-Vlasov stochastic differential equations (MVSDEs). These are an important class of processes, which frequently appear in applications such as mathematical finance, biology and opinion dynamics. Typically the stationary distribution is unknown and indeed one cannot simulate such processes exactly. As a result one commonly requires a time-discretization scheme which results in a discretization bias and a bias from not being able to simulate the associated stationary distribution. To overcome this bias, we present a new unbiased estimator taking motivation from the literature on unbiased Monte Carlo. We prove the unbiasedness of our estimator, under assumptions. In order to prove this we require developing ergodicity results of various discrete time processes, through an appropriate discretization scheme, towards the invariant measure. Numerous numerical experiments are provided, on a range of MVSDEs, to demonstrate the effectiveness of our unbiased estimator. Such examples include the Currie-Weiss model, a 3D neuroscience model and a parameter estimation problem. © 2024, CC BY-NC-SA.

关键词： Stochastic systems

HS-Patch: A New Hermite Smart Bicubic Patch Modification

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Skala, Vaclav Smolik, Michal Karlicek, Lukas Department of Computer Science and Engineering Faculty of Applied Sciences University of West Bohemia Univerzitni 22 PlzenCZ 306 14 Czech Republic

Bicubic four-sided patches are widely used in computer graphics, CAD/CAM systems etc. Their flexibility is high and enables to compress a surface description before final rendering. However, computer graphics hardware supports only triangular meshes. Therefore, four-sided bicubic patches are approximated by a triangular mesh. The border curves of a bicubic patch are of degree 3, while diagonal and anti-diagonal curves are of degree 6. Therefore the resulting shape and texturing depend on the actual mapping, i.e. how the tessellation of a bicubic patch is made. The proposed new modification of the Hermite bicubic patch, the HS-patch, is a result of additional restriction put on the Hermite bicubic patch formulation – the diagonal and anti-diagonal curves are of degree 3. This requirement leads to a new Hermite based bicubic four-sided patch with 12 control points and another 4 control points, i.e. twist vectors, are computed from those 12 control points. © 2022, CC BY.

关键词： computer hardware

Meal Image Recognition and Healthy Meal Combination Recommendation System Integrated with Generative Artificial Intelligence

学校读者我要写书评

暂无评论

Meal Image Recognition and Healthy Meal Combination Recommen...

IEEE Eurasia Conference on Biomedical engineering, Healthcare and Sustainability (ECBIOS)

作者： Chin-Chih Chang Chi-Hung Wei Sean Hsiao Chyuan-Huei Thomas Yang Department of Computer Science and Information Engineering Chung Hua University Hsinchu Taiwan Ph.D. Program in Engineering Science Chung Hua University Hsinchu Taiwan Bachelor's Program in Applied Foreign Language and Smart Commerce Chung Hua University Hsinchu Taiwan School of Information Engineering Shandong Vocational and Technical University of International Studies Shandong China

ISBN: (数字)9798350396133

ISBN: (纸本)9798350396140

People increasingly prioritize a balanced diet to enhance well-being, yet making informed dietary choices remains challenging amidst the abundance of options. To address this, we developed a meal image recognition and healthy meal combination recommender system, integrating generative artificial intelligence (AI). Convolutional neural networks were used for precise meal image recognition to identify diverse food items. The generative AI-augmented recommendation engine offers personalized meal suggestions aligned with nutritional goals and dietary preferences, utilizing a nutrition knowledge base to ensure overall well-being. The system's feasibility was validated, illustrating its excellence in meal recognition accuracy, recommendation diversity, and user engagement. By integrating generative AI, the system shows its potential to enhance dietary recommendations and public health.

关键词： Image recognition Accuracy Generative AI Knowledge based systems Convolutional neural networks Sustainable development Public healthcare Recommender systems Engines Biomedical engineering

Solution of Linear Systems of Equations Ax=b and Ax=0 using Unifying Approach with Geometric Algebra: Outer Product Application and Angular Conditionality

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Skala, Vaclav Department of Computer Science and Engineering Faculty of Applied Sciences University of West Bohemia Univerzitni 8 CZ Pilsen306 14 Czech Republic

A solution of linear systems of equations Ax=b and Ax=0 is a vital part of many computational packages. This paper presents a novel formulation based on the projective extension of the Euclidean space using the outer product (extended cross-product). This approach enables to solve the both cases, i.e. Ax=b and Ax=0 The proposed approach leads actually to an "analytical" solution of linear systems in the form ξ = α1 ∧α2 ∧...∧αn, on which the other vector operation can be applied before using the numerical evaluation. This contribution also proposes a new approach to the conditionality estimation of matrices applicable to non-squared matrices. It splits the conditionality to "structural" conditionality showing matrix property if nearly unlimited precision is used, "numerical" issue which depends on numerical representation with respect to the right-hand side influence, if given. © 2022, CC BY.

关键词： Matrix algebra

MQDD: Pre-training of Multimodal Question Duplicity Detection for Software engineering Domain

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Pašek, Jan Sido, Jakub Konopík, Miloslav Pražák, Ondřej NTIS – New Technologies for the Information Society Department of Computer Science and Engineering Faculty of Applied Sciences University of West Bohemia Plzeň Czech Republic

This work proposes a new pipeline for leveraging data collected on the Stack Overflow website for pre-training a multimodal model for searching duplicates on question answering websites. Our multimodal model is trained on question descriptions and source codes in multiple programming languages. We design two new learning objectives to improve duplicate detection capabilities. The result of this work is a mature, fine-tuned Multimodal Question Duplicity Detection (MQDD) model, ready to be integrated into a Stack Overflow search system, where it can help users find answers for already answered questions. Alongside the MQDD model, we release two datasets related to the software engineering domain. The first Stack Overflow Dataset (SOD) represents a massive corpus of paired questions and answers. The second Stack Overflow Duplicity Dataset (SODD) contains data for training duplicate detection models. © 2022, CC BY-NC-SA.

关键词： Websites

Secrecy Performance of Joint Antenna and User Selection in Cognitive Ambient Backscattering Communications

学校读者我要写书评

暂无评论

Secrecy Performance of Joint Antenna and User Selection in C...

IEEE Conference on Vehicular Technology (VTC)

作者： Ahmed N. Elbattrawy Ahmed H. Abd El-Malek Sherif I. Rabia Waheed K. Zahra Basic and Applied Sciences Institute Egypt-Japan University of Science and Technology (E-JUST) New Borg El-Arab City Alexandria Egypt School of Electronics Communications and Computer Engineering Egypt-Japan University of Science and Technology New Borg El-Arab City Alexandria Egypt Department of Engineering Mathematics and Physics Faculty of Engineering Alexandria University Alexandria Egypt

ISBN: (数字)9798331517786

ISBN: (纸本)9798331517793

In this work, we investigate the security performance of an underlay cognitive radio network (CRN) with ambient backscatter communication (AmBC), where a backscattering device (BD) shares the spectrum and the receivers with the secondary user. Different from the related work, we consider a secondary user transmitter (ST) with multiple antenna in an AmBC-CRN with multiple receivers and multiple passive eavesdroppers. The ST performs joint antenna-user selection to enhance its security performance and overcome the performance degradation caused by BD interference. Considering the Nakagami-m fading model, closed-form expressions are derived for the secrecy outage probability for both the ST and the BD transmissions. Monte Carlo simulations are performed to validate the derived closed-form expressions. Numerical results show that employing joint antenna-user selection enhances the ST security performance by exploiting antenna and user diversity.

关键词： Performance evaluation Fading channels Vehicular and wireless technologies Closed-form solutions System performance Radio transmitters Receiving antennas Interference MIMO communication Backscatter

A New Formulation for Total Least Square Error Method in d-dimensional Space with Mapping to a Parametric Line

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Skala, Vaclav Department of Computer Science and Engineering Faculty of Applied Sciences University of West Bohemia Univerzitni 8 PlzenCZ 306 14 Czech Republic

There are many practical applications based on the Least Square Error (LSE) or Total Least Square Error (TLSE) methods. Usually the standard least square error is used due to its simplicity, but it is not an optimal solution, as it does not optimize distance, but square of a distance. The TLSE method, respecting the orthogonality of a distance measurement, is computed in -dimensional space, i.e. for points given in E2 a line π in E2, resp. for points given in E3 a plane p in E3, fitting the TLSE criteria are found. However, some tasks in physical sciences lead to a slightly different problem. In this paper, a new TSLE method is introduced for solving a problem when data are given in E3 a line π ∊ E3 is to be found fitting the TLSE criterion. The presented approach is applicable for a general d-dimensional case, i.e. when points are given in Ed a line π ∊ Ed is to be found. This formulation is different from the TLSE *** Codes 68xx, 68U05 © 2022, CC BY.

关键词： Errors