检索结果-内蒙古大学图书馆

Composing Synergistic Macro Actions for Reinforcement Learning Agents

IEEE Transactions on Neural Networks and Learning systems 2024年第5期35卷 7251-7258页

作者： Chen, Yu-Ming Chang, Kaun-Yu Liu, Chien Hsiao, Tsu-Ching Hong, Zhang-Wei Lee, Chun-Yi Hsinchu300 Taiwan Avery Design Systems Inc. Taipei100 Taiwan University of Rostock Faculty of Computer Science and Electrical Engineering Rostock18051 Germany National Tsing Hua University Department of Computer Science Hsinchu300 Taiwan Massachusetts Institute of Technology CambridgeMA02139 United States

Macro actions have been demonstrated to be beneficial for the learning processes of an agent and have encouraged a variety of techniques to be developed for constructing more effective ones. However, previous techniques usually do not further consider combining macro actions to form a synergistic macro action ensemble, in which synergism exhibits when the constituent macro actions are favorable to be jointly used by an agent during evaluation. Such a synergistic macro action ensemble may potentially allow an agent to perform even better than the individual macro actions within it. Motivated by the recent advances of neural architecture search (NAS), in this brief, we formulate the construction of a synergistic macro action ensemble as a Markov decision process (MDP) and evaluate the constructed macro action ensemble as a whole. Such a problem formulation enables synergism to be taken into account by the proposed evaluation procedure. Our experimental results demonstrate that the proposed framework is able to discover the synergistic macro action ensembles. Furthermore, we also highlight the benefits of these macro action ensembles through a set of analytical cases. © 2012 IEEE.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Design and fabrication of photovoltaics based on MFS (Ag/BaTiO3/silicon p-type) structure

引用

Materials science for Energy Technologies 2024年第1期7卷 29-34页

作者： Irzaman Dahrul, M. Rahmani, M. Rukyati, A.M. Samsidar Nurhidayah Deswardani, F. Peslinof, M. Jenie, R.P. Iskandar, J. Wahyuni, Y. Priandana, K. Siskandar, R. Department of Physics Faculty of Mathematics and Natural Sciences IPB University Bogor16680 Indonesia Department of Physics Faculty of Sciences and Technology Jambi University Jambi36361 Indonesia Department of Nutrition Faculty of Health Science and Technology Binawan University East Jakarta13630 Indonesia Department of Computer Engineering Pakuan University Bogor16142 Indonesia Department of Computer Science IPB University Bogor16680 Indonesia Computer Engineering Technology Study Program College of Vocational Studies IPB University West Java Bogor16151 Indonesia

The experiment was carried out by growing BaTiO3 (Undoped or Li-doped) on p-type Si(1 0 0) substrates using the Chemical Solution Deposition (CSD) method and spin coating at a rotational speed of 3000 rpm for 60 s, followed by heating at 850 °C. The characterization results show that the bandgap energy value of the thin film due to lithium doping reduces the bandgap energy value. This is presumably because the donor atom added to a semiconductor causes the allowable energy level to be slightly below the conduction band. The presence of this new band causes the thin film bandgap energy to decrease with a five-valent tantalum dip. The morphological properties showed that the BaTiO3/Si(1 0 0) thin film particles in the deposited lithium had a fairly homogeneous grain. With the addition of lithium acetate as a binder into barium titanate, the grain size is getting smaller because it is suspected that the lithium-ion radius is smaller than the barium-ion radius. Measurement of I-V on the thin film shows that the output voltage value increases with more light intensity hitting the surface of the thin film. The greater the light intensity, the greater the energy of the photons, so the electrons are easier to jump. The three things above (both electrical and morphological properties) conclude that the thin films grown have the potential for photovoltaics. © 2023

关键词： Thin films

来源：评论

学校读者我要写书评

暂无评论

Enhancing Security Information and Event Management (SIEM) by Incorporating Machine Learning for Cyber Attack Detection 9

Enhancing Security Information and Event Management (SIEM) b...

引用

9th IEEE International Conference on Computing, engineering and Design, ICCED 2023

作者： Ayu, Media Anugerah Erlangga, Dimas Mantoro, Teddy Handayani, Dini Sampoerna University Faculty of Engineering and Technology Department of Computer Science Jakarta Indonesia Nusa Putra University - Sukabumi Postgraduate Program - School of Computer Science Indonesia

ISBN: (纸本)9798350370126

Network security is a crucial component of Information Technology, yet organizations continue to grapple with meeting established security benchmarks. Given the rise in cyber-attacks and the continuous emergence of new attack types, it's practically infeasible to persistently update attack patterns or signatures within security parameters. Key tools such as Intrusion Detection systems (IDS) and Security Information and Event Management (SIEM) are instrumental in monitoring network traffic and identifying potential threats. However, these tools face limitations, such as the high volume of alerts produced by IDS and the use of rule-based method, also the inability of SIEM tools to analyze logs comprehensively to identify inappropriate activities. This research has conducted anomaly detection using machine learning process to classify cyber-attacks network flow collected from IDS that installed incident network infrastructure. The analysis of IDS using machine learning, integrated with SIEM. The algorithm used in this research was Random Forest Classifier using CSE-CID-IDS2018 dataset pre-processed with Principal Component Analysis (PCA). Results of the experiments show that Random Forest Classifier Model, when combined with Principal Component Analysis (PCA), yields the most commendable results when applied to a 70/30 training/testing data ratio with accuracy of 0.99953. © 2023 IEEE.

关键词： Network security

来源：评论

学校读者我要写书评

暂无评论

Sentiment Analysis with N-Gram Preprocessing for Online-Shopping Reviews in Indonesian Language 9

Sentiment Analysis with N-Gram Preprocessing for Online-Shop...

引用

9th IEEE International Conference on Computing, engineering and Design, ICCED 2023

作者： Asian, Jelita Putra, Oktavianus Tegar N.K. Ayu, Media Anugerah Mantoro, Teddy Nusa Putra University Postgraduate Program - School of Computer Science Sukabumi Indonesia Sampoerna University Faculty of Engineering and Technology Department of Computer Science Jakarta Indonesia

ISBN: (纸本)9798350370126

Currently, online Shopping platforms have grown significantly, especially during the COVID-19 pandemic. This condition motivates the need for analyzing how the users/customers' opinions on using such platform. Sentiment analysis, as a process of detecting, extracting, and classifying users' opinions and attitudes toward specific topics, is a good tool for the required analysis. This study aims to evaluate the performance of machine learning approach which combined with N-Gram technique in doing sentiment analysis. The dataset used in this study comes from scraping reviews in Bahasa Indonesia regarding the Shopee Apps. In this study, N=2 for the N-Gram was employed in the preprocessing process. Our main goal is to investigate whether the performance of machine learning in doing sentiment analysis can be improved by adding the N-Gram technique in its preprocessing. This work applied the Naive Bayes Classifier and k-Nearest Neighbor with K=11 as the machine learning algorithms. The best accuracy in this study was achieved by Naive Bayes Classifier after applying N-Gram Terms (N=2) with Split Validation (8:2), which is 97.26%. © 2023 IEEE.

关键词： Sentiment analysis

来源：评论

学校读者我要写书评

暂无评论

Learning-Based Artificial Algae Algorithm with Optimal Machine Learning Enabled Malware Detection

引用

computer systems science & engineering 2023年第9期46卷 3103-3119页

作者： Khaled M.Alalayah Fatma S.Alrayes Mohamed K.Nour Khadija M.Alaidarous Ibrahim M.Alwayle Heba Mohsen Ibrahim Abdulrab Ahmed Mesfer Al Duhayyim Department of Computer Science College of Science and ArtsNajran UniversitySharurahSaudi Arabia Department of Information Systems College of Computer and Information SciencesPrincess Nourah bint Abdulrahman UniversityP.O.Box 84428Riyadh11671Saudi Arabia Department of Computer Sciences College of Computing and Information SystemUmm Al-Qura UniversitySaudi Arabia Department of Computer Science Faculty of Computers and Information TechnologyFuture University in EgyptNew Cairo11835Egypt Computer Department Applied CollegeNajran UniversityNajran66462Saudi Arabia Department of Computer Science College of Computer Engineering and SciencesPrince Sattam bin Abdulaziz UniversityAl-Kharj16273Saudi Arabia

Malware is a‘malicious software program that performs multiple cyberattacks on the Internet,involving fraud,scams,nation-state cyberwar,and *** malicious software programs come under different classifications,namely Trojans,viruses,spyware,worms,ransomware,Rootkit,botnet malware,*** is a kind of malware that holds the victim’s data hostage by encrypting the information on the user’s computer to make it inaccessible to users and only decrypting it;then,the user pays a ransom procedure of a sum of *** prevent detection,various forms of ransomware utilize more than one mechanism in their attack flow in conjunction with Machine Learning(ML)*** study focuses on designing a Learning-Based Artificial Algae Algorithm with Optimal Machine Learning Enabled Malware Detection(LBAAA-OMLMD)approach in computer *** presented LBAAA-OMLMDmodelmainly aims to detect and classify the existence of ransomware and goodware in the *** accomplish this,the LBAAA-OMLMD model initially derives a Learning-Based Artificial Algae Algorithm based Feature Selection(LBAAA-FS)model to reduce the curse of dimensionality ***,the Flower Pollination Algorithm(FPA)with Echo State Network(ESN)Classification model is *** FPA model helps to appropriately adjust the parameters related to the ESN model to accomplish enhanced classifier *** experimental validation of the LBAAA-OMLMD model is tested using a benchmark dataset,and the outcomes are inspected in distinct *** comprehensive comparative examination demonstrated the betterment of the LBAAAOMLMD model over recent algorithms.

关键词： computer networks machine learning security malware detection feature selection ransomware

来源：评论

学校读者我要写书评

暂无评论

Identification and Classification of Crowd Activities

引用

computers, Materials & Continua 2022年第7期72卷 815-832页

作者： Manar Elshahawy Ahmed O.Aseeri Shaker El-Sappagh Hassan Soliman Mohammed Elmogy Mervat Abu-Elkheir Department of Information Technology Faculty of Computers and InformationMansoura UniversityEgypt Department of Computer Science College of Computer Engineering and SciencesPrince Sattam Bin Abdulaziz UniversityAl-Kharj11942Saudi Arabia Department of Information Systems Faculty of Computers and Artificial IntelligenceBenha UniversityEgypt Faculty of Computer Science and Engineering Galala University435611SuezEgypt Department of Computer Science Faculty of Media Engineering and TechnologyGerman UniversityEgypt

The identification and classification of collective people’s activities are gaining momentum as significant themes in machine learning,with many potential applications *** need for representation of collective human behavior is especially crucial in applications such as assessing security conditions and preventing crowd *** paper investigates the capability of deep neural network(DNN)algorithms to achieve our carefully engineered pipeline for crowd *** includes three principal stages that cover crowd analysis ***,individual’s detection is represented using the You Only Look Once(YOLO)model for human detection and Kalman filter for multiple human tracking;Second,the density map and crowd counting of a certain location are generated using bounding boxes from a human detector;and Finally,in order to classify normal or abnormal crowds,individual activities are identified with pose *** proposed system successfully achieves designing an effective collective representation of the crowd given the individuals in addition to introducing a significant change of crowd in terms of activities *** results onMOT20 and SDHA datasets demonstrate that the proposed system is robust and *** framework achieves an improved performance of recognition and detection peoplewith a mean average precision of 99.0%,a real-time speed of 0.6ms non-maximumsuppression(NMS)per image for the SDHAdataset,and 95.3%mean average precision for MOT20 with 1.5ms NMS per image.

关键词： Crowd analysis individual detection You Only Look Once(YOLO) multiple object tracking kalman filter pose estimation

来源：评论

学校读者我要写书评

暂无评论

An Intelligent Data Analytics Approach for Crisis Management in Healthcare systems

An Intelligent Data Analytics Approach for Crisis Management...

引用

2024 International Conference on computer and Applications, ICCA 2024

作者： Madian, Fatma A. Ebrahim, Gamal A. Salah, Mostafa M. Abdelaal, Marwa A. Ain Shams University Faculty of Engineering Computer and Systems Engineering Department Cairo Egypt Future University in Egypt Electrical Engineering Department Cairo Egypt Faculty of Computers and Information Sadat Academy for Management Sciences Computer Science Department Cairo Egypt

ISBN: (纸本)9798350367560

Crisis management is preparing for and managing possible crises that may impact organizations and individuals at different levels. It involves effective communication, quick decision-making, and strategic planning to minimize the negative impact of a crisis and ensure swift recovery. It plays a vital role in healthcare systems, especially in virus outbreaks. Its role is to monitor and manage the spread of viruses. Moreover, it can use Machine Learning (ML) techniques to achieve this goal. This paper discusses how to apply ML approaches to daily reports of infection cases. The adopted ML approaches are Auto Regressive Integrated Moving Average (ARIMA) model and the Long Short-Term Memory (LSTM) model. Furthermore, it uses Root Mean Square Error (RMSE) as a performance measure to evaluate the applied models. Simulation results show that ARIMA model performs better as compared to other models, which can provide a prediction accuracy of more than 99%. © 2024 IEEE.

关键词： Electronic health record

来源：评论

学校读者我要写书评

暂无评论

Leveraging Social Learning for Improved Cybersecurity Maturity: A Case Study Using the NIST Framework

Leveraging Social Learning for Improved Cybersecurity Maturi...

引用

2024 International Conference on Information Technology and Computing, ICITCOM 2024

作者： Marcel Meyliana Hendric Spits Warnars, Harco Leslie Nugraha Mursitama, Tirta BINUS Graduate Program Computer Science Bina Nusantara University Computer Science Department Jakarta Indonesia Krida Wacana Christian University Information Systems Department Jakarta Indonesia School of Information Systems Bina Nusantara University Information Systems Department Jakarta Indonesia BINUS Business School Bina Nusantara University Management Department Jakarta Indonesia

ISBN: (纸本)9798350379839

This research shows that social learning can be used to increase an organization's cybersecurity maturity level. Using a literature study and case study approach. Literature studies are used to identify social learning's key success factors (KSF) and challenges in general. Then, the case study was performed in the context of assessing the maturity level of information security using the NIST Cybersecurity framework at ABC Software House, a small-scale software development company in Indonesia. Assessment activities are performed through FGDs which then also identify the most relevant social learning' KSF to increase the organization's information security maturity level. Next, referring to the selected KSF, a process of identifying and mapping social learning' challenges was carried out. The integration of social learning can help organizations gain better focus and understanding in nontechnical contexts to increase their maturity level. This research highlights that integrating social learning with the NIST cybersecurity framework can provide organizations with better focus and perspective for formulating non-technical solutions. This study also enriches the existing literature on social learning in cybersecurity and offers practical insights for organizations looking to improve their cybersecurity resilience. © 2024 IEEE.

关键词： case study cybersecurity maturity level NIST social learning

来源：评论

学校读者我要写书评

暂无评论

引用

11th International Conference on Information and Education Technology, ICIET 2023

作者： Muepu, Daniel M. Shirafuji, Atsushi Amin, Md Faizul Ibne Watanobe, Yutaka The University of Aizu Graduate Department of Computer and Information Systems Aizu-Wakamatsu Japan The University of Aizu Department of Computer Science and Engineering Aizu-Wakamatsu Japan

ISBN: (纸本)9781665465489

This paper proposes a recommendation model for similar programming problems to support programming education. In the proposed model, problem similarity is determined according to the similarity of source codes, in terms of the term frequency-inverse document frequency and the effort required to solve the given problem, as calculated according to Halstead metrics. The proposed model can be used to improve student understanding of a programming concept by solving many similar problems simultaneously. In addition, teachers can diversify similar programming problems during practical exercises, assignments, quizzes, and exams. The first experiment carried out in the Aizu Online Judge showed that the user's accuracy when solving a problem was correlated to the user's accuracy for a similar problem and, the second experiment showed a matching rate of 70% between the result of our recommendation model and the observations of a teaching assistant involved in programming classes. © 2023 IEEE.

关键词： Recommender systems

来源：评论

学校读者我要写书评

暂无评论

Reinforcement learning-based unknown reference tracking control of HMASs with nonidentical communication delays

引用

science China(Information sciences) 2023年第7期66卷 46-57页

作者： Yong XU Zheng-Guang WU Wei-Wei CHE Deyuan MENG School of Automation Beijing Institute of Technology Institute of Cyber-Systems and Control Zhejiang University College of Mathematics and Computer Science Zhejiang Normal University Department of Automation Qingdao University School of Automation Science and Electrical Engineering Beihang University(BUAA)

This paper focuses on the optimal output synchronization control problem of heterogeneous multiagent systems(HMASs) subject to nonidentical communication delays by a reinforcement learning *** with existing studies assuming that the precise model of the leader is globally or distributively accessible to all or some of the followers, the leader's precise dynamical model is entirely inaccessible to all the followers in this paper. A data-based learning algorithm is first proposed to reconstruct the leader's unknown system matrix online. A distributed predictor subject to communication delays is further devised to estimate the leader's state, where interaction delays are allowed to be nonidentical. Then, a learning-based local controller, together with a discounted performance function, is projected to reach the optimal output synchronization. Bellman equations and game algebraic Riccati equations are constructed to learn the optimal solution by developing a model-based reinforcement learning(RL) algorithm online without solving regulator equations, which is followed by a model-free off-policy RL algorithm to relax the requirement of all agents' dynamics faced by the model-based RL algorithm. The optimal tracking control of HMASs subject to unknown leader dynamics and communication delays is shown to be solvable under the proposed RL algorithms. Finally, the effectiveness of theoretical analysis is verified by numerical simulations.

关键词： heterogeneous multiagent systems HMAS reinforcement learning RL optimal output synchronization communication delays

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：