检索结果-内蒙古大学图书馆

Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methods

IEEE Transactions on Neural Networks and Learning Systems 2024年第6期36卷 9737-9757页

作者： Yuji Cao Huan Zhao Yuheng Cheng Ting Shu Yue Chen Guolong Liu Gaoqi Liang Junhua Zhao Jinyue Yan Yun Li Department of Mechanical and Automation Engineering The Chinese University of Hong Kong Hong Kong SAR China Department of Building Environment and Energy Engineering The Hong Kong Polytechnic University Hong Kong China School of Science and Engineering The Chinese University of Hong Kong Shenzhen China Center for Crowd Intelligence Shenzhen Institute of Artificial Intelligence and Robotics for Society (AIRS) Shenzhen China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen China School of Electrical and Electronic Engineering Nanyang Technological University Jurong West Singapore School of Mechanical Engineering and Automation Harbin Institute of Technology Shenzhen China Shenzhen Institute for Advanced Study University of Electronic Science and Technology of China Shenzhen China i4AI Ltd. London U.K.

With extensive pretrained knowledge and high-level general capabilities, large language models (LLMs) emerge as a promising avenue to augment reinforcement learning (RL) in aspects, such as multitask learning, sample efficiency, and high-level task planning. In this survey, we provide a comprehensive review of the existing literature in LLM-enhanced RL and summarize its characteristics compared with conventional RL methods, aiming to clarify the research scope and directions for future studies. Utilizing the classical agent-environment interaction paradigm, we propose a structured taxonomy to systematically categorize LLMs’ functionalities in RL, including four roles: information processor, reward designer, decision-maker, and generator. For each role, we summarize the methodologies, analyze the specific RL challenges that are mitigated and provide insights into future directions. Finally, the comparative analysis of each role, potential applications, prospective opportunities, and challenges of the LLM-enhanced RL are discussed. By proposing this taxonomy, we aim to provide a framework for researchers to effectively leverage LLMs in the RL field, potentially accelerating RL applications in complex applications, such as robotics, autonomous driving, and energy systems.

关键词： Taxonomy Surveys Visualization Reviews Planning Reinforcement learning Games Transformers Natural language processing Large language models

来源：评论

学校读者我要写书评

暂无评论

Formation Control with Orientation Alignment and Constrained Input

引用

IFAC-PapersOnLine 2020年第2期53卷 3397-3402页

作者： Yu-Wen Chen Ming-Li Chiang Li-Chen Fu Department of Electrical Engineering National Taiwan University Taipei Taiwan Graduate Institute of Automation Technology National Taipei University of Technology Taipei Taiwan Department of Electrical Engineering and the Center for Artificial Intelligence and Advanced Robotics National Taiwan University Taipei Taiwan

We design a formation controller for Multi Agent Systems such that the agents can form into the desired shape and track a given reference trajectory. The main feature of the proposed design is that not only the orientation of individual agents, but also the orientation of the whole formation is considered and is designed to be aligned with the moving direction of the reference trajectory, which helps the tracking movement to be smoother compared with the common tracking results. Moreover, the control inputs are designed in predefined input ranges to reflect the practical system. System stability is proved based on nonlinear system theory and some simulations are given to validate the proposed results.

关键词： Multi-agent systems Nonlinear adaptive control Coordination of multiple vehicle systems

来源：评论

学校读者我要写书评

暂无评论

Recent Advances in Triboelectric Nanogenerators: From Technological Progress to Commercial Applications

引用

ACS Nano 2023年第12期17卷 11087-11219页

作者： Choi, Dongwhi Lee, Younghoon Lin, Zong-Hong Cho, Sumin Kim, Miso Ao, Chi Kit Soh, Siowling Sohn, Changwan Jeong, Chang Kyu Lee, Jeongwan Lee, Minbaek Lee, Seungah Ryu, Jungho Parashar, Parag Cho, Yujang Ahn, Jaewan Kim, Il-Doo Jiang, Feng Lee, Pooi See Khandelwal, Gaurav Kim, Sang-Jae Kim, Hyun Soo Song, Hyun-Cheol Kim, Minje Nah, Junghyo Kim, Wook Menge, Habtamu Gebeyehu Park, Yong Tae Xu, Wei Hao, Jianhua Park, Hyosik Lee, Ju-Hyuck Lee, Dong-Min Kim, Sang-Woo Park, Ji Young Zhang, Haixia Zi, Yunlong Guo, Ru Cheng, Jia Yang, Ze Xie, Yannan Lee, Sangmin Chung, Jihoon Oh, Il-Kwon Kim, Ji-Seok Cheng, Tinghai Gao, Qi Cheng, Gang Gu, Guangqin Shim, Minseob Jung, Jeehoon Yun, Changwoo Zhang, Chi Liu, Guoxu Chen, Yufeng Kim, Suhan Chen, Xiangyu Hu, Jun Pu, Xiong Guo, Zi Hao Wang, Xudong Chen, Jun Xiao, Xiao Xie, Xing Jarin, Mourin Zhang, Hulin Lai, Ying-Chih He, Tianyiyi Kim, Hakjeong Park, Inkyu Ahn, Junseong Huynh, Nghia Dinh Yang, Ya Wang, Zhong Lin Baik, Jeong Min Choi, Dukhyun Kyung Hee University Gyeonggi Yongin17104 Korea Republic of Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology 77 Massachusetts Avenue CambridgeMA02139 United States Department of Mechanical Engineering Soft Robotics Research Center Seoul National University Seoul08826 Korea Republic of Department of Mechanical Engineering Gachon University Seongnam13120 Korea Republic of Department of Biomedical Engineering National Taiwan University Taipei10617 Taiwan Frontier Research Center on Fundamental and Applied Sciences of Matters National Tsing Hua University Hsinchu30013 Taiwan School of Advanced Materials Science & Engineering Sungkyunkwan University Suwon16419 Korea Republic of Sungkyunkwan University 2066 Seobu-ro Gyeonggi Suwon16419 Korea Republic of Department of Chemical and Biomolecular Engineering National University of Singapore 4 Engineering Drive 4 117585 Singapore Division of Advanced Materials Engineering Jeonbuk National University 567 Baekje-daero Jeonbuk Jeonju54896 Korea Republic of Jeonbuk National University 567 Baekje-daero Jeonbuk Jeonju54896 Korea Republic of Department of Physics Inha University 100 Inha-ro Incheon22212 Korea Republic of School of Materials Science & Engineering Yeungnam University Gyeongbuk Gyeongsan38541 Korea Republic of 291 Daehak-ro Daejeon34141 Korea Republic of School of Materials Science and Engineering Nanyang Technological University 50 Nanyang Avenue 639798 Singapore Institute of Flexible Electronics Technology of Tsinghua Zhejiang Jiaxing314000 China Nanomaterials and System Lab Major of Mechatronics Engineering Faculty of Applied Energy System Jeju National University Jeju632-43 Korea Republic of School of Engineering University of Glasgow GlasgowG128QQ United Kingdom Seoul02792 Korea Republic of Department of Physics Inha University Incheon22212 Korea Republic of Suwon16419 Korea Republic of Department of

Serious climate changes and energy-related environmental problems are currently critical issues in the world. In order to reduce carbon emissions and save our environment, renewable energy harvesting technologies will serve as a key solution in the near future. Among them, triboelectric nanogenerators (TENGs), which is one of the most promising mechanical energy harvesters by means of contact electrification phenomenon, are explosively developing due to abundant wasting mechanical energy sources and a number of superior advantages in a wide availability and selection of materials, relatively simple device configurations, and low-cost processing. Significant experimental and theoretical efforts have been achieved toward understanding fundamental behaviors and a wide range of demonstrations since its report in 2012. As a result, considerable technological advancement has been exhibited and it advances the timeline of achievement in the proposed roadmap. Now, the technology has reached the stage of prototype development with verification of performance beyond the lab scale environment toward its commercialization. In this review, distinguished authors in the world worked together to summarize the state of the art in theory, materials, devices, systems, circuits, and applications in TENG fields. The great research achievements of researchers in this field around the world over the past decade are expected to play a major role in coming to fruition of unexpectedly accelerated technological advances over the next decade. © 2023 The Authors. Published by American Chemical Society

关键词： Nanogenerators

来源：评论

学校读者我要写书评

暂无评论

Dual Null-Space Based Controller Design with Signal Compensation for Formation with Conflicted Tasks

Dual Null-Space Based Controller Design with Signal Compensa...

引用

Control technology and Applications (CCTA),

作者： Yen Cheng Huang Jui-Ting Shen Ming-Li Chiang Yu-Wen Chen Tuan Lian Chua Li-Chen Fu Department of Electrical Engineering National Taiwan University Graduate Institute of Automation Technology National Taipei University of Technology Department of Electrical Engineering and Center for Artificial Intelligence and Advanced Robotics National Taiwan University

In this paper, we consider the multi-agent formation problem with trajectory tracking and obstacle avoidance. Out of all the controllers proposed to solve the multi-task problem, null-space based controller stood out for its ability of task priority appointment, priority interchangeability, and the simplicity in Lyapunov stability analysis. However, the advantages above are mainly based on the assumption that the considered tasks are mutually non-conflicted, which is not always the case. We propose a null-space based controller that takes the lower-rank task's control signal as the higher-rank controller's input, and redesign higher-rank controller so that the eliminated control signal is partially compensated and the tasks' aggregated error is decreased. We also design a dual null-space controller in order to apply virtual leader for path planning, which enables obstacle avoidance and tracking while the target tracking point is in an inadmissible condition. We verify the performance of formation and tracking control with and without dynamic obstacles, and show the decrease in aggregated error compared with the traditional null-space controller.

关键词： Task analysis Collision avoidance Target tracking Jacobian matrices Artificial intelligence Robots Lyapunov methods

来源：评论

学校读者我要写书评

暂无评论

Real-time Obstacle Avoidance using Supervised Recurrent Neural Network with Automatic Data Collection and Labeling

Real-time Obstacle Avoidance using Supervised Recurrent Neur...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Shao-Hung Chan Xiaoyue Xu Ping-Tsang Wu Ming-Li Chiang Li-Chen Fu Department of Electrical Engineering National Taiwan University Taipei Taiwan Graduate Institute of Automation Technology National Taipei University of Technology Taipei Taiwan NTU Center for Artificial Intelligence Advanced Robotics Taipei Taiwan

The following topics are dealt with: learning (artificial intelligence); medical signal processing; neurophysiology; electroencephalography; mobile robots; feature extraction; brain-computer interfaces; neural nets; c... 详细信息

关键词： Collision avoidance Training Robot sensing systems Robot kinematics Path planning Labeling

来源：评论

学校读者我要写书评

暂无评论

Multi-Layer Environmental Affordance Map for Robust Indoor Localization, Event Detection and Social Friendly Navigation

Multi-Layer Environmental Affordance Map for Robust Indoor L...

引用

2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Ping-Tsang Wu Chee-An Yu Shao-Hung Chan Ming-Li Chiang Li-Chen Fu Department of Electrical Engineering National Taiwan University Taipei Taiwan Graduate Institute of Automation Technology National Taipei University of Technology Taipei Taiwan Director of NTU Center for Artificial Intelligence & Advanced Robotics Taipei Taiwan

In this paper, we propose a novel system architecture called multi-layer environmental affordance map for social and service companion robots. Based on this architecture, robots can organize the perception and inference information efficiently and generate social friendly navigation strategies. In other words, robots are able to strengthen their perception and inference abilities to interact with domestic environment and users under our efficient framework. The main feature of this architecture is that the relations between layers can be viewed as affordances to improve the accuracy and the robustness of the detection and inference. The results show that our architecture achieves robust indoor localization, scene localization, human event detection and socially friendly navigation in real time under limited computational resource.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the BRATS challenge

arXiv

引用

arXiv 2018年

作者： Bakas, Spyridon Reyes, Mauricio Jakab, Andras Bauer, Stefan Rempfler, Markus Crimi, Alessandro Shinohara, Russell Takeshi Berger, Christoph Ha, Sung Min Rozycki, Martin Prastawa, Marcel Alberts, Esther Lipkova, Jana Freymann, John Kirby, Justin Bilello, Michel Fathallah-Shaykh, Hassan M. Wiest, Roland Kirschke, Jan Wiestler, Benedikt Colen, Rivka Kotrotsou, Aikaterini Lamontagne, Pamela Marcus, Daniel Milchenko, Mikhail Nazeri, Arash Weber, Marc-Andr Mahajan, Abhishek Baid, Ujjwal Gerstner, Elizabeth Kwon, Dongjin Acharya, Gagan Agarwal, Manu Alam, Mahbubul Albiol, Alberto Albiol, Antonio Albiol, Francisco J. Alex, Varghese Allinson, Nigel Amorim, Pedro H.A. Amrutkar, Abhijit Anand, Ganesh Andermatt, Simon Arbel, Tal Arbelaez, Pablo Avery, Aaron Azmat, Muneeza Pranjal, B. Bai, Wenjia Banerjee, Subhashis Barth, Bill Batchelder, Thomas Batmanghelich, Kayhan Battistella, Enzo Beers, Andrew Belyaev, Mikhail Bendszus, Martin Benson, Eze Bernal, Jose Bharath, Halandur Nagaraja Biros, George Bisdas, Sotirios Brown, James Cabezas, Mariano Cao, Shilei Cardoso, Jorge M. Carver, Eric N. Casamitjana, Adri Castillo, Laura Silvana Cat, Marcel Cattin, Philippe Cérigues, Albert Chagas, Vinicius S. Chandra, Siddhartha Chang, Yi-Ju Chang, Shiyu Chang, Ken Chazalon, Joseph Chen, Shengcong Chen, Wei Chen, Jefferson W. Chen, Zhaolin Cheng, Kun Choudhury, Ahana Roy Chylla, Roger Clrigues, Albert Colleman, Steven Colmeiro, Ramiro German Rodriguez Combalia, Marc Costa, Anthony Cui, Xiaomeng Dai, Zhenzhen Dai, Lutao Daza, Laura Alexandra Deutsch, Eric Ding, Changxing Dong, Chao Dong, Shidu Dudzik, Wojciech Eaton-Rosen, Zach Egan, Gary Escudero, Guilherme Estienne, Tho Everson, Richard Fabrizio, Jonathan Fan, Yong Fang, Longwei Feng, Xue Ferrante, Enzo Fidon, Lucas Fischer, Martin French, Andrew P. Fridman, Naomi Fu, Huan Fuentes, David Gao, Yaozong Gates, Evan Gering, David Gholami, Amir Gierke, Willi Glocker, Ben Gong, Mingming Gonzlez-Vill, Sandra Grosges, T. Guan, Yuanfang Guo, Sheng Gupta, Sudeep Han, Woo-Sup Han, Il Song Harmuth, Ko Center for Biomedical Image Computing and Analytics University of Pennsylvania PhiladelphiaPA United States Department of Radiology Perelman School of Medicine University of Pennsylvania PhiladelphiaPA United States Department of Pathology and Laboratory Medicine Perelman School of Medicine University of Pennsylvania PhiladelphiaPA United States Institute for Surgical Technology and Biomechanics University of Bern Bern Switzerland Center for MR-Research University Children's Hospital Zurich Zurich Switzerland Support Centre for Advanced Neuroimaging Inselspital Institute for Diagnostic and Interventional Neuroradiology Bern University Hospital Bern Switzerland University Hospital of Zurich Zurich Switzerland Center for Clinical Epidemiology and Biostatistics University of Pennsylvania Philadelphia United States Image-Based Biomedical Modeling Group Technical University of Munich Munich Germany Icahn School of Medicine Mount Sinai Health System New YorkNY United States Leidos Biomedical Research Inc. Frederick National Laboratory for Cancer Research FrederickMD21701 United States Cancer Imaging Program National Cancer Institute National Institutes of Health BethesdaMD20814 United States Department of Neurology University of Alabama at Birmingham BirminghamAL United States Department of Diagnostic Radiology University of Texas MD Anderson Cancer Center HoustonTX United States Department of Psychology Washington University St. LouisMO United States Neuroimaging Informatics and Analysis Center Washington University St. LouisMO United States Department of Radiology Washington University St. LouisMO United States Institute of Diagnostic and Interventional Radiology Pediatric Radiology and Neuroradiology University Medical Center Rostock Ernst-Heydemann-Str. 6 Rostock18057 Germany Tata Memorial Centre Homi Bhabha National Institute Mumbai India Shri Guru Gobind Singhji Institute of Engineering and Technology Nanded India NVIDIA Santa Clara

Gliomas are the most common primary brain malignancies, with different degrees of aggressiveness, variable prognosis and various heterogeneous histologic sub-regions, i.e., peritumoral edematous/invaded tissue, necrotic core, active and non-enhancing core. This intrinsic heterogeneity is also portrayed in their radio-phenotype, as their sub-regions are depicted by varying intensity profiles disseminated across multi-parametric magnetic resonance imaging (mpMRI) scans, reflecting varying biological properties. Their heterogeneous shape, extent, and location are some of the factors that make these tumors difficult to resect, and in some cases inoperable. The amount of resected tumor is a factor also considered in longitudinal scans, when evaluating the apparent tumor for potential diagnosis of progression. Furthermore, there is mounting evidence that accurate segmentation of the various tumor sub-regions can offer the basis for quantitative image analysis towards prediction of patient overall survival. This study assesses the state-of-the-art machine learning (ML) methods used for brain tumor image analysis in mpMRI scans, during the last seven instances of the International Brain Tumor Segmentation (BraTS) challenge, i.e., 2012-2018. Specifically, we focus on i) evaluating segmentations of the various glioma sub-regions in pre-operative mpMRI scans, ii) assessing potential tumor progression by virtue of longitudinal growth of tumor sub-regions, beyond use of the RECIST/RANO criteria, and iii) predicting the overall survival from pre-operative mpMRI scans of patients that underwent gross total resection. Finally, we investigate the challenge of identifying the best ML algorithms for each of these tasks, considering that apart from being diverse on each instance of the challenge, the multi-institutional mpMRI BraTS dataset has also been a continuously evolving/growing dataset. Copyright © 2018, The Authors. All rights reserved.

关键词： Tumors

来源：评论

学校读者我要写书评

暂无评论

Vision-Based Kinematic Calibration of Spherical Robots

Vision-Based Kinematic Calibration of Spherical Robots

引用

RSI/ISM International Conference on robotics and Mechatronics

作者： Pedram Agand Hamid D. Taghirad Amir Molaee Advanced Robotics and Automation System (ARAS) Industrial Control Center of Excellence (ICEE) Department of Systems and Control Faculty of Electrical Engineering K. N. Toosi University of Technology Iran

ISBN: (纸本)9781467372350

In this article, a method to obtain spatial coordinate of spherical robot's moving platform using a single camera is proposed, and experimentally verified. The proposed method is an accurate, flexible and low-cost tool for the kinematic calibration of spherical-workspace mechanisms to achieve the desired accuracy in position. The sensitivity and efficiency of the provided method is thus evaluated. Furthermore, optimization of camera location is outlined subject to the prescribed cost functions. Finally, experimental analysis of the proposed calibration method on ARAS Eye surgery Robot (DIAMOND) is presented;In which the accuracy is obtained from three to six times better than the previous calibration.

关键词： Kinematic Calibration Vision-Base Positioning Eye Surgery Robot Spherical Workspace

来源：评论

学校读者我要写书评

暂无评论

A positive tensions PID controller for a planar cable robot: An experimental study

A positive tensions PID controller for a planar cable robot:...

引用

RSI/ISM International Conference on robotics and Mechatronics (ICROM)

作者： Mohammad A. Khosravi Hamid D. Taghirad Reza Oftadeh Advanced Robotics and Automated Systems (ARAS) Industrial Control Center of Excellence (ICCE) Faculty of Electrical and Computer Engineering K. N. Toosi University of Technology Tehran Iran Intelligent Hydraulics and Automation Department (lHA) Tampere University of Technology Finland

In this paper design and control of planar cable-driven parallel robots are studied in an experimental prospective. Since in this class of manipulators, cable tensionability conditions must be met, feedback control of such robots becomes more challenging than for conventional robots. To meet these conditions, internal force control structure is introduced and used in addition to a PID control scheme to ensure that all cables remain in tension. A robust PID controller is proposed for partial knowledge of the robot, to keep the tracking errors bounded. Finally, the effectiveness of the proposed control algorithm is examined through experiments on K.N. Toosi planar cable-driven robot and it is shown that the proposed control structure is able to provide suitable performance in practice.

关键词： PD control Assembly Logic gates Servomotors Force

来源：评论

学校读者我要写书评

暂无评论

A Study On Iterative Learning Control With Adjustment Of Learning Interval For Monotone Convergence In The Sense Of Sup-Norm

引用

Asian Journal of Control 2008年第1期4卷

作者： Kwang-Hyun Park Zeungnam Bien Division of EE Department of EECS Korea Advanced Institute of Science and Technology 373–1 Kusong-dong Yusong-gu Taejon 305–701 Korea. Zeungname Bien:received the B.S. degree in electronics engineering from Seoul National University Seoul Korea in 1969 and the M.S. and Ph.D. degrees in electrical engineering from the University of Iowa Iowa City Iowa U.S.A. in 1972 and 1975 respectively. During 1976–1977 academic years he taught as assistant professor at the Department of Electrical Engineering University of Iowa. Then Dr. Bien joined Korea Advanced Institute of Science and Technology summer 1977 and is now Professor of Control Engineering at the Department of Electrical Engineering and Computer Science KAIST. Dr. Bien was the president of the Korea Fuzzy Logic and Intelligent Systems Society during 1990–1995 and also the general chair of IFSA World Congress 1993 and for FUZZ-IEEE99 respectively. He is currently co-Editor-in-Chief for International Journal of Fuzzy Systems (IJFS) Associate Editor for IEEE Transactions on Fuzzy Systems and a regional editor for the International Journal of Intelligent Automation and Soft Computing. He has been serving as Vice President for IFSA since 1997 and is now Chief Chairman of Institute of Electronics Engineers of Korea and Director of Humanfriendly Welfare Robot System Research Center. His current research interests include intelligent control methods with emphasis on fuzzy logic systems service robotics and rehabilitation engineering and large-scale industrial control systems. Kwang-Hyun Park:received the B.S. M.S. and Ph.D. degrees in electrical engineering and computer science from KAIST Korea in 1994 19997 and 2001 respectively. He is now a researcher at Human-friendly Welfare Robot System Research Center. His research interests include learning control machine learning human-friendly interfaces and service robotics.

It has been found that some huge overshoot in the sense of sup-norm may be observed when typical iterative learning control (ILC) algorithms are applied to LTI systems, even though monotone convergence in the sense of λ-norm is guaranteed. In this paper, a new ILC algorithm with adjustment of learning interval is proposed to resolve such an undesirable phenomenon, and it is shown that the output error can be monotonically converged to zero in the sense of sup-norm when the proposed ILC algorithm is applied. A numerical example is given to show the effectiveness of the proposed algorithm.

关键词： Iterative learning control monotone convergence learning interval sup-norm

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：