检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Yao, Yifei He, Wentao Gu, Chenyu Du, Jiaheng Tan, Fuwei Zhu, Zhen Lu, Junguo All authors are with Machine Vision and Autonomous System Laboratory Department of Automation School of Electrical Information and Electronic Engineering Shanghai Jiao Tong University Shanghai China Key Laboratory of System Control and Information Processing Ministry of Education of China China Shanghai Engineering Research Center of Intelligent Control and Management Shanghai200240 China University of Michigan Shanghai Jiao Tong University Joint Institute Shanghai Jiao Tong University Shanghai China

Training and deploying reinforcement learning (RL) policies for robots, especially in accomplishing specific tasks, presents substantial challenges. Recent advancements have explored diverse reward function designs, training techniques, simulation-to-reality (sim-to-real) transfers, and performance analysis methodologies, yet these still require significant human intervention. This paper introduces an end-to-end framework for training and deploying RL policies, guided by Large Language Models (LLMs), and evaluates its effectiveness on bipedal robots. The framework consists of three interconnected modules: an LLM-guided reward function design module, an RL training module leveraging prior work, and a sim-to-real homomorphic evaluation module. This design significantly reduces the need for human input by utilizing only essential simulation and deployment platforms, with the option to incorporate human-engineered strategies and historical data. We detail the construction of these modules, their advantages over traditional approaches, and demonstrate the framework’s capability to autonomously develop and refine controlling strategies for bipedal robot locomotion, showcasing its potential to operate independently of human intervention. Copyright © 2024, The Authors. All rights reserved.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Thermal management solutions for a traction robot for use in downhole extreme conditions

Thermal management solutions for a traction robot for use in...

引用

Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems (ITHERM)

作者： Shuang Gao Aihua Tao Jingjing Cheng Ming Zhou Zhiyu Gong School of Automation Huazhong University of Science and Technology Wuhan P. R. China Well-Tech R&D Institutes China Oilfield Service Limited Beijing P. R. China Key Laboratory of Image Processing and Intelligent Control Ministry of Education Wuhan P. R. China School of Energy and Power Engineering Huazhong University of Science and Technology Wuhan P. R. China

Accurate techniques for testing production sections are important when developing horizontal wells, but appropriate methods are also needed for transporting loggers through horizontal well segments. The reciprocating grip traction robot is a pipeline robot that has already been tested and broadly accepted for use in horizontal wells. Reciprocating grip traction robots have received a great deal of attention because they are very (more than 40%) efficient, although many other tractors are only 10% to 20% efficient, the remaining energy being converted to waste heat. However, even an efficiency of 40% may constitute a serious thermal problem in high-temperature environments, and cooling methods must be used to remove the heat produced by the waste energy. The research presented here is mainly focused on the development of a thermal management system for the electronics in traction robots. Numerical simulations are used to optimize heat sink and skeleton structure to mitigate the effects of high temperature.

关键词： Heat sinks Robots Heat transfer Resistance Resistance heating Skeleton

来源：评论

学校读者我要写书评

暂无评论

A Dual-Functional Single-Atom Fe Nanozyme-Based Sensitive Colorimetric Sensor for Tannins Quantification in Brandy

SSRN

引用

SSRN 2023年

作者： Hou, Changjun Wang, Xinrou Liu, Huan Qiao, Cailin Ma, Yi Luo, Huibo Huo, Danqun Key Laboratory for Biorheological Science and Technology of Ministry of Education Bioengineering College of Chongqing University Chongqing400044 China Chongqing Institute for Food and Drug Control Chongqing401121 China Liquor Making Biology Technology Application of Key Laboratory of Sichuan Province College of Bioengineering Sichuan University of Science and Engineering 188 University Town Yi bin644000 China Chongqing Key Laboratory of Bio-perception & Intelligent Information Processing School of Microelectronics and Communication Engineering Chongqing University Chongqing400044 China

Detection of tannins can be utilized as an approach for regulating food quality. Herein, a single-atom Fe nanozyme (Fe@CN-20)-based sensitive colorimetric sensor for tannins was initially developed. Fe@CN-20 had both laccase-like and oxidase-like activities, and has a high affinity for TMB with a Km value of 6.191×10-7 M. Therefore, the Fe@CN-20/TMB system can be sensitive to tannic acid due to the fact that tannins are easily oxidized. The linear range was 5 - 100 mg/L, and the detection limit was 0.13 mg/L (S/N=3). The entire testing process takes approximately 30 minutes. The sensing platform was further successfully utilized for quantifying tannins in five different brands of brandy. The sensing platform is characterized by great environmental stability, recyclability, remarkable sensitivity, and stability, all of which demonstrate its immense potential for rapid on-site detection of tannins. © 2023, The Authors. All rights reserved.

关键词： Tannins

来源：评论

学校读者我要写书评

暂无评论

Distributed Online Optimization for Charging and Discharging of Plug-in Electric Vehicles

Distributed Online Optimization for Charging and Discharging...

引用

IEEE International Conference on Cyborg and Bionic Systems (CBS)

作者： Haiming Xiong Ming Chi Zhi-Wei Liu Dandan Hu Liang-Liang Zhu Cheng Jiang Jun-Ping Gui Yao Rao School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Key Laboratory of Image Processing and Intelligent Control Ministry of Education Huazhong University of Science and Technology Wuhan China School of Management South-Central University for Nationalities Wuhan China Nari Group Corporation State Grid Electric Power Research Institute Nanjing China State Grid Electric Power Research Institute Wuhan Efficiency Evaluation Company Limited Wuhan China

The increasing number of uncoordinated charging and discharging for plug-in electric vehicles (PEVs) poses new challenges to the operation of the distribution network. We introduce a dynamic price mechanism so that charging at peak load will lead to an increase in cost. Then, a distributed online charging and discharging scheduling scheme for PEVs based on the dynamic price mechanism is proposed, considering the minimization of charging cost and battery degradation cost. Unlike most of the existing studies that require the future information of PEVs to schedule charging, the proposed algorithm can solve the scheduling problem for PEVs by taking advantage of a distributed alternating direction method of multipliers (ADMM). Simulation results demonstrate the effectiveness and correctness of the proposed scheduling scheme.

关键词： Plug-in electric vehicles Schedules Costs Heuristic algorithms Simulation Dynamic scheduling Minimization

来源：评论

学校读者我要写书评

暂无评论

Dynamic Ca2+ sensitivity of BK channels

Dynamic Ca2+ sensitivity of BK channels

引用

The 4th International Ion Channel Conference(第四届国际离子通道会议)

作者： Panpan Hou Jianming Cui Ding Jiuping Feng Xiao Ming Yuchi Guohui Zhang Ying Wu Wei Wang Wenping Zeng Mingyue Ding Zhengxing Wu Department of pharmacology Soochow University college of pharmaceutical Sciences SuzhouChina Key Laboratory of Image Processing and Intelligent Control Huazhong University of Science and Technology Ministry of Education Department of Biomedical Engineering College of Life Science and Technology Wuhan China Department of Biomedical Engineering Center for the Investigation of Membrane Excitability Disorders Cardiac Bioelectricity and Arrhythmia Center Washington University St Louis MOUSA Key Laboratory of Molecular Biophysics Huazhong University of Science and Technology Ministry of Education College of Life Science and Technology Wuhan China Department of Biomedical Engineering Center for the Investigation of Membrane Excitability Disorders Cardiac Bioelectricity and Arrhythmia Center Washington University St Louis MOUSA

来源：评论

学校读者我要写书评

暂无评论

Real-time Multi-person Eyeblink Detection in the Wild for Untrimmed Video

Real-time Multi-person Eyeblink Detection in the Wild for Un...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Wenzheng Zeng Yang Xiao Sicheng Wei Jinfang Gan Xintao Zhang Zhiguo Cao Zhiwen Fang Joey Tianyi Zhou Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China School of Biomedical Engineering Southern Medical University Guangzhou China Department of Rehabilitation Medicine Zhujiang Hospital Southern Medical University Guangzhou China Centre for Frontier AI Research Agency for Science Technology and Research (A*STAR) Singapore Institute of High Performance Computing Agency for Science Technology and Research (A*STAR) Singapore

Real-time eyeblink detection in the wild can widely serve for fatigue detection, face anti-spoofing, emotion analysis, etc. The existing research efforts generally focus on single-person cases towards trimmed video. However, multi-person scenario within untrimmed videos is also important for practical applications, which has not been well concerned yet. To address this, we shed light on this research field for the first time with essential contributions on dataset, theory, and practices. In particular, a large-scale dataset termed MPEblink that involves 686 untrimmed videos with 8748 eyeblink events is proposed under multi-person conditions. The samples are captured from uncon-strainedfilms to reveal “in the wild“ characteristics. Meanwhile, a real-time multi-person eyeblink detection method is also proposed. Being different from the existing counter-parts, our proposition runs in a one-stage spatio-temporal way with end-to-end learning capacity. Specifically, it simultaneously addresses the sub-tasks of face detection, face tracking, and human instance-level eyeblink detection. This paradigm holds 2 main advantages: (1) eyeblink features can be facilitated via the face's global context (e.g., head pose and illumination condition) with joint optimization and interaction, and (2) addressing these sub-tasks in parallel instead of sequential manner can save time remarkably to meet the real-time running requirement. Experiments on MPEblink verify the essential challenges of real-time multi-person eyeblink detection in the wild for untrimmed video. Our method also outperforms existing approaches by large margins and with a high inference speed.

关键词：

来源：评论

学校读者我要写书评

暂无评论

IF2Net: Innately Forgetting-Free Networks for Continual Learning

arXiv

引用

arXiv 2023年

作者： Li, Depeng Wang, Tianqi Xu, Bingrong Kawaguchi, Kenji Zeng, Zhigang Suganthan, Ponnuthurai Nagaratnam The School of Artificial Intelligence and Automation The Institute of Artificial Intelligence Huazhong University of Science and Technology The Key Laboratory of Image Processing and Intelligent Control Education Ministry of China Wuhan430074 China The School of Automation Wuhan University of Technology Wuhan430070 China The School of Computing National University of Singapore 117417 Singapore The School of Electrical and Electronic Engineering Nanyang Technological University Singapore639798 Singapore The KINDI Center for Computing Research College of Engineering Qatar University Doha Qatar

Continual learning can incrementally absorb new concepts without interfering with previously learned knowledge. Motivated by the characteristics of neural networks, in which information is stored in weights on connections, we investigated how to design an Innately Forgetting-Free Network (IF2Net) for continual learning context. This study proposed a straightforward yet effective learning paradigm by ingeniously keeping the weights relative to each seen task untouched before and after learning a new task. We first presented the novel representation-level learning on task sequences with random weights. This technique refers to tweaking the drifted representations caused by randomization back to their separate task-optimal working states, but the involved weights are frozen and reused (opposite to well-known layer-wise updates of weights). Then, sequential decision-making without forgetting can be achieved by projecting the output weight updates into the parsimonious orthogonal space, making the adaptations not disturb old knowledge while maintaining model plasticity. IF2Net allows a single network to inherently learn unlimited mapping rules without telling task identities at test time by integrating the respective strengths of randomization and orthogonalization. We validated the effectiveness of our approach in the extensive theoretical analysis and empirical study. Copyright © 2023, The Authors. All rights reserved.

关键词： Decision making

来源：评论

学校读者我要写书评

暂无评论

End-to-end Driving in High-Interaction Traffic Scenarios with Reinforcement Learning

arXiv

引用

arXiv 2024年

作者： Li, Yueyuan Jiang, Mingyang Zhang, Songan Yuan, Wei Wang, Chunxiang Yang, Ming The Department of Automation Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai200240 China The Global Institute of Future Technology Shanghai Jiao Tong University Shanghai200240 China The Innovation Center of Intelligent Connected Vehicles Global Institute of Future Technology Shanghai Jiao Tong University Shanghai200240 China

Dynamic and interactive traffic scenarios pose significant challenges for autonomous driving systems. Reinforcement learning (RL) offers a promising approach by enabling the exploration of driving policies beyond the constraints of pre-collected datasets and predefined conditions, particularly in complex environments. However, a critical challenge lies in effectively extracting spatial and temporal features from sequences of high-dimensional, multi-modal observations while minimizing the accumulation of errors over time. Additionally, efficiently guiding large-scale RL models to converge on optimal driving policies without frequent failures during the training process remains tricky. We propose an end-to-end model-based RL algorithm named Ramble to address these issues. Ramble processes multi-view RGB images and LiDAR point clouds into low-dimensional latent features to capture the context of traffic scenarios at each time step. A transformer-based architecture is then employed to model temporal dependencies and predict future states. By learning a dynamics model of the environment, Ramble can foresee upcoming traffic events and make more informed, strategic decisions. Our implementation demonstrates that prior experience in feature extraction and decision-making plays a pivotal role in accelerating the convergence of RL models toward optimal driving policies. Ramble achieves state-of-the-art performance regarding route completion rate and driving score on the CARLA Leaderboard 2.0, showcasing its effectiveness in managing complex and dynamic traffic situations. Copyright © 2024, The Authors. All rights reserved.

关键词： Deep reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Event-Triggered Model Predictive control for A Three-Phase Inverter with Output LC Filter

Event-Triggered Model Predictive Control for A Three-Phase I...

引用

IEEE Conference on Industrial Electronics and Applications (ICIEA)

作者： Benfei WANG Jingjing HUANG Jose RODRIGUEZ Cristian GARCIA Guodong FENG School of Intelligent Systems Engineering Sun Yat-sen University Guangdong China Key Laboratory of System Control and Information Processing Ministry of Education Shanghai China School of Electronic and Information Engineering Xi’an Jiaotong University Xi’an China Engineering School Universidad Andrés Bello Santiago Chile Engineering Faculty Universidad de Talca Curico Chile

ISBN: (数字)9781728151694

ISBN: (纸本)9781728151700

This paper proposes an event-triggered model predictive control (ET-MPC) method for the three-phase inverter with output LC filter. The proposed method is developed by combining the conventional finite-control-set MPC (FCS-MPC) method and the ET control strategy. The ET control strategy incorporates a preset triggering condition based on the requirement of the regulation performance for the three-phase inverter. When the state of the three-phase inverter activates the triggering condition, FCS-MPC is triggered with the updated state so that the optimal control actions can be generated when it is necessary. If the state of the inverter is within the preset triggering condition, FCS-MPC is suspended and the control actions are held as constant. Consequently, the unnecessary online prediction, online optimization, and the corresponding control actions can be avoided. Therefore, with the tolerate regulation performance, the proposed ET-MPC can reduce the computational burden of the conventional FCS-MPC. The various simulation studies of the three-phase inverter are conducted and discussed to demonstrate the effectiveness of the proposed ET-MPC method.

关键词： Computational modeling Simulation Switches Inverters Regulation Optimization Predictive control

来源：评论

学校读者我要写书评

暂无评论

Quantum gyroscopes based on double-mode surface-acoustic-wave cavities

arXiv

引用

arXiv 2024年

作者： Zhu, Yuting Xue, Shibei Ju, Fangfang Yuan, Haidong Department of Automation Shanghai Jiao Tong University Shanghai200240 China Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai200240 China Shanghai Engineering Research Center of Intelligent Control and Management Shanghai200240 China Department of Mechanical and Automation Engineering The Chinese University of Hong Kong Shatin Hong Kong School of Physics and Electronics Hunan Normal University Changsha410081 China

Recent progress shows that a surface-acoustic-wave (SAW) cavity can not only induce quantum acoustic dynamics but also can form optomechanical-like systems. Its operating frequencies in the microwave band make it resistant to the thermal noise of surrounding environments, while its radiation-pressure couplings make it susceptible to weak forces. Based on these advantages, we propose a gyroscope comprising coupled microwave-SAW cavities. In this paper, we systematically consider the three indices including range, signal-to-noise ratio, and sensitivity, which are the most important to gyroscopes but only partially considered in existing works. Additionally, we establish the fundamental limits of sensitivity when the quantum input is in the vacuum state and the squeezed vacuum state. We find that squeezing improves sensitivity and can surpass the standard quantum limit. However, this improvement can only reach up to √2/2 even as the squeezed parameter approaches infinity, which is rarely noted in recent works. Finally, we also offer analytical constraints for cooperativity and squeezed parameters. These constraints can be utilized to design gyroscopes based on coupled cavities in experiments. Copyright © 2024, The Authors. All rights reserved.

关键词： Gyroscopes

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：