检索结果-内蒙古大学图书馆

Parallel Reinforcement Learning:A Framework and Case Study

IEEE/CAA Journal of Automatica Sinica 2018年第4期5卷 827-835页

作者： Teng Liu Bin Tian Yunfeng Ai Li Li Dongpu Cao Fei-Yue Wang State Key Laboratory of Management and Control for Complex System Institute of AutomationChinese Academy of SciencesBeijing 100190China State Key Lab.of Management and Control for Complex System Institute of AutomationChinese Academy of SciencesBeijing 100190China Cloud Computing Center Chinese Academy of SciencesDongguan 523808China School of Artificial Intelligence University of Chinese Academy of SciencesBeijing 100190China Department of Automation Tsinghua UniversityBeijing 100190China Driver Cognition and Automated Driving Laboratory University of WaterlooWaterloo N2L 3G1Canada IEEE

In this paper, a new machine learning framework is developed for complex system control, called parallel reinforcement learning. To overcome data deficiency of current data-driven algorithms, a parallel system is built to improve complex learning system by self-guidance. Based on the Markov chain(MC) theory, we combine the transfer learning, predictive learning, deep learning and reinforcement learning to tackle the data and action processes and to express the knowledge. Parallel reinforcement learning framework is formulated and several case studies for real-world problems are finally introduced.

关键词： Deep learning machine learning parallel reinforcement learning parallel system predictive learning transfer learning

来源：评论

学校读者我要写书评

暂无评论

A Gait Events Detection Algorithm Based on the Invariant Characteristic of Hip Joint Kinematics 33

A Gait Events Detection Algorithm Based on the Invariant Cha...

引用

第33届中国控制与决策会议

作者： Ningcun Xu Xiwei Peng Liang Peng Zeng-Guang Hou Institute of Intelligent Sensing & Motion Control School of AutomationBeijing Institute of Technology The State Key Laboratory for Management and Control of Complex Systems(SKL-MCCS) Institute of AutomationChinese academy of Science

ISBN: (纸本)9781665431293

In order to make up for the shortcomings of a single inertial sensor,which is easily disturbed and unable to directly describe the periodic characteristics of gait,a novel gait events detection algorithm is proposed which is based on the invariant characteristics of hip joint *** healthy volunteers conducted a walking experiment over the ground,who were equipped with motion capture device and insole with *** hip angle derived from motion capture device were applied to detect gait events,heel stride(HS) and toe off(TO).And the gait events detected by ground reactor force(GRF) were taken as the reference *** mean absolute difference of HS is 28±42 ms,and the mean absolute difference of TO is 27 ± 43 ms. And the confidence levels of the two gait events are 97.5% and 99.2%,*** results demonstrate that the proposed gait events detection algorithm is reliability and has potential clinical application value.

关键词： gait event inertial sensor hip joint kinematics statistical analysis

来源：评论

学校读者我要写书评

暂无评论

A SINS Error Correction Approach Based on Dual-Threshold ZV Detection and Cubature Kalman Filter

A SINS Error Correction Approach Based on Dual-Threshold ZV ...

引用

2023 IEEE International Conference on systems, Man, and Cybernetics, SMC 2023

作者： Xu, Ruijie Chen, Shichao Sun, Wenqiao Lv, Yisheng Luo, Jialiang Tang, Ying Institute of Automation Chinese Academy of Sciences College of Information Science & Technology Beijing University of Chemical Technology The State Key Laboratory for Management and Control of Complex System State Key Laboratory of Multimodal Artificial Intelligence Systems Beijing China Institute of Automation Chinese Academy of Sciences The Center of National Railway Intelligent Transportation System Engineering and Technology China Academy of Railway Sciences Corporation Limited The State Key Laboratory for Management and Control of Complex System State Key Laboratory of Multimodal Artificial Intelligence Systems Beijing China Transportation and Economics Research Institute The Center of National Railway Intelligent Transportation System Engineering and Technology China Academy of Railway Sciences Corporation Limited Beijing China Institute of Automation Chinese Academy of Sciences The State Key Laboratory for Management and Control of Complex System State Key Laboratory of Multimodal Artificial Intelligence Systems Beijing China Institute of Automation Chinese Academy of Sciences China University of Geosciences Beijing School of Information Engineering The State Key Laboratory for Management and Control of Complex System State Key Laboratory of Multimodal Artificial Intelligence Systems Beijing China Rowan University Department of Electrical and Computer Engineering Glassboro United States

ISBN: (纸本)9798350337020

Global Navigation Satellite systems (GNSS) can provide real-time positioning information for outdoor users, but cannot for indoor scenarios or heavily occluded outdoor scenarios. Strap-down Inertial Navigation system (SINS) are widely used to locate people in complex interior or heavily occluded outdoor scenarios due to its light weight and low power consumption. However, IMU of SINS are noisy, and the sampling data error is large, which is a divergence of the error with time. Therefore, it will generate a positioning accumulation error, which affects the final positioning accuracy. The problem of cumulative IMU errors is usually dealt with by Zero-Velocity Update (ZUPT). The zero-velocity detection part of basic ZUPT method usually uses a single threshold to determine the gait of pedestrian, which often has the problem of gait misjudgment and omission. To address these problems, this paper proposes a composite conditional detection method to solve the problem of misjudgment in the zero-velocity interval. In addition, we redesign the zero-velocity update algorithm and uses the Cubature Kalman filter (CKF) for pedestrian positioning error correction. The experimental results demonstrate that the proposed ZUPT method based on dual-threshold detection can better detect the interval between pedestrian motion and stationery than ones with single threshold. The zero-velocity update algorithm based on CKF has higher performance than conventional EKF and UKF methods, which constrains the cumulative error of SINS to about 0.2% of the whole walking distance. © 2023 IEEE.

关键词： Cubature Kalman Filter Inertial Pedestrian Navigation Zero-Velocity Update

来源：评论

学校读者我要写书评

暂无评论

Parallel intelligence： toward lifelong and eternal developmental AI and learning in cyber-physical-social spaces

引用

Frontiers of Computer Science 2018年第3期12卷 401-405页

作者： Fei-Yue WANG Jun Jason ZHANG Xiao WANG The State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing 100190 China School of Electrical Engineering Wuhan University Wuhan 430072 China Qingdao Academy of Intelligent Industries Qingdao 266109 China

Dear editor, Fundamentally, there are only two main approaches so far in artificial intelligence （AI）： reasoning-oriented formal logic approach and function-oriented computational intelligence approach, so called Neats vs. Scuruffies, which is a reflection of the historical fight between two schools of thought for formalism and empiricism respectively in the field of AI that is continuing even today.

关键词：

来源：评论

学校读者我要写书评

暂无评论

The Combination of Two control Strategies for Series Hybrid Electric Vehicles

引用

IEEE/CAA Journal of Automatica Sinica 2019年第2期6卷 596-608页

作者： Can Luo Zhen Shen Simos Evangelou Gang Xiong Fei-Yue Wang State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Cloud Computing Center Chinese Academy of Sciences IEEE Department of Electrical and Electronic Engineering Imperial College London Beijing Engineering Research Center of Intelligent Systems and Technology Institute of Automation Chinese Academy of Sciences Qingdao Academy of Intelligent Industries

With most countries paying attention to the environment protection, hybrid electric vehicles have become a focus of automobile research and development due to the characteristics of energy saving and low emission. Power follower control strategy(PFCS) and DC-link voltage control strategy are two sorts of control strategies for series hybrid electric vehicles(HEVs). Combining those two control strategies is a new idea for control strategy of series hybrid electric vehicles. By tuning essential parameters which are the defined constants under DClink voltage control and under PFCS, the points of minimum mass of equivalent fuel consumption(EFC) corresponding to a series of variables are marked for worldwide harmonized light vehicles test procedure(WLTP). The fuel economy of series HEVs with the combination control schemes performs better compared with individual control scheme. The results show the effects of the combination control schemes for series HEVs driving in an urban environment.

关键词： DC-Link voltage control power follower control strategy series hybrid electric vehicles tuning

来源：评论

学校读者我要写书评

暂无评论

一种仿生水下机器人的设计与动力学分析(英文)

引用

自动化学报 2013年第8期39卷 1330-1338页

作者： WEI Qing-Ping WANG Shuo DONG Xiang SHANG Liu-Ji TAN Min The State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Institute of Intelligent Machines Chinese Academy of Sciences

A biomimetic underwater vehicle propelled by two undulating long-fins is introduced in this paper. The concerned vehicle is propelled by two symmetrical undulating long-fins installed on both sides. Ten servo motors are employed to drive the long-fins and cosine wave function is employed for motor control. A real-time control system is designed for controlling the long-fins by adjusting its oscillating frequency and oscillating amplitude. An inertial measurement unit is installed to collect the accelerations and angular velocity. To obtain the relationship between oscillating frequency/amplitude and swimming performance, kinematic analysis and hydromechanic analysis are given. By dividing the long-fin into many small elements and computing the hydrodynamic force acting on each element, the instantaneous thrust generated by the long-fin is obtained. Then the average thrust of the long-fin is obtained by summing up the forces acted on the elements in one undulating period. Then swimming experiments are carried out to validate the vehicle design and kinematic analysis and hydromechanic analysis. And two swimming motion modes including marching and rotating locomotion are chosen. Finally, discussions between the swimming performance and the oscillating parameters are given.

关键词：水下机器人车辆设计动力学分析起伏仿生鳍计算流体动力学运动学分析

来源：评论

学校读者我要写书评

暂无评论

Cyber-physical-social system in intelligent Transportation

引用

IEEE/CAA Journal of Automatica Sinica 2015年第3期2卷 320-333页

作者： Gang Xiong Fenghua Zhu Xiwei Liu Xisong Dong Wuling Huang Songhang Chen Kai Zhao the State Key Laboratory of Management and Control for Complex Systems Institute of AutomationChinese Academy of Science the Cloud Computing Center Chinese Academy of Sciences Qingdao Academy of Intelligent Industries Beijing Engineering Research Center for Intelligent Systems and Technology Institute of AutomationChinese Academy of Science

A cyber-physical system (CPS) is composed of a physical system and its corresponding cyber systems that are tightly fused at all scales and levels. CPS is helpful to improve the controllability, efficiency and reliability of a physical system, such as vehicle collision avoidance and zero-net energy buildings systems. It has become a hot R&D and practical area from US to EU and other countries. In fact, most of physical systems and their cyber systems are designed, built and used by human beings in the social and natural environments. So, social systems must be of the same importance as their CPSs. The indivisible cyber, physical and social parts constitute the cyber-physical-social system (CPSS), a typical complex system and it's a challengeable problem to control and manage it under traditional theories and methods. An artificial systems, computational experiments and parallel execution (ACP) methodology is introduced based on which data-driven models are applied to social system. Artificial systems, i.e., cyber systems, are applied for the equivalent description of physical-social system (PSS). Computational experiments are applied for control plan validation. And parallel execution finally realizes the stepwise control and management of CPSS. Finally, a CPSS-based intelligent transportation system (ITS) is discussed as a case study, and its architecture, three parts, and application are described in detail. © 2014 Chinese Association of Automation.

关键词： Amphibious vehicles complex networks Embedded systems intelligent systems Transportation

来源：评论

学校读者我要写书评

暂无评论

Self-Attention based Temporal Intrinsic Reward for Reinforcement Learning

Self-Attention based Temporal Intrinsic Reward for Reinforce...

引用

2021 China Automation Congress, CAC 2021

作者： Jiang, Zhuo Tian, Daiying Yang, Qingkai Peng, Zhihong The School of Automation Beijing Institute of Technology Beijing China State Key Laboratory of Intelligent Control and Decision of Complex System Beijing China Peng Cheng Laboratory Guangdong Shenzhen China

ISBN: (纸本)9781665426473

This paper proposes a self-attention based temporal intrinsic reward model for reinforcement learning (RL), to synthesize the control policy for the agent constrained by the sparse reward in partially observable environments. This approach can solve the problem of temporal credit assignment to some extent and deal with the low efficiency of exploration. We first introduce a sequence-based self-attention mechanism to generate the temporary features, which can effectively capture the temporal property of the task for the agent. During the training process, the temporary features are employed in each sampled episode to elaborate the intrinsic rewards, which is combined with the extrinsic reward to help the agent learn a feasible policy. Then we use the meta-gradient to update this intrinsic reward model in order that the agent can achieve better performance. Experiments are given to demonstrate the superiority of the proposed method. © 2021 IEEE

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Linguistic dynamic analysis for single lane's traffic status based on FCM

Linguistic dynamic analysis for single lane's traffic status...

引用

2014 International Conference on Informative and Cybernetics for Computational Social systems, ICCSS 2014

作者： Jie, Wang Hong, Mo Fenghua, Zhu College of Electrical AndInformation Engineering Changsha University of Science and Technology Changsha China State Key Laboratory of Management and Control for Complex System Beijing China

ISBN: (纸本)9781479947522

The results of traditional traffic status analysis are mostly single values, whose accuracy can't be determined;fuzzy c-means clustering (FCM) algorithm based on fuzzy theory can calculate the clustering center of plenty data quickly and easily;linguistic dynamic systems could describe the dynamic rules of complex systems in the language level. In this paper, membership functions are decided by FCM;result of a specific time period taken as one example is obtained;it's discussed that linguistic dynamic analysis of traffic status in different period within a day by the same method. © 2014 IEEE.

关键词： Linguistics

来源：评论

学校读者我要写书评

暂无评论

Integrated Inspection of QoM, QoP, and QoS for AOI Industries in Metaverses

引用

IEEE/CAA Journal of Automatica Sinica 2022年第12期9卷 2071-2078页

作者： Yutong Wang Yonglin Tian Jiangong Wang Yansong Cao Shixing Li Bin Tian IEEE The State Key Laboratory for Management and Control of Complex Systems Chinese Academy of SciencesBeijing 100190China Department of Engineering Science Faculty of Innovation EngineeringMacao University of Science and TechnologyMacao 999078China North Automatic Control Technology Institute in Taiyuan ShanxiChina Qingdao Academy of Intelligent Industries Shandong 266109China

With the rapid development of information technologies such as digital twin, extended reality, and blockchain,the hype around "metaverse" is increasing at astronomical speed. However, much attention has been paid to its entertainment and social functions. Considering the openness and interoperability of metaverses, the market of quality inspection promises explosive growth. In this paper, taking advantage of metaverses, we first propose the concept of Automated Quality Inspection(Auto QI), which performs integrated inspection covering the entire manufacturing process, including Quality of Materials, Quality of Manufacturing(Qo M), Quality of Products, Quality of Processes(Qo P), Quality of systems, and Quality of Services(Qo S). Based on the scenarios engineering theory, we discuss how to perform interactions between metaverses and the physical world for virtual design instruction and physical validation feedback. Then we introduce a bottomup inspection device development workflow with productivity tools offered by metaverses, making development more effective and efficient than ever. As the core of quality inspection,we propose Quality Transformers to complete detection task,while federated learning is integrated to regulate data *** summary, we point out the development directions of quality inspection under metaverse tide.

关键词： Automated Optical Inspection Metaverses Quality Inspection Transformers

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：