Robots are playing a more and more important role in people's production and life, recently. However, robot control in dynamic environment is still a difficulty. With the great breakthrough of deep reinforcement l...
详细信息
With the rapid development of the transportation industry, Intelligent Transportation System (ITS) tries to adapt to industry changes through constructing new organizational forms, management methods, and incentive me...
详细信息
This paper presents a novel underactuated coupled adaptive hand exoskeleton, called UCAS-Hand, which is designed to assist users with weak muscle strength to complete the operation of daily living items. In mechanical...
详细信息
The concept of metaverses has received extensive attention recently and cyber-physical-social systems (CPSS) is its academic foundation. In almost all the applications of metaverses, the sensing system is an essential...
详细信息
The concept of metaverses has received extensive attention recently and cyber-physical-social systems (CPSS) is its academic foundation. In almost all the applications of metaverses, the sensing system is an essential part and intelligent sensing capacity must be provided. However, due to the insufficient consideration of human factors in most of the studies, digital twins' sensing in cyber-physical systems cannot achieve smart sensing in metaverses. For this reason, a novel framework for intelligent sensing in metaverses, MetaSensing, is proposed based on parallel intelligence in CPSS. Within the framework of MetaSensing, there are four states of sensing: physical sensing, descriptive sensing, predictive sensing, and prescriptive sensing. To protect sensors' data privacy in metaverses, DAO-based decentralized sensing is introduced as a mechanism of the operation and maintenance for smart sensing industries.
Feature correspondence is an important topic in many computer vision or robot vision tasks. Different from traditional optimization based matching method, in the last two years, researchers are finally able to solve t...
详细信息
ISBN:
(数字)9781665490627
ISBN:
(纸本)9781665490627
Feature correspondence is an important topic in many computer vision or robot vision tasks. Different from traditional optimization based matching method, in the last two years, researchers are finally able to solve the matching process in a learning manner. As a representative method, SuperGlue achieves superior performance in many real-world tasks, but it still has problems in dealing with outlier features. Targeting at the outlier problem, this paper improves SuperGlue by introducing a deep learning based feature correspondence method, which consists of the pruned attentional graph neural network and the improved matching layer for the outlier problem. Experiments on real world images validate the effectiveness of the proposed method.
The traditional dynamical models show lower accuracy when predicting joint movement, and should be compensated. This paper proposed a model combined with the convolutional network(CNN) and temporal convolutional netwo...
The traditional dynamical models show lower accuracy when predicting joint movement, and should be compensated. This paper proposed a model combined with the convolutional network(CNN) and temporal convolutional network(TCN) to compensate for the joint torque prediction values that are calculated from the sensing information. The experiments on the Cooperative Universal Robotic Assistant 6 DoF(CURA6) open dataset, including multi-load and multi-velocity, showed the prediction error can be reduced by 20% compared to other network models. Since there are many kinds of joint movement information, the input data form of the deep learning model should be improved. Thus, the kinetic linearization model is proposed to modify the input of sensing data. According to the different motion types of the CURA6 dataset, comparative experiments were taken, and the mean absolute error was less than 6.8%.
In this paper, we develop a novel non-parametric online actor-critic reinforcement learning (RL) algorithm to solve optimal regulation problems for a class of continuous-time affine nonlinear dynamical systems. To dea...
详细信息
In this paper, we develop a novel non-parametric online actor-critic reinforcement learning (RL) algorithm to solve optimal regulation problems for a class of continuous-time affine nonlinear dynamical systems. To deal with the value function approximation (VFA) with inherent nonlinear and unknown structure, a reproducing kernel Hilbert space (RKHS)-based kernelized method is designed through online sparsification, where the dictionary size is fixed and consists of updated elements. In addition, the linear independence check condition, i.e., an online criteria, is designed to determine whether the online data should be inserted into the dictionary. The RHKS-based kernelized VFA has a variable structure in accordance with the online data collection, which is different from classical parametric VFA methods with a fixed structure. Furthermore, we develop a sparse online kernelized actor-critic learning RL method to learn the unknown optimal value function and the optimal control policy in an adaptive fashion. The convergence of the presented kernelized actor-critic learning method to the optimum is provided. The boundedness of the closed-loop signals during the online learning phase can be guaranteed. Finally, a simulation example is conducted to demonstrate the effectiveness of the presented kernelized actor-critic learning algorithm.
Automatic surgical phase recognition plays a key role in surgical workflow analysis and overall optimization in clinical work. In the complicated surgical procedures, similar inter-class appearance and drastic variabi...
详细信息
ISBN:
(数字)9781728127828
ISBN:
(纸本)9781728127828
Automatic surgical phase recognition plays a key role in surgical workflow analysis and overall optimization in clinical work. In the complicated surgical procedures, similar inter-class appearance and drastic variability in phase duration make this still a challenging task. In this paper, a spatio-temporal transformer is proposed for online surgical phase recognition with different granularity. To extract rich spatial information, a spatial transformer is used to model global spatial dependencies of each time index. To overcome the variability in phase duration, a temporal transformer captures the multi-scale temporal context of different time indexes with a dual pyramid pattern. Our method is thoroughly validated on the public Cholec80 dataset with 7 coarse-grained phases and the CATARACTS2020 dataset with 19 fine-grained phases, outperforming state-of-the-art approaches with 91.4% and 84.2% accuracy, taking only 24.5M parameters.
This paper proposes a parallel system-based predictive control (PPC) method to address the problem of active traffic signal control in large-scale urban road networks. The method leverages simulated artificial transpo...
详细信息
ISBN:
(纸本)9798350399462
This paper proposes a parallel system-based predictive control (PPC) method to address the problem of active traffic signal control in large-scale urban road networks. The method leverages simulated artificial transportation systems to infer the short-term future operating states of the real transportation system. During the inference process, an efficient predictive learning-based multi-agent reinforcement learning (RL) algorithm is employed to optimize the cooperative control policies. The optimized policies are then deployed to the real transportation system at fixed intervals to adapt to the real-time and dynamic traffic flow. Experimental results demonstrate that PPC outperforms traditional traffic control methods and some multi-agent RL benchmarks in large-scale road network control scenarios with nearly two hundred intersections, showcasing superior generalization capabilities.
暂无评论