Among the most important human needs is the desire to live as comfortably and independently as possible. Nothing bothers the patient so much as the infirmity of his own body, often resulting in a high dependence on th...
详细信息
Methods of surgical plan determination are the topic of this paper. Neurosurgical operations are especially dangerous because of the risk of damage important areas in the brain. Results of such damage can be patient...
详细信息
In this study, a robust H∞, controller for a quarter-car model of an active inerter-based suspension in the presence of external disturbance has been investigated. Its prime goal is to improve the inherent trade-offs...
详细信息
An example of a system with hysteresis is an actuator made of SMA. In the paper, the LSTM neural network was used to model the actuator. The focus was pointed to its hysteretic part. Neural network structure and learn...
详细信息
The beginning of the paper introduces the idea of neural networks by presenting the neuron models and artificial neural networks. Next, the flow of operations used in the development of convolutional neural networks i...
详细信息
When building digital twins of existing technical solutions, we need a large amount of data on the parameters of their operation under various conditions. The source of data on the values of process variables at the l...
详细信息
This paper addresses the task of road scene classification by leveraging multi-task learning (MTL) to improve model performance and computational efficiency. We employ the BDD100K dataset, which provides diverse drivi...
详细信息
The paper presents three object localisation methods in 3D space using a laser scanner sensor as a measured reference signal. The authors used the Velodyne LIDAR sensor and Matlab software to realise the described alg...
详细信息
Functional Data Analysis (FDA) is a modern statistical technique that deals with data in the form of curves or functions. It has recently gained popularity in the field of fault detection as it can capture the dynamic...
详细信息
Goal-conditioned reinforcement learning(RL)is an interesting extension of the traditional RL framework,where the dynamic environment and reward sparsity can cause conventional learning algorithms to *** shaping is a p...
详细信息
Goal-conditioned reinforcement learning(RL)is an interesting extension of the traditional RL framework,where the dynamic environment and reward sparsity can cause conventional learning algorithms to *** shaping is a practical approach to improving sample efficiency by embedding human domain knowledge into the learning *** reward shaping methods for goal-conditioned RL are typically built on distance metrics with a linear and isotropic distribution,which may fail to provide sufficient information about the ever-changing environment with high *** paper proposes a novel magnetic field-based reward shaping(MFRS)method for goal-conditioned RL tasks with dynamic target and *** by the physical properties of magnets,we consider the target and obstacles as permanent magnets and establish the reward function according to the intensity values of the magnetic field generated by these *** nonlinear and anisotropic distribution of the magnetic field intensity can provide more accessible and conducive information about the optimization landscape,thus introducing a more sophisticated magnetic reward compared to the distance-based ***,we transform our magnetic reward to the form of potential-based reward shaping by learning a secondary potential function concurrently to ensure the optimal policy invariance of our *** results in both simulated and real-world robotic manipulation tasks demonstrate that MFRS outperforms relevant existing methods and effectively improves the sample efficiency of RL algorithms in goal-conditioned tasks with various dynamics of the target and obstacles.
暂无评论