This paper presents an interactive motion control method based on reinforcement learning, designed to assist children with autism who have social motor impairments through a mirror game intervention. The virtual teach...
详细信息
ISBN:
(数字)9798331521950
ISBN:
(纸本)9798331521967
This paper presents an interactive motion control method based on reinforcement learning, designed to assist children with autism who have social motor impairments through a mirror game intervention. The virtual teacher uses the Deep Deterministic Policy Gradient (DDPG) algorithm to optimize its actions, guiding the participant to follow a Lissajous trajectory. To ensure safety, a motion-correction mechanism was developed, which automatically adjusts actions when the predicted trajectory surpasses predefined safety boundaries. The reward function considers both the distance between the virtual teacher and the target trajectory, as well as the distance between the virtual teacher and the participant, with dynamic adjustments applied by the motion-correction mechanism. Experimental results demonstrate that the virtual teacher effectively guides the participant towards the target trajectory while adhering to safety constraints.
This study investigated the oil pollution remediation ability of konjac glucomannan (KGM) aerogel immobilized Chlorella vulgaris LH-1 (C. vulgaris). The KGM aerogel exhibited a high porosity of 86.83 %, and with the c...
详细信息
A single-bus DC microgrid can represent a wide range of applications. control objectives of such systems include high-performance bus voltage regulation and proper load sharing among multiple distributed generators(DG...
详细信息
A single-bus DC microgrid can represent a wide range of applications. control objectives of such systems include high-performance bus voltage regulation and proper load sharing among multiple distributed generators(DGs) under various operating conditions. This paper presents a novel decentralized control algorithm that can guarantee both the transient voltage control performance and realize the predefined load sharing percentages. First, the output-constrained control problem is transformed into an equivalent unconstrained one. Second, a two-step backstepping control algorithm is designed based on the transformed model for bus-voltage regulation. Since the overall control effort can be split proportionally and calculated with locally-measurable signals, decentralized load sharing can be realized. The control design requires neither accurate parameters of the output filters nor load measurement. The stability of the transformed systems under the proposed control algorithm can indirectly guarantee the transient bus voltage performance of the original system. Additionally, the high-performance control design is robust, flexible, and reliable. Switch-level simulations under both normal and fault operating conditions demonstrate the effectiveness of the proposed algorithm.
The ever-changing battlefield environment requires the use of robust and adaptive technologies integrated into a reliable platform. Unmanned combat aerial vehicles(UCAVs) aim to integrate such advanced technologies wh...
详细信息
The ever-changing battlefield environment requires the use of robust and adaptive technologies integrated into a reliable platform. Unmanned combat aerial vehicles(UCAVs) aim to integrate such advanced technologies while increasing the tactical capabilities of combat aircraft. As a research object, common UCAV uses the neural network fitting strategy to obtain values of attack areas. However, this simple strategy cannot cope with complex environmental changes and autonomously optimize decision-making problems. To solve the problem, this paper proposes a new deep deterministic policy gradient(DDPG) strategy based on deep reinforcement learning for the attack area fitting of UCAVs in the future battlefield. Simulation results show that the autonomy and environmental adaptability of UCAVs in the future battlefield will be improved based on the new DDPG algorithm and the training process converges quickly. We can obtain the optimal values of attack areas in real time during the whole flight with the well-trained deep network.
This paper develops a model-based diagnostic method for internal short circuit (ISC) faults in lithium-ion batteries. This method utilizes a second-order equivalent circuit model (ECM) combined with a recursive least ...
详细信息
Tissue P systems are a class of distributed and parallel computing models inspired from inter-cellular communication and cooperation between cells. In this work, a variant of tissue P system, named tissue P system wit...
详细信息
Tissue P systems are a class of distributed and parallel computing models inspired from inter-cellular communication and cooperation between cells. In this work, a variant of tissue P system, named tissue P system with look-ahead mode, is discussed for decreasing the inherent non-determinism of tissue P systems and helping implementing tissue P systems on computers. Such systems are proved to be universal by simulating register machine, and they are also proved to be able to efficiently solve computationally hard problems by means of a spacetime tradeoff, which is illustrated with a polynomial solution to 3-coloring problem.
Residual stress in high-carbon steel affects the dimensional accuracy, structural stability, and integrity of components. Although the evolution of residual stress under an electric field has received extensive attent...
详细信息
Residual stress in high-carbon steel affects the dimensional accuracy, structural stability, and integrity of components. Although the evolution of residual stress under an electric field has received extensive attention, its elimination mechanism has not been fully clarified. In this study, it was found that the residual stress of high-carbon steel could be effectively relieved within a few minutes through the application of a low density pulse current. The difference between the current pulse treatment and traditional heat treatment in reducing residual stress is that the electric pulse provides additional Gibbs free energy for the system, which promotes dislocation annihilation and carbon atom diffusion to form carbides, thus reducing the free energy of the system. The electroplastic and thermal effects of the pulse current promoted the movement of dislocations under the electric field, thus eliminating the internal stress caused by dislocation entanglement. The precipitation of carbides reduced the carbon content of the steel matrix and lattice shrinkage, thereby reducing the residual tensile stress. Considering that a pulsed current has the advantages of small size, small power requirement, continuous output, and continuously controllable parameters, it has broad application prospects for eliminating residual stress.
Public blockchain has outstanding performance in transaction privacy protection because of its anonymity. The data openness brings feasibility to transaction behavior analysis. At present, the transaction data of the ...
详细信息
Public blockchain has outstanding performance in transaction privacy protection because of its anonymity. The data openness brings feasibility to transaction behavior analysis. At present, the transaction data of the public chain are huge, including complex trading objects and relationships. It is difficult to extract attributes and predict transaction behavior by traditional methods. To solve the problems, we extract the transaction features to construct the Ethereum transaction heterogeneous information network (HIN), and propose graph-neural-network-based transaction prediction method for public blockchain in HINs, which can divide the network into subgraphs according to connectivity and make the prediction results of transaction behavior more accurate. Experiments show that the execution time consumption of the proposed transaction subgraph division method is reduced by 70.61% on average compared with the search method. The accuracy of the proposed behavior prediction method also improve compared with the traditional random walk method, with an average accuracy of 83.82%.
The Bitcoin network comprises numerous nodes, necessitating users to invest significant network requests and time in comprehending its network topology. In this paper, we propose a Bitcoin network topology discovery a...
详细信息
The Bitcoin network comprises numerous nodes, necessitating users to invest significant network requests and time in comprehending its network topology. In this paper, we propose a Bitcoin network topology discovery algorithm that utilizes lightweight probe nodes to facilitate rapid transmission of network protocols. Building upon this, we introduce a node layer clustering algorithm based on filtering stable network nodes, enabling parallel discovery of the network topology. Additionally, we present an adaptive method for dynamically displaying the layered structure of the network topology. Experimental results demonstrate that our proposed method reduces communication overhead by approximately 72.16% when achieving a 95% similarity in network topology. Furthermore, the algorithm is applicable for discovering the network topology in other blockchain networks with similar structures.
暂无评论