Deep reinforcement learning for closed-loop blood glucose control: two approaches

作     者：Francesco Di Felice Alessandro Borri Maria Domenica Di Benedetto 

作者机构：Scuola Superiore Sant'Anna Istituto di Intelligenza Meccanica Pisa Italy CNR-IASI Biomathematics Laboratory National Research Council of Italy Rome Italy Department of Information Engineering Computer Science and Mathematics Center of Excellence for Research DEWS University of L'Aquila Italy 

出 版 物：《IFAC-PapersOnLine》 

年 卷 期：2022年第55卷第40期

页      面：115-120页

主　　题：Adaptive Learning Systems Modelling Control of Biomedical Systems Reinforcement learning control Numerical simulation 

摘      要：Reinforcement learning, thanks to the observation-action approach, represents a useful control tool, in particular when the dynamics are characterized by strong non-linearity and complexity. In this sense, it has a natural application in the biological systems field where the complexity of the dynamics makes the automatic control particularly challenging. This paper presents a combined application of neural networks and reinforcement learning, in the so-called field of deep reinforcement learning, for the glucose regulation problem in patients with diabetes mellitus. The glucose control problem is solved through the Deep Deterministic Policy Gradient (DDPG) and the Soft Actor-Critic (SAC) algorithms, where the environment exploited for the agent s interactions is represented by a glucose model that is completely unknown to agents. Preliminary results show that the DDPG and SAC agents can suitably control the glucose dynamics, making the proposed approach promising for further investigations. The comparison between the two agents shows a better behaviour of SAC algorithm.