FROM INTENTION TO IMPLEMENTATION: AUTOMATING BIOMEDICAL RESEARCH VIA LLMS

作     者：Luo, Yi Shi, Linghang Li, Yihao Zhuang, Aobo Gong, Yeyun Liu, Ling Chen, Lin 

作者机构：School of Informatics Xiamen University China National Institute for Data Science in Health and Medicine Xiamen University China School of Medicine Xiamen University China Microsoft Research Asia China College of Computing Georgia Institute of Technology United States 

出 版 物：《arXiv》 (arXiv)

年 卷 期：2024年

核心收录：

主　　题：Hierarchical systems 

摘      要：Conventional biomedical research is increasingly labor-intensive due to the exponential growth of scientific literature and datasets. Artificial intelligence (AI), particularly Large Language Models (LLMs), has the potential to revolutionize this process by automating various steps. Still, significant challenges remain, including the need for multidisciplinary expertise, logicality of experimental design, and performance measurements. This paper introduces BioResearcher, the first end-to-end automated system designed to streamline the entire biomedical research process involving dry lab experiments. BioResearcher employs a modular multi-agent architecture, integrating specialized agents for search, literature processing, experimental design, and programming. By decomposing complex tasks into logically related sub-tasks and utilizing a hierarchical learning approach, BioResearcher effectively addresses the challenges of multidisciplinary requirements and logical complexity. Furthermore, BioResearcher incorporates an LLM-based reviewer for in-process quality control and introduces novel evaluation metrics to assess the quality and automation of experimental protocols. BioResearcher successfully achieves an average execution success rate of 63.07% across eight previously unmet research objectives. The generated protocols averagely outperform typical agent systems by 22.0% on five quality metrics. The system demonstrates significant potential to reduce researchers’ workloads and accelerate biomedical discoveries, paving the way for future innovations in automated research systems. Copyright © 2024, The Authors. All rights reserved.