Microscopic augmented reality calibration with contactless line-structured light registration for surgical navigation

作     者：Li, Yuhua Jiang, Shan Yang, Zhiyong Yang, Shuo Zhou, Zeyang 

作者机构：Tianjin Univ Mech Engn Dept 135 Yaguan RdHaihe Educ Pk Tianjin 300350 Peoples R China 

出 版 物：《MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING》 (Med. Biol. Eng. Comput.)

年 卷 期：2025年第63卷第5期

页      面：1463-1479页

核心收录：

学科分类：0831[工学-生物医学工程（可授工学、理学、医学学位）] 0710[理学-生物学] 1001[医学-基础医学(可授医学、理学学位)] 0812[工学-计算机科学与技术（可授工学、理学学位）] 10[医学] 

基　　金：National Key R&D Pro-gram of China [2022YFB4702600] Guangdong Basic and Applied Basic Research Foundation [2023B1515120076] National Natural Science Foundation of China Beijing-Tianjin-Hebei Basic Research Cooperation Project [H202406573] Natural Science Foundation of Tianjin [23JCQNJC01920, 23JCQNJC01530] 

主　　题：Augmented reality Microscope calibration Surgical navigation system Point cloud processing Video stream fusion 

摘      要：The use of AR technology in image-guided neurosurgery enables visualization of lesions that are concealed deep within the brain. Accurate AR registration is required to precisely match virtual lesions with anatomical structures displayed under a microscope. The purpose of this work was to develop a real-time augmented surgical navigation system using contactless line-structured light registration, microscope calibration, and visible optical tracking. Contactless discrete sparse line-structured light point cloud is utilized to construct patient-image registration. Microscope calibration optimization with dimensional invariant calibrator is employed to enable real-time tracking of the microscope. The visible optical tracking integrates a 3D medical model with surgical microscope video in real time, generating an augmented microscope stream. The proposed patient-image registration algorithm yielded an average root mean square error (RMSE) of 0.78 +/- 0.14 mm. The pixel match ratio error (PMRE) of the microscope calibration was found to be 0.646%. The RMSE and PMRE of the system experiments are 0.79 +/- 0.10 mm and 3.30 +/- 1.08%, respectively. Experimental evaluations confirmed the feasibility and efficiency of microscope AR surgical navigation (MASN) registration. By means of registration technology, MASN overlays virtual lesions onto the microscopic view of the real lesions in real time, which can help surgeons to localize lesions hidden deep in tissue.