EGBNet: a real-time edge-guided bilateral network for nighttime semantic segmentation

作     者：An, Guanhua Guo, Jichang Wang, Yudong Ai, Yufeng 

作者机构：Tianjin Univ Sch Elect & Informat Engn Tianjin Peoples R China 

出 版 物：《SIGNAL IMAGE AND VIDEO PROCESSING》 (信号，图像与视频处理)

年 卷 期：2023年第17卷第6期

页      面：3173-3181页

核心收录：

学科分类：0808[工学-电气工程] 1002[医学-临床医学] 0809[工学-电子科学与技术（可授工学、理学学位）] 08[工学] 

基　　金：National Natural Science Foundation of China Tianjin Research Innovation Project for Postgraduate Students [2021YJSB153] 

主　　题：Nighttime semantic segmentation Real-time processing Edge-guided Deep learning 

摘      要：Due to poor illumination and low contrast, semantic segmentation of nighttime images faces major challenges. Various segmentation models with a large number of parameters are proposed to improve the performance but lead to an inability to process in real time. To tackle these problems, we propose a real-time edge-guided bilateral network (EGBNet) for nighttime semantic segmentation. Considering the blurred details and low contrast of nighttime images, we propose a lightweight multi-dilation dense aggregation module and introduce an efficient edge head to improve the ability to distinguish target features from the nighttime background. Moreover, a self-adaptive feature fusion module is proposed for the bilateral segmentation network to enhance the feature representation and generalization ability by fully using multi-scale feature maps. To capture more useful information from limited nighttime images, we further use the knowledge distillation strategy to improve the segmentation performance. Extensive experiments on ACDC and BDD datasets demonstrate the effectiveness of our EGBNet by achieving a satisfactory trade-off between segmentation accuracy and inference speed. Specifically, EGBNet achieves 55.56% mIoU on the ACDC test set with 9.4 M parameters and 60FPS speed for a 1080 x 1920 input image on a single NVIDIA 2080Ti.