A hybrid spatial error concealment using human face and image edge over H.264/AVC video sequences

作     者：Nam, Cholman Ryu, Sun Chu, Changgon Kim, Taeguk Choe, Sungran Choe, Jinhyok 

作者机构：Kim II Sung Univ Informat & Commun Lab Sch Informat Sci Pyongyang North Korea Kim II Sung Univ Informat & Artificial Intelligence Lab Sch Informat Sci Pyongyang North Korea Kim II Sung Univ Visual Informat Proc Lab Sch Informat Sci Pyongyang North Korea 

出 版 物：《MULTIMEDIA TOOLS AND APPLICATIONS》 (多媒体工具和应用)

年 卷 期：2023年第82卷第3期

页      面：3769-3799页

核心收录：

学科分类：0808[工学-电气工程] 08[工学] 0835[工学-软件工程] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

主　　题：Multi-direction-based filling interpolation Horizontal symmetrical interpolation Block division-based interpolation Adaptive selection based hybrid error concealment Bezier curve-based block division 

摘      要：This paper proposes a human face and image edge-based hybrid spatial error concealment. Though human faces on video sequences are of most interest, the face error concealment is not yet easy in case of loss of face information. And furthermore, when there are bit errors in regular edge shapes in background, it affects more seriously to visual effect than irregular image characteristics. In order to overcome these challenges, the proposed algorithm, at first, classifies the lost block into foreground, boundary and background by using face detection, and then selects adaptively bilinear interpolation(BI) and horizontal symmetrical interpolation(HSI) for foreground, multi-direction filling interpolation(MDFI) for boundary and block division-based interpolation(BDI) for background. HSI, MDFI, Bezier curve-based block division of foreground and background and BDI of background are novel error concealments which are proposed in this paper. Our test reveals that the proposed error concealment can achieve a better PSNR compared with previous works including separate, adaptive or hybrid concealments, in terms of visual effect, PSNR and runtime, etc. The proposed algorithm may be utilized as an effective error resilient tool for real-time video applications, such as telephone conference, mobile telephone conference and wireless multimedia camera networks in which power consumption should be low.