Unconstrained end-to-end text reading with feature rectification

作     者：Du, Chen Wang, Yanna Wang, Chunheng Xiao, Baihua Shi, Cunzhao 

作者机构：Chinese Acad Sci Inst Automat State Key Lab Management & Control Complex Syst Beijing 100190 Peoples R China Univ Chinese Acad Sci Beijing Peoples R China 

出 版 物：《PATTERN RECOGNITION LETTERS》 (模式识别快报)

年 卷 期：2021年第149卷

页      面：1-8页

核心收录：

学科分类：08[工学] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

基　　金：Key Programs of the Chinese Academy of Sciences [ZDBSSSWJSC004, ZDBSSSWJSC005] National Natural Science Foundation of China (NSFC) [62073326, 62071469] 

主　　题：Text recognition Text detection Position-sensitive network Features incompatibility End-to-end 

摘      要：We propose an end-to-end trainable network that can simultaneously localize and recognize irregular text from images. Specifically, we find the feature incompatibility problem, which arises from the contradiction between detection and recognition tasks for feature extraction of the convolutional neural network, and propose to introduce the larger-scale features for the recognition part to improve the accuracy of recognition instead of using the same feature with the detection. To extract effective text features for perspective and curved text recognition, we propose a position-sensitive network to rectify the text proposal features in the recognition branch. The position-sensitive network, which is trained in a weak supervision way, takes the proposal detection feature as input and outputs the feature rectification information. Experiments demonstrate that the proposed method can achieve state-of-the-art or highly competitive performance compared with baselines on a number of benchmarks. (c) 2021 Elsevier B.V. All rights reserved.