Modeling With Prejudice: Small-Sample Learning via Adversary for Semantic Segmentation

作     者：Jiang, Zhiyu Wang, Qi Yuan, Yuan 

作者机构：Northwestern Polytech Univ Ctr Opt Imagery Anal & Learning OPTIMAL Sch Comp Sci Xian 710072 Shaanxi Peoples R China 

出 版 物：《IEEE ACCESS》 (IEEE Access)

年 卷 期：2018年第6卷

页      面：77965-77974页

核心收录：

基　　金：National Key R&D Program of China [2017YFB1002202] State Key Program of National Natural Science Foundation of China National Natural Science Foundation of China Natural Science Foundation of Shaanxi Province [2018KJXX-024] Fundamental Research Funds for the Central Universities [3102017AX010] Open Research Fund of Key Laboratory of Spectral Imaging Technology, Chinese Academy of Sciences 

主　　题：Adversary learning CRF probabilistic graphical model semantic segmentation small-sample learning 

摘      要：Semantic segmentation has become one of the core tasks for scene understanding and many high-level works heavily rely on its performance. In the past decades, much progress has been achieved. However, some problems still need to be settled. One problem is about the challenging classification of various objects, which are with diverse viewpoints, illumination, appearance, and cluttered backgrounds, in a unified framework. The other one is focusing on the unbalanced distribution of semantic labels, where long-tail phenomenon exists and the trained model tends to be biased toward the majority classes when testing. And this problem can be regarded as the small-sample learning problem in semantic segmentation for the number of training samples upon the minority classes are small. For tackling these problems, a small-sample learning method via adversary is proposed and three contributions are claimed: 1) discriminatory modeling for semantic segmentation: two submodels are simultaneously built based on the attribute of semantic classs;2) hierarchical contextual information consideration: both local and global contextual relationships are equally modeled under a hierarchical probabilistic graphical method and neighborhood relationship in label space are also considered;and 3) adversary learning for small-sample modeling: according to the structural relationships between small samples and the others, semantic classes are adversely modeled through computing the weighted costs. Experimental results on three benchmarks have verified the superiority of the proposed method compared with the state-of-the-arts.