More and more images/videos will be consumed by both human and machine in many fields. optimization of imageprocessingalgorithm for hybrid human and machine becomes a challenging task. To address this problem, featu...
详细信息
ISBN:
(纸本)9781728198354
More and more images/videos will be consumed by both human and machine in many fields. optimization of imageprocessingalgorithm for hybrid human and machine becomes a challenging task. To address this problem, feature structure similarity index (FSSIM) is proposed in this paper as an objective metric for image quality assessment (IQA), by defining structure similarity in low-level feature domain. Features extracted by the first convolutional layer of pretrained resnet50 network are treated as common feature domain for both human and machine vision. Moreover, multi-scale structure similarity with weighting matrix is used as distance measure in the feature domain. FSSIM is capable of fully decoupling imageprocessing and its downstream machine tasks, enabling image processing algorithm optimization for hybrid human and machine vision. Experimental results show FSSIM-optimized imageprocessingalgorithms achieve significant performance improvement over existing metrics in context of machine vision tasks including object detection and semantic segmentation. Meanwhile reconstructed images of FSSIM-optimized algorithms are better friendly to human vision.
暂无评论