A Strategy of Parallel Seed-Based Image Segmentation Algorithms for Handling Massive Image Tiles over the Spark Platform

作     者：Chen, Fang Wang, Ning Yu, Bo Qin, Yuchu Wang, Lei 

作者机构：Chinese Acad Sci Aerosp Informat Res Inst Key Lab Digital Earth Sci 9 Dengzhuang South Rd Beijing 100094 Peoples R China Univ Chinese Acad Sci Beijing 100049 Peoples R China Chinese Acad Sci Aerosp Informat Res Inst State Key Lab Remote Sensing Sci Beijing 100101 Peoples R China Chinese Acad Sci Aerosp Informat Res Inst Hainan Key Lab Earth Observat Sanya 572029 Peoples R China 

出 版 物：《REMOTE SENSING》 (遥感)

年 卷 期：2021年第13卷第10期

页      面：1969-1969页

核心收录：

学科分类：0830[工学-环境科学与工程（可授工学、理学、农学学位）] 1002[医学-临床医学] 070801[理学-固体地球物理学] 07[理学] 08[工学] 0708[理学-地球物理学] 0816[工学-测绘科学与技术] 

基　　金：National Key R&D Program of China [2019YFD1100803] 

主　　题：segmentation algorithm distributed computation image processing spark platform digital disaster reduction 

摘      要：The volume of remote sensing images continues to grow as image sources become more diversified and with increasing spatial and spectral resolution. The handling of such large-volume datasets, which exceed available CPU memory, in a timely and efficient manner is becoming a challenge for single machines. The distributed cluster provides an effective solution with strong calculation power. There has been an increasing number of big data technologies that have been adopted to deal with large images using mature parallel technology. However, since most commercial big data platforms are not specifically developed for the remote sensing field, two main issues exist in processing large images with big data platforms using a distributed cluster. On the one hand, the quantities and categories of official algorithms used to process remote sensing images in big data platforms are limited compared to large amounts of sequential algorithms. On the other hand, the sequential algorithms employed directly to process large images in parallel over a distributed cluster may lead to incomplete objects in the tile edges and the generation of large communication volumes at the shuffle stage. It is, therefore, necessary to explore the distributed strategy and adapt the sequential algorithms over the distributed cluster. In this research, we employed two seed-based image segmentation algorithms to construct a distributed strategy based on the Spark platform. The proposed strategy focuses on modifying the incomplete objects by processing border areas and reducing the communication volume to a reasonable size by limiting the auxiliary bands and the buffer size to a small range during the shuffle stage. We calculated the F-measure and execution time to evaluate the accuracy and execution efficiency. The statistical data reveal that both segmentation algorithms maintained high accuracy, as achieved in the reference image segmented in the sequential way. Moreover, generally the strategy took le