Apache Sedona (formerly GeoSpark) is a new in-memory cluster computing system for processing large-scale spatialdata, which extends the core of Apache Spark to support spatialdatatypes, partitioning techniques, spat...
详细信息
Apache Sedona (formerly GeoSpark) is a new in-memory cluster computing system for processing large-scale spatialdata, which extends the core of Apache Spark to support spatialdatatypes, partitioning techniques, spatial indexes, and spatial operations (e.g. spatial range, nearest neighbor, and spatial join queries). Distance-based Join Queries (DJQs), like nearest neighbor join (kNNJQ) or closest pairs queries (kCPQ), are not supported by it. Therefore, in this paper, we investigate how to design and implement efficient DJQ distributed algorithms in Apache Sedona, using the most appropriate spatial partitioning and other optimization techniques. The results of an extensive set of experiments with real-world datasets are presented, demonstrating that the proposed kNNJQ and kCPQ distributed algorithms are efficient, scalable, and robust in Apache Sedona. Finally, Sedona is also compared to other similar cluster computing systems, showing the best performance for kCPQ and competitive results for kNNJQ.
暂无评论