3D floor plan recovery from overlapping spherical images

作     者：Giovanni Pintore Fabio Ganovelli Ruggero Pintus Roberto Scopigno Enrico Gobbetti 

作者机构：CRS4Visual Computing Group CNR-ISTIVisual Computing Group 

出 版 物：《Computational Visual Media》 (计算可视媒体（英文版）)

年 卷 期：2018年第4卷第4期

页      面：367-383页

核心收录：

学科分类：12[管理学] 1201[管理学-管理科学与工程(可授管理学、工学学位)] 08[工学] 

基　　金：partially supported by projects VIGEC and 3DCLOUDPRO 

主　　题：indoor reconstruction spherical panoramic cameras 360 degree photography multi-room environments 

摘      要：We present a novel approach to automatically recover, from a small set of partially overlapping spherical images, an indoor structure representation in terms of a 3D floor plan registered with a set of 3D environment maps. We introduce several improvements over previous approaches based on color and spatial reasoning exploiting Manhattan world priors. In particular, we introduce a new method for geometric context extraction based on a 3D facet representation,which combines color distribution analysis of individual images with sparse multi-view clues. We also introduce an efficient method to combine the facets from different viewpoints in a single consistent model, taking into the reliability of the facet information. The resulting capture and reconstruction pipeline automatically generates 3D multi-room environments in cases where most previous approaches fail, e.g., in the presence of hidden corners and large clutter, without the need for additional dense 3D data or tools. We demonstrate the effectiveness and performance of our approach on different real-world indoor scenes. Our test data is available to allow further studies and comparisons.