Web-based Exploration of Annotated Multi-Layered Relightable Image Models

作     者：Jaspe-Villanueva, Alberto Ahsan, Moonisa Pintus, Ruggero Giachetti, Andrea Marton, Fabio Gobbetti, Enrico 

作者机构：CRS4 Via Ampere 2 I-09134 Cagliari CA Italy Univ Verona Verona VR Italy 

出 版 物：《ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE》 (J. Comput. Cult. Heritage)

年 卷 期：2021年第14卷第2期

页      面：1–29页

核心收录：

学科分类：0303[法学-社会学] 08[工学] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

基　　金：European Uniona Sardinian Regional Authorities under project VIGECLAB Sardinian Regional Authorities under project TDM (POR FESR 2014-2020 Action 1.2.2) 

主　　题：3D visualization 2D visualization reflectance transformation imaging annotations 

摘      要：We introduce a novel approach for exploring image-based shape and material models registered with structured descriptive information fused in multi-scale overlays. We represent the objects of interest as a series of registered layers of imagebased shape and material data. These layers are represented at different scales and can come out of a variety of pipelines. These layers can include both Reflectance Transformation Imaging representations, and spatially varying normal and Bidirectional Reflectance Distribution Function fields, possibly as a result of fusing multi-spectral data. An overlay image pyramid associates visual annotations to the various scales. The overlay pyramid of each layer is created at data preparation time by either one of the three subsequent methods: (1) by importing it from other pipelines, (2) by creating it with the simple annotation drawing toolkit available within the viewer, and (3) with external image editing tools. This makes it easier for the user to seamlessly draw annotations over the region of interest. At runtime, clients can access an annotated multi-layered dataset by a standard web server. Users can explore these datasets on a variety of devices;they range from small mobile devices to large-scale displays used in museum installations. On all these aforementioned platforms, JavaScript/WebGL2 clients running in browsers are fully capable of performing layer selection, interactive relighting, enhanced visualization, and annotation display. We address the problem of clutter by embedding interactive lenses. This focus-and-context-aware (multiple-layer) exploration tool supports exploration of more than one representation in a single view. That allows mixing and matching of presentation modes and annotation display. The capabilities of our approach are demonstrated on a variety of cultural heritage use-cases. That involves different kinds of annotated surface and material models.