检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Song, Shuang Qin, Rongjun Geospatial Data Analytics Laboratory The Ohio State University Columbus United States Department of Civil Environmental and Geodetic Engineering The Ohio State University Columbus United States Department of Electrical and Computer Engineering The Ohio State University Columbus United States Translational Data Analytics Institute The Ohio State University Columbus United States

Modeling outdoor scenes for the synthetic 3D environment requires the recovery of reflectance/albedo information from raw images, which is an ill-posed problem due to the complicated unmodeled physics in this process (e.g., indirect lighting, volume scattering, specular reflection). The problem remains unsolved in a practical context. The recovered albedo can facilitate model relighting and shading, which can further enhance the realism of rendered models and the applications of digital twins. Typically, photogrammetric 3D models simply take the source images as texture materials, which inherently embed unwanted lighting artifacts (at the time of capture) into the texture. Therefore, these "polluted" textures are suboptimal for a synthetic environment to enable realistic rendering. In addition, these embedded environmental lightings further bring challenges to photo-consistencies across different images that cause image-matching uncertainties. This paper presents a general image formation model for albedo recovery from typical aerial photogrammetric images under natural illuminations and derives the inverse model to resolve the albedo information through inverse rendering intrinsic image decomposition. Our approach builds on the fact that both the sun illumination and scene geometry are estimable in aerial photogrammetry, thus they can provide direct inputs for this ill-posed problem. This physics-based approach does not require additional input other than data acquired through the typical drone-based photogrammetric collection and was shown to favorably outperform existing approaches. We also demonstrate that the recovered albedo image can in turn improve typical image processing tasks in photogrammetry such as feature and dense matching, edge, and line extraction. [This work extends our prior work "A Novel Intrinsic Image Decomposition Method to Recover Albedo for Aerial Images in Photogrammetry Processing" in ISPRS Congress 2022]. The code will be made available

关键词： Inverse problems

来源：评论

学校读者我要写书评

暂无评论

Adaptive and non-adaptive fusion algorithms analysis for digital surface model generated using census and convolutional neural networks 24

Adaptive and non-adaptive fusion algorithms analysis for dig...

引用

2021 24th ISPRS Congress Commission II: Imaging Today, Foreseeing Tomorrow

作者： Albanwan, Hessah Qin, Rongjun Geospatial Data Analytics Laboratory Department of Civil Environmental and Geodetic Engineering The Ohio State University ColumbusOH United States Department of Electrical and Computer Engineering The Ohio State University United States Translational Data Analytics Institute The Ohio State University United States

The digital surface models (DSM) fusion algorithms are one of the ongoing challenging problems to enhance the quality of 3D models, especially for complex regions with variable radiometric and geometric distortions like satellite datasets. DSM generation using Multiview stereo analysis (MVS) is the most common cost-efficient approach to recover elevations. Algorithms like Census-semi global matching (SGM) and Convolutional Neural Networks (MC-CNN) have been successfully implemented to generate the disparity and recover DSMs;however, their performances are limited when matching stereo pair images with ill-posed regions, low texture, dense texture, occluded, or noisy, which can yield missing or incorrect elevation values, in additions to fuzzy boundaries. DSM fusion algorithms have proven to tackle such problems, but their performance may vary based on the quality of the input and the type of fusion which can be classified into adaptive and non-adaptive. In this paper, we evaluate the performance of the adaptive and nonadaptive fusion methods using median filter, adaptive median filter, K-median clustering fusion, weighted average fusion, and adaptive spatiotemporal fusion for DSM generated using Census and MC-CNN. We perform our evaluation on 9 testing regions using stereo pair images from Worldview-3 satellite to generate DSMs using Census and MC-CNN. Our results show that adaptive fusion algorithms are more accurate than non-adaptive algorithms in predicting elevations due to their ability to learn from temporal and contextual information. Our results also show that MC-CNN produces better fusion results with a lower overall average RMSE than Census. © 2021 International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives. All rights reserved.

关键词： Textures

来源：评论

学校读者我要写书评

暂无评论

A CRITICAL ANALYSIS OF INTERNAL RELIABILITY FOR UNCERTAINTY QUANTIFICATION OF DENSE IMAGE MATCHING IN MULTI-VIEW STEREO

arXiv

引用

arXiv 2023年

作者： Huang, Debao Qin, Rongjun Geospatial Data Analytics Laboratory The Ohio State University Columbus United States Department of Civil Environmental and Geodetic Engineering The Ohio State University Columbus United States Department of Electrical and Computer Engineering The Ohio State University Columbus United States Translational Data Analytics Institute The Ohio State University Columbus United States

Nowadays, photogrammetrically derived point clouds are widely used in many civilian applications due to their low cost and flexibility in acquisition. Typically, photogrammetric point clouds are assessed through reference data such as LiDAR point clouds. However, when reference data are not available, the assessment of photogrammetric point clouds may be challenging. Since these point clouds are algorithmically derived, their accuracies and precisions are highly varying with the camera networks, scene complexity, and dense image matching (DIM) algorithms, and there is no standard error metric to determine per-point errors. The theory of internal reliability of camera networks has been well studied through first-order error estimation of Bundle Adjustment (BA), which is used to understand the errors of 3D points assuming known measurement errors. However, the measurement errors of the DIM algorithms are intricate to an extent that every single point may have its error function determined by factors such as pixel intensity, texture entropy, and surface smoothness. Despite the complexity, there exist a few common metrics that may aid the process of estimating the posterior reliability of the derived points, especially in a multi-view stereo (MVS) setup when redundancies are present. In this paper, by using an aerial oblique photogrammetric block with LiDAR reference data, we analyze several internal matching metrics within a common MVS framework, including statistics in ray convergence, intersection angles, DIM energy, etc. We associate these metrics to the per-point errors evaluated through LiDAR reference data and discuss their potential contributions in estimating internal reliabilities of point clouds derived from DIM algorithms. The experimental results show that ray convergence and DIM energy are relevant indicators for the accuracy of the generated point clouds. Initial investigation shows that these two indicators could be further utilized to infer the measurem

关键词： Photogrammetry

来源：评论

学校读者我要写书评

暂无评论

A NOVEL INTRINSIC IMAGE DECOMPOSITION METHOD TO RECOVER ALBEDO FOR AERIAL IMAGES IN PHOTOGRAMMETRY PROCESSING

arXiv

引用

arXiv 2022年

Recovering surface albedos from photogrammetric images for realistic rendering and synthetic environments can greatly facilitate its downstream applications in VR/AR/MR and digital twins. The textured 3D models from standard photogrammetric pipelines are suboptimal to these applications because these textures are directly derived from images, which intrinsically embedded the spatially and temporally variant environmental lighting information, such as the sun illumination, direction, causing different looks of the surface, making such models less realistic when used in 3D rendering under synthetic lightings. On the other hand, since albedo images are less variable by environmental lighting, it can, in turn, benefit basic photogrammetric processing. In this paper, we attack the problem of albedo recovery for aerial images for the photogrammetric process and demonstrate the benefit of albedo recovery for photogrammetry data processing through enhanced feature matching and dense matching. To this end, we proposed an image formation model with respect to outdoor aerial imagery under natural illumination conditions;we then, derived the inverse model to estimate the albedo by utilizing the typical photogrammetric products as an initial approximation of the geometry. The estimated albedo images are tested in intrinsic image decomposition, relighting, feature matching, and dense matching/point cloud generation results. Both synthetic and real-world experiments have demonstrated that our method outperforms existing methods and can enhance photogrammetric processing. Copyright © 2022, The Authors. All rights reserved.

关键词： Aerial photography

来源：评论

学校读者我要写书评

暂无评论

Sat2lod2: A Software For Automated Lod-2 Modeling From Satellite-Derived Orthophoto And Digital Surface Model

arXiv

引用

arXiv 2022年

作者： Gui, Shengxi Qin, Rongjun Tang, Yang Geospatial Data Analytics Laboratory The Ohio State University Columbus United States Department of Civil Environmental and Geodetic Engineering The Ohio State University Columbus United States Department of Electrical and Computer Engineering The Ohio State University Columbus United States Translational Data Analytics Institute The Ohio State University Columbus United States

Deriving LoD2 models from orthophoto and digital surface models (DSM) reconstructed from satellite images is a challenging task. Existing solutions are mostly system approaches that require complicated step-wise processes, including not only heuristic geometric operations, but also high-level steps such as machine learning-based semantic segmentation and building detection. Here in this paper, we describe an open-source tool, called SAT2LOD2, built based on a minorly modified version of our recently published work. SAT2LoD2 is a fully open-source and GUI (Graphics User Interface) based software, coded in Python, which takes an orthophoto and DSM as inputs, and outputs individual building models, and it can additionally take road network shapefiles, and customized classification maps to further improve the reconstruction results. We further improve the robustness of the method by 1) intergrading building segmentation based on HRNetV2 into our software;and 2) having implemented a decision strategy to identify complex buildings and directly generate mesh to avoid erroneous LoD2 reconstruction from a system point of view. The software can process a moderate level of data (around 5000*5000 size of orthophoto and DSM) using a PC with a graphics card supporting CUDA. Furthermore, the GUI is self-contained and stores the intermediate processing results facilitating researchers to learn the process easily and reuse intermediate files as needed. The updated codes and software are available under this GitHub page: https://***/GDAOSU/LOD2BuildingModel. Copyright © 2022, The Authors. All rights reserved.

关键词： Open source software

来源：评论

学校读者我要写书评

暂无评论

FINE-TUNING DEEP LEARNING MODELS FOR STEREO MATCHING USING RESULTS FROM SEMI-GLOBAL MATCHING

arXiv

引用

arXiv 2022年

作者： Albanwan, Hessah Qin, Rongjun Geospatial Data Analytics Laboratory The Ohio State University Columbus United States Department of Civil Environmental and Geodetic Engineering The Ohio State University Columbus United States Department of Electrical and Computer Engineering The Ohio State University Columbus United States Translational Data Analytics Institute The Ohio State University Columbus United States

Deep learning (DL) methods are widely investigated for stereo image matching tasks due to their reported high accuracies. However, their transferability/generalization capabilities are limited by the instances seen in the training data. With satellite images covering large-scale areas with variances in locations, content, land covers, and spatial patterns, we expect their performances to be impacted. Increasing the number and diversity of training data is always an option, but with the ground-truth disparity being limited in remote sensing due to its high cost, it is almost impossible to obtain the ground-truth for all locations. Knowing that classical stereo matching methods such as Census-based semi-global-matching (SGM) are widely adopted to process different types of stereo data, we therefore, propose a finetuning method that takes advantage of disparity maps derived from SGM on target stereo data. Our proposed method adopts a simple scheme that uses the energy map derived from the SGM algorithm to select high confidence disparity measurements, at the same utilizing the images to limit these selected disparity measurements on texture-rich regions. Our approach aims to investigate the possibility of improving the transferability of current DL methods to unseen target data without having their ground truth as a requirement. To perform a comprehensive study, we select 20 study-sites around the world to cover a variety of complexities and densities. We choose well-established DL methods like geometric and context network (GCNet), pyramid stereo matching network (PSMNet), and LEAStereo for evaluation. Our results indicate an improvement in the transferability of the DL methods across different regions visually and numerically. Copyright © 2022, The Authors. All rights reserved.

关键词： Surveys

来源：评论

学校读者我要写书评

暂无评论

Image Fusion in Remote Sensing: An Overview and Meta-Analysis

SSRN

引用

SSRN 2024年

作者： Albanwan, Hessah Qin, Rongjun Tang, Yang Geospatial Data Analytics Laboratory The Ohio State University 218B Bolz Hall 2036 Neil Avenue ColumbusOH43210 United States Department of Civil Environmental and Geodetic Engineering The Ohio State University 218B Bolz Hall 2036 Neil Avenue ColumbusOH43210 United States Department of Electrical and Computer Engineering The Ohio State University 205 Dreese Lab 2036 Neil Avenue ColumbusOH43210 United States Translational Data Analytics Institute The Ohio State University United States

Image fusion in Remote Sensing (RS) has been a consistent demand due to its ability to turn raw images of different resolutions, sources, and modalities into accurate, complete, and spatio-temporally coherent images. It greatly facilitates downstream applications such as pan-sharpening, change detection, land-cover classification, etc. Yet, image fusion solutions are highly disparate to various remote sensing problems and thus are often narrowly defined in existing reviews as topical applications, such as pan-sharpening and spatial-temporal image fusion. Considering that image fusion can be theoretically applied to any gridded data through pixel-level operations, in this paper, we expand its scope by comprehensively surveying relevant works with a simple taxonomy: 1) many-to-one image fusion;2) many-to-many image fusion. This simple taxonomy defines image fusion as a mapping problem that turns either a single or a set of images into another single or set of images, depending on the desired coherence, e.g., spectral, spatial/resolution coherence, etc. We show that this simple taxonomy, despite the significant modality difference it covers, can be presented by a conceptually easy framework. Furthermore, we provide a meta-analysis to review the major papers studying the various types of image fusion and their applications over the years (from the 1980s to date), covering 10,420 peer-reviewed papers. Finally, we discuss image fusion's main benefits and emerging challenges to provide open research directions and potential future works. © 2024, The Authors. All rights reserved.

关键词： Image fusion

来源：评论

学校读者我要写书评

暂无评论

Enhancement of depth map by fusion using adaptive and semantic-guided spatiotemporal filtering 24

Enhancement of depth map by fusion using adaptive and semant...

引用

2020 24th ISPRS Congress on Technical Commission III

作者： Albanwan, H. Qin, R. Geospatial Data Analytics Laboratory Department of Civil Ohio State University ColumbusOH United States Department of Electrical and Computer Engineering Ohio State University ColumbusOH United States

Extracting detailed geometric information about a scene relies on the quality of the depth maps (e.g. Digital Elevation Surfaces, DSM) to enhance the performance of 3D model reconstruction. Elevation information from LiDAR is often expensive and hard to obtain. The most common approach to generate depth maps is through multi-view stereo (MVS) methods (e.g. dense stereo image matching). The quality of single depth maps, however, is often prone to noise, outliers, and missing data points due to the quality of the acquired image pairs. A reference multi-view image pair must be noise-free and clear to ensure high-quality depth maps. To avoid such a problem, current researches are headed toward fusing multiple depth maps to recover the shortcomings of single-depth maps resulted from a single pair of multi-view images. Several approaches tackled this problem by merging and fusing depth maps, using probabilistic and deterministic methods, but few discussed how these fused depth maps can be refined through adaptive spatiotemporal analysis algorithms (e.g. spatiotemporal filters). The motivation is to push towards preserving the high precision and detail level of depth maps while optimizing the performance, robustness, and efficiency of the algorithm. © Authors 2020. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Large-scale and Efficient Texture Mapping Algorithm via Loopy Belief Propagation

arXiv

引用

arXiv 2023年

作者： Ling, Xiao Qin, Rongjun Geospatial Data Analytics Laboratory The Ohio State University 218B Bolz Hall 2036 Neil Avenue ColumbusOH43210 United States Department of Civil Environmental and Geodetic Engineering The Ohio State University 218B Bolz Hall 2036 Neil Avenue ColumbusOH43210 United States College of Astronautics Nanjing University Of Aeronautics And Astronautics 29 Jiangjun Avenue Jiangning District Jiangsu Nanjing211106 China Department of Electrical and Computer Engineering The Ohio State University 205 Dreese Lab 2036 Neil Avenue ColumbusOH43210 United States Translational Data Analytics Institute The Ohio State University United States

Texture mapping as a fundamental task in 3D modeling has been well established for well-acquired aerial assets under consistent illumination, yet it remains a challenge when it is scaled to large datasets with images under varying views and illuminations. A well-performed texture mapping algorithm must be able to efficiently select views, fuse and map textures from these views to mesh models, at the same time, achieve consistent radiometry over the entire model. Existing approaches achieve efficiency either by limiting the number of images to one view per face, or simplifying global inferences to only achieve local color consistency. In this paper, we break this tie by proposing a novel and efficient texture mapping framework that allows the use of multiple views of texture per face, at the same time to achieve global color consistency. The proposed method leverages a loopy belief propagation algorithm to perform an efficient and global-level probabilistic inferences to rank candidate views per face, which enables face-level multi-view texture fusion and blending. The texture fusion algorithm, being non-parametric, brings another advantage over typical parametric post color correction methods, due to its improved robustness to non-linear illumination differences. The experiments on three different types of datasets (i.e. satellite dataset, unmanned-aerial vehicle dataset and close-range dataset) show that the proposed method has produced visually pleasant and texturally consistent results in all scenarios, with an added advantage of consuming less running time as compared to the state of the art methods, especially for large-scale dataset such as satellite-derived models. Copyright © 2023, The Authors. All rights reserved.

关键词： Belief propagation

来源：评论

学校读者我要写书评

暂无评论

A Graph-Matching Approach for Cross-view Registration of Over-view 2 and Street-view based Point Clouds

arXiv

引用

arXiv 2022年

作者： Ling, Xiao Qin, Rongjun Geospatial Data Analytics Laboratory The Ohio State University 218B Bolz Hall 2036 Neil Avenue ColumbusOH43210 United States Department of Civil Environmental and Geodetic Engineering The Ohio State University 218B Bolz Hall 2036 Neil Avenue ColumbusOH43210 United States Department of Electrical and Computer Engineering The Ohio State University 205 Dreese Lab 2036 Neil Avenue ColumbusOH43210 United States Translational Data Analytics Institute The Ohio State University United States

Wide-area 3D data generation for complex urban environments often needs to leverage a mixed use of data collected from both air and ground platforms, such as from aerial surveys, satellite, and mobile vehicles, etc. On one hand, such kind of data with information from drastically different views (ca. 90°and more) forming cross-view data, which due to very limited overlapping region caused by the drastically different line of sight of the sensors, is difficult to be registered without significant manual efforts. On the other hand, the registration of such data often suffers from non-rigid distortion of the street-view data (e.g., non-rigid trajectory drift), which cannot be simply rectified by a similarity transformation. In this paper, based on the assumption that the object boundaries (e.g., buildings) from the over-view data should coincide with footprints of façade 3D points generated from street-view photogrammetric images, we aim to address this problem by proposing a fully automated geo-registration method for cross-view data, which utilizes semantically segmented object boundaries as view-invariant features under a global optimization framework through graph-matching: taking the over-view point clouds generated from stereo/multi-stereo satellite images and the street-view point clouds generated from monocular video images as the inputs, the proposed method models segments of buildings as nodes of graphs, both detected from the satellite-based and street-view based point clouds, thus to form the registration as a graph-matching problem to allow non-rigid matches;to enable a robust solution and fully utilize the topological relations between these segments, we propose to address the graph-matching problem on its conjugate graph solved through a belief-propagation algorithm. The matched nodes will be subject to a further optimization to allow precise-registration, followed by a constrained bundle adjustment on the street-view image to keep 2D-3D consistencies, w

关键词： Global optimization

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：