检索结果-内蒙古大学图书馆

INVESTIGATING SPHERICAL EPIPOLAR RECTIFICATION FOR MULTI-VIEW STEREO 3D RECONSTRUCTION

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Elhashash, Mostafa Qin, Rongjun Geospatial Data Analytics Lab The Ohio State University Columbus United States Department of Civil Environmental and Geodetic Engineering The Ohio State University Columbus United States Department of Electrical and Computer Engineering The Ohio State University Columbus United States Translational Data Analytics Institute The Ohio State University Columbus United States

Multi-view stereo (MVS) reconstruction is essential for creating 3D models. The approach involves applying epipolar rectification followed by dense matching for disparity estimation. However, existing approaches face challenges in applying dense matching for images with different viewpoints primarily due to large differences in object scale. In this paper, we propose a spherical model for epipolar rectification to minimize distortions caused by differences in principal rays. We evaluate the proposed approach using two aerial-based datasets consisting of multi-camera head systems. We show through qualitative and quantitative evaluation that the proposed approach performs better than frame-based epipolar correction by enhancing the completeness of point clouds by up to 4.05% while improving the accuracy by up to 10.23% using LiDAR data as ground truth. Copyright © 2022, The Authors. All rights reserved.

关键词： Antennas

Automated LoD-2 model reconstruction from very-high-resolution satellite-derived digital surface model and orthophoto

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Gui, Shengxi Qin, Rongjun Geospatial Data Analytics Lab Ohio State University Columbus United States Department of Civil Environmental and Geodetic Engineering Ohio State University Columbus United States Department of Electrical and Computer Engineering Ohio State University Columbus United States Translational Data Analytics Institute Ohio State University Columbus United States

Digital surface models (DSM) generated from multi-stereo satellite images are getting higher in quality owing to the improved data resolution and photogrammetric reconstruction algorithms. Very-high-resolution (VHR, with sub-meter level resolution) satellite images effectively act as a unique data source for 3D building modeling, because it provides a much wider data coverage with lower cost than the traditionally used LiDAR and airborne photogrammetry data. Although 3D building modeling from point clouds has been intensively investigated, most of the methods are still ad-hoc to specific types of buildings and require high-quality and high-resolution data sources as input. Therefore, when applied to satellite-based point cloud or DSMs, these developed approaches are not readily applicable and more adaptive and robust methods are needed. As a result, most of the existing work on building modeling from satellite DSM achieves LoD-1 generation. In this paper, we propose a model-driven method that reconstructs LoD-2 building models following a "decomposition-optimization-fitting" paradigm. The proposed method starts building detection results through a deep learning-based detector and vectorizes individual segments into polygons using a "three-step" polygon extraction method, followed by a novel grid-based decomposition method that decomposes the complex and irregularly shaped building polygons to tightly combined elementary building rectangles ready to fit elementary building models. We have optionally introduced OpenStreetMap (OSM) and Graph-Cut (GC) labeling to further refine the orientation of 2D building rectangle. The 3D modeling step takes building-specific parameters such as hip lines, as well as non-rigid and regularized transformations to optimize the flexibility for using a minimal set of elementary models. Finally, roof type of building models s refined and adjacent building models in one building segment are merged into the complex polygonal model. Our propo

关键词： Geometry

CONSTRAINED BUNDLE ADJUSTMENT FOR STRUCTURE FROM MOTION USING UNCALIBRATED MULTI-CAMERA SYSTEMS

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Huang, Debao Elhashash, Mostafa Qin, Rongjun Geospatial Data Analytics Lab The Ohio State University Columbus United States Department of Civil Environmental and Geodetic Engineering The Ohio State University Columbus United States Department of Electrical and Computer Engineering The Ohio State University Columbus United States Translational Data Analytics Institute The Ohio State University Columbus United States

Structure from motion using uncalibrated multi-camera systems is a challenging task. This paper proposes a bundle adjustment solution that implements a baseline constraint respecting that these cameras are static to each other. We assume these cameras are mounted on a mobile platform, uncalibrated, and coarsely synchronized. To this end, we propose the baseline constraint that is formulated for the scenario in which the cameras have overlapping views. The constraint is incorporated in the bundle adjustment solution to keep the relative motion of different cameras static. Experiments were conducted using video frames of two collocated GoPro cameras mounted on a vehicle with no system calibration. These two cameras were placed capturing overlapping contents. We performed our bundle adjustment using the proposed constraint and then produced 3D dense point clouds. Evaluations were performed by comparing these dense point clouds against LiDAR reference data. We showed that, as compared to traditional bundle adjustment, our proposed method achieved an improvement of 29.38%. Copyright © 2022, The Authors. All rights reserved.

关键词： Cameras

Point cloud registration for LiDAR and photogrammetric data: A critical synthesis and performance analysis on classic and deep learning algorithms

学校读者我要写书评

暂无评论

ISPRS Open Journal of Photogrammetry and Remote Sensing 2023年 8卷

作者： Xu, Ningli Qin, Rongjun Song, Shuang Geospatial Data Analytics Lab The Ohio State University Columbus United States Department of Civil Environmental and Geodetic Engineering The Ohio State University Columbus United States Department of Electrical and Computer Engineering The Ohio State University Columbus United States Translational Data Analytics Institute The Ohio State University Columbus United States

Three-dimensional (3D) point cloud registration is a fundamental step for many 3D modeling and mapping applications. Existing approaches are highly disparate in the data source, scene complexity, and application, therefore the current practices in various point cloud registration tasks are still ad-hoc processes. Recent advances in computer vision and deep learning have shown promising performance in estimating rigid/similarity transformation between unregistered point clouds of complex objects and scenes. However, their performances are mostly evaluated using a limited number of datasets from a single sensor (e.g. Kinect or RealSense cameras), lacking a comprehensive overview of their applicability in photogrammetric 3D mapping scenarios. In this work, we provide a comprehensive review of the state-of-the-art (SOTA) point cloud registration methods, where we analyze and evaluate these methods using a diverse set of point cloud data from indoor to satellite sources. The quantitative analysis allows for exploring the strengths, applicability, challenges, and future trends of these methods. In contrast to existing analysis works that introduce point cloud registration as a holistic process, our experimental analysis is based on its inherent two-step process to better comprehend these approaches including feature/keypoint-based initial coarse registration and dense fine registration through cloud-to-cloud (C2C) optimization. More than ten methods, including classic hand-crafted, deep-learning-based feature correspondence, and robust C2C methods were tested. We observed that the success rate of most of the algorithms are fewer than 40% over the datasets we tested and there are still are large margin of improvement upon existing algorithms concerning 3D sparse corresopondence search, and the ability to register point clouds with complex geometry and occlusions. With the evaluated statistics on three datasets, we conclude the best-performing methods for each step and prov

关键词： Deep learning Iterative closest point algorithm Point cloud registration Terrestrial laser scanning

A volumetric change detection framework using UAV oblique photogrammetry - A case study of ultra-high-resolution monitoring of progressive building collapse

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Xu, Ningli Huang, Debao Song, Shuang Ling, Xiao Strasbaugh, Chris Yilmaz, Alper Sezen, Halil Qin, Rongjun Geospatial Data Analytics Lab The Ohio State University Columbus United States Photogrammetric Computer Vision Lab The Ohio State University Columbus United States Department of Civil Environmental and Geodetic Engineering The Ohio State University Columbus United States Department of Electrical and Computer Engineering The Ohio State University Columbus United States Translational Data Analytics Institute The Ohio State University Columbus United States Engineering Technology Services The Ohio State University Columbus United States

In this paper, we present a case study that performs an unmanned aerial vehicle (UAV) based fine-scale 3D change detection and monitoring of progressive collapse performance of a building during a demolition event. Multi-temporal oblique photogrammetry images are collected with 3D point clouds generated at different stages of the demolition. The geometric accuracy of the generated point clouds has been evaluated against both airborne and terrestrial LiDAR point clouds, achieving an average distance of 12 cm and 16 cm for roof and façade respectively. We propose a hierarchical volumetric change detection framework that unifies multi-temporal UAV images for pose estimation (free of ground control points), reconstruction, and a coarse-to-fine 3D density change analysis. This work has provided a solution capable of addressing change detection on full 3D time-series datasets where dramatic scene content changes are presented progressively. Our change detection results on the building demolition event have been evaluated against the manually marked ground-truth changes and have achieved an F-1 score varying from 0.78 to 0.92, with consistently high precision (0.92 - 0.99). Volumetric changes through the demolition progress are derived from change detection and have shown to favorably reflect the qualitative and quantitative building demolition progression. Copyright © 2021, The Authors. All rights reserved.

关键词： Photogrammetry

Deep Learning Meets Satellite Images – An Evaluation on Handcrafted and Learning-based Features for Multi-date Satellite Stereo Images

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Song, Shuang Morelli, Luca Wu, Xinyi Qin, Rongjun Albanwan, Hessah Remondino, Fabio Geospatial Data Analytics Lab The Ohio State University Columbus United States Department of Civil Environmental and Geodetic Engineering The Ohio State University Columbus United States Department of Electrical and Computer Engineering The Ohio State University Columbus United States Translational Data Analytics Institute The Ohio State University Columbus United States Trento Italy Department of Civil Environmental and Mechanical Engineering University of Trento Italy Civil Engineering Department Kuwait University Kuwait

A critical step in the digital surface models (DSM) generation is feature matching. Off-track (or multi-date) satellite stereo images, in particular, can challenge the performance of feature matching due to spectral distortions between images, long baseline, and wide intersection angles. Feature matching methods have evolved over the years from handcrafted methods (e.g., SIFT) to learning-based methods (e.g., SuperPoint and SuperGlue). In this paper, we compare the performance of different features, also known as feature extraction and matching methods, applied to satellite imagery. A wide range of stereo pairs (~ 500) covering two separate study sites are used. SIFT, as a widely used classic feature extraction and matching algorithm, is compared with seven deep-learning matching methods: SuperGlue, LightGlue, LoFTR, ASpanFormer, DKM, GIM-LightGlue, and GIM-DKM. Results demonstrate that traditional matching methods are still competitive in this age of deep learning, although for particular scenarios learning-based methods are very promising. Copyright © 2024, The Authors. All rights reserved.

关键词： Satellite imagery

Spatio-Temporal Stratified Associations between Urban Human Activities and Crime Patterns: A Case Study in San Francisco Around the Covid-19 Stay-at-Home Mandate

学校读者我要写书评

暂无评论

SSRN

SSRN 2022年

作者： Chen, Tongxin Bowers, Kate Zhu, Di Gao, Xiaowei Cheng, Tao Space Time Lab for Big Data Analytics Department of Civil Environmental and Geomatic Engineering University College London LondonWC1E 6BT United Kingdom Department of Security and Crime Science University College London LondonWC1H 9EZ United Kingdom Geospatial Data Intelligence Lab Department of Geography Environment and Society University of Minnesota Twin Cities Minneapolis55455 United States

Crime changes have been reported as a result of human routine activity shifting due to containment policies, such as stay-at-home (SAH) mandates during the COVID-19 pandemic. However, the way in which the manifestation of crime in both space and time is affected by dynamic human activities in urban areas has not been explored in depth in empirical studies hitherto. Here, we aim to quantitatively measure the spatio-temporal associations between crime patterns and human activities in the context of an unstable period of the ever-changing socio-demographic backcloth. We propose an analytical framework to detect the dynamic stratified associations between the spatial distributions of human activities and crimes. The results of a case study in San Francisco, United States reveal that the spatial patterns of most crime types are statistically significantly associated with that of human activities zones. Property crime exhibits higher stratified association than violent crime across all temporal scales. Further, the strongest association is obtained with the eight-week time span centered around the SAH order. These findings not only enhance our understanding of the relationships between urban crime and human activities, but also offer insights that tailored crime intervention strategies need to consider human activity variables. © 2022, The Authors. All rights reserved.

关键词： Crime

A Graph-Matching Approach for Cross-view Registration of Over-view 2 and Street-view based Point Clouds

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Ling, Xiao Qin, Rongjun Geospatial Data Analytics Laboratory The Ohio State University 218B Bolz Hall 2036 Neil Avenue ColumbusOH43210 United States Department of Civil Environmental and Geodetic Engineering The Ohio State University 218B Bolz Hall 2036 Neil Avenue ColumbusOH43210 United States Department of Electrical and Computer Engineering The Ohio State University 205 Dreese Lab 2036 Neil Avenue ColumbusOH43210 United States Translational Data Analytics Institute The Ohio State University United States

Wide-area 3D data generation for complex urban environments often needs to leverage a mixed use of data collected from both air and ground platforms, such as from aerial surveys, satellite, and mobile vehicles, etc. On one hand, such kind of data with information from drastically different views (ca. 90°and more) forming cross-view data, which due to very limited overlapping region caused by the drastically different line of sight of the sensors, is difficult to be registered without significant manual efforts. On the other hand, the registration of such data often suffers from non-rigid distortion of the street-view data (e.g., non-rigid trajectory drift), which cannot be simply rectified by a similarity transformation. In this paper, based on the assumption that the object boundaries (e.g., buildings) from the over-view data should coincide with footprints of façade 3D points generated from street-view photogrammetric images, we aim to address this problem by proposing a fully automated geo-registration method for cross-view data, which utilizes semantically segmented object boundaries as view-invariant features under a global optimization framework through graph-matching: taking the over-view point clouds generated from stereo/multi-stereo satellite images and the street-view point clouds generated from monocular video images as the inputs, the proposed method models segments of buildings as nodes of graphs, both detected from the satellite-based and street-view based point clouds, thus to form the registration as a graph-matching problem to allow non-rigid matches;to enable a robust solution and fully utilize the topological relations between these segments, we propose to address the graph-matching problem on its conjugate graph solved through a belief-propagation algorithm. The matched nodes will be subject to a further optimization to allow precise-registration, followed by a constrained bundle adjustment on the street-view image to keep 2D-3D consistencies, w

关键词： Global optimization

Image Fusion in Remote Sensing: An Overview and Meta-Analysis

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Albanwan, Hessah Qin, Rongjun Tang, Yang Geospatial Data Analytics Laboratory The Ohio State University 218B Bolz Hall 2036 Neil Avenue ColumbusOH43210 United States Department of Civil Environmental and Geodetic Engineering The Ohio State University 218B Bolz Hall 2036 Neil Avenue ColumbusOH43210 United States Department of Electrical and Computer Engineering The Ohio State University 205 Dreese Lab 2036 Neil Avenue ColumbusOH43210 United States Translational Data Analytics Institute The Ohio State University United States

Image fusion in Remote Sensing (RS) has been a consistent demand due to its ability to turn raw images of different resolutions, sources, and modalities into accurate, complete, and spatio-temporally coherent images. It greatly facilitates downstream applications such as pan-sharpening, change detection, land-cover classification, etc. Yet, image fusion solutions are highly disparate to various remote sensing problems and thus are often narrowly defined in existing reviews as topical applications, such as pan-sharpening and spatial-temporal image fusion. Considering that image fusion can be theoretically applied to any gridded data through pixel-level operations, in this paper, we expand its scope by comprehensively surveying relevant works with a simple taxonomy: 1) many-to-one image fusion;2) many-to-many image fusion. This simple taxonomy defines image fusion as a mapping problem that turns either a single or a set of images into another single or set of images, depending on the desired coherence, e.g., spectral, spatial/resolution coherence, etc. We show that this simple taxonomy, despite the significant modality difference it covers, can be presented by a conceptually easy framework. Furthermore, we provide a meta-analysis to review the major papers studying the various types of image fusion and their applications over the years (from the 1980s to date), covering 10,420 peer-reviewed papers. Finally, we discuss image fusion's main benefits and emerging challenges to provide open research directions and potential future works. © 2024, The Authors. All rights reserved.

关键词： Image fusion