image-based 3D reconstruction has been successfully employed for micro-measurements and industrial quality control purposes. However, obtaining a highly-detailed and reliable 3D reconstruction and inspection of non-co...
详细信息
image-based 3D reconstruction has been successfully employed for micro-measurements and industrial quality control purposes. However, obtaining a highly-detailed and reliable 3D reconstruction and inspection of non-collaborative surfaces is still an open issue. Photometric stereo (PS) offers the high spatial frequencies of the surface, but the low frequency is erroneous due to the mathematical model's assumptions and simplifications on how light interacts with the object surface. Photogrammetry, on the other hand, gives precise low-frequency information but fails to utilize high frequencies. As a result, in this research, we present a fusion strategy in Fourier domain to replace the low spatial frequencies of PS with the corresponding photogrammetric frequencies in order to have correct low frequencies while maintaining high frequencies from PS. The proposed method was tested on three different objects. Different cloud-to-cloud comparisons were provided between reference data and the 3D points derived from the proposed method to evaluate high and low frequency information. The obtained 3D findings demonstrated how the proposed methodology generates a high-detail 3D reconstruction of the surface topography (below 20 mu m) while maintaining low-frequency information (0.09 mu m on average for three different testingobjects) by fusingphotogrammetric and PSdepth datawith the proposed FFT-based method.
This work aims to address the problems of clothed human reconstructionfrom unseen partial point clouds. Existing methods focus on estimating vertex offsets on top of parametric models for clothing details but with th...
详细信息
The accurate estimation of state of health (SOH) plays a crucial role in ensuring the safe operation of batteries. Most existing SOH estimation methods are based on complete charging or discharging data. However, in r...
详细信息
LiDAR Point Cloud segmentation is a key input to downstream tasks such as object recognition and classification, obstacle avoidance, and even 3D reconstruction. Akey challenge in the segmentation of large city-scale d...
详细信息
ISBN:
(纸本)9781510666184;9781510666191
LiDAR Point Cloud segmentation is a key input to downstream tasks such as object recognition and classification, obstacle avoidance, and even 3D reconstruction. Akey challenge in the segmentation of large city-scale datasets is uneven distribution of points to specific classes and significant class imbalances. As highly detailed point cloud datasets of urban environments become available, neural networks have shown significant performance in recognizing large well-defined objects. However, data is fed into these networks in chunks and the scheme by which data is presented for training and evaluation can have a significant impact on performance. In this work, we establish a method analogous to gradients in image processing to segment the ground in point clouds, achieving an accuracy of 91.4% on the Sensaturban dataset. By isolating the ground, we reduce the quantity of classes that need to be segmented from structures in urban LiDAR and improve data partitioning schemes when combined with random/grid down-sampling techniques for neural network inputs.
In longitudinal medical image analysis, most work focuses on regularly sampled images, or on tasks like regression or classification. However, in the clinical context, images are frequently generated irregularly due t...
详细信息
The inherent challenge of image fusion lies in capturing the correlation of multi-source images and comprehensively integrating effective information from different sources. Most existing techniques fail to perform dy...
Magnetic Resonance Imaging can produce detailed images of the anatomy and physiology of the human body that can assist doctors in diagnosing and treating pathologies such as tumours. However, MRI suffers from very lon...
详细信息
ISBN:
(数字)9781665469463
ISBN:
(纸本)9781665469463
Magnetic Resonance Imaging can produce detailed images of the anatomy and physiology of the human body that can assist doctors in diagnosing and treating pathologies such as tumours. However, MRI suffers from very long acquisition times that make it susceptible to patient motion artifacts and limit its potential to deliver dynamic treatments. Conventional approaches such as Parallel Imaging and Compressed Sensing allow for an increase in MRI acquisition speed by reconstructing MR images from subsampled MRI data acquired using multiple receiver coils. Recent advancements in Deep Learning combined with Parallel Imaging and Compressed Sensing techniques have the potential to produce high-fidelity reconstructions from highly accelerated MRI data. In this work we present a novel Deep Learning-based Inverse Problem solver applied to the task of Accelerated MRI reconstruction, called the Recurrent Variational Network (RecurrentVarNet), by exploiting the properties of Convolutional Recurrent Neural Networks and unrolled algorithms for solving Inverse Problems. The RecurrentVarNet consists of multiple recurrent blocks, each responsible for one iteration of the unrolled variational optimization scheme for solving the inverse problem of multi-coil Accelerated MRI reconstruction. Contrary to traditional approaches, the optimization steps are performed in the observation domain (k-space) instead of the image domain. Each block of the RecurrentVarNet refines the observed k -space and comprises a data consistency term and a recurrent unit which takes as input a learned hidden state and the prediction of the previous block. Our proposed method achieves new state of the art qualitative and quantitative reconstruction results on 5-fold and 10-fold accelerated datafrom a public multi-coil brain dataset, outperforming previous conventional and deep learning-based approaches.
The proceedings contain 66 papers. The topics discussed include: bringing data into the conversation: adapting content from business intelligence dashboards for threaded collaboration platforms;AEye: a visualization t...
ISBN:
(纸本)9798350354850
The proceedings contain 66 papers. The topics discussed include: bringing data into the conversation: adapting content from business intelligence dashboards for threaded collaboration platforms;AEye: a visualization tool for imagedatasets;feature clock: high-dimensional effects in two-dimensional plots;curve segment neighborhood-based vector field exploration;micro visualizations on a smartwatch: assessing reading performance while walking;guided statistical workflows with interactive explanations and assumption checking;opening the black box of 3D reconstruction error analysis with VECTOR;and an Overview+Detail layout for visualizing compound graphs.
Convolutional neural networks (CNN) have become some of the most powerful tools for imagereconstruction problems thanks to the availability of very large data sets. Implementations of deep residual structures, advers...
详细信息
ISBN:
(纸本)9783031221361;9781665437943
Convolutional neural networks (CNN) have become some of the most powerful tools for imagereconstruction problems thanks to the availability of very large data sets. Implementations of deep residual structures, adversarial generation networks and attention mechanisms have made great accomplishment. However, the good performance from complex and deep network architecture is not guaranteed when the training data set is small and not well preventative for the entire population. There are many real-world imagereconstruction tasks where large and diverse training data is unavailable, such as problems in the physical sciences and engineering for which the data set generation process is complicated and large data sets are expensive to construct. For example, herein we discuss the application of deep-learning to challenging problems in material science. Inspired by compressive sensing and ensemble learning, we propose a method using ensemble image super-resolution CNNs in transform domains to overcome the challenges of small training data in imagereconstruction problems. Ensemble methods provide a more robust approach when CNNs are trained with less representative data. Transform domains could support the CNNs with multiple sparse representations of the original imagedata which enrich the information so that the CNNs can be sufficiently trained even using small data sets. Particularly, we report here a successful application of CNN ensembles to the reconstruction of areal density maps of carbon nano-tube sheet materials. We show that applying the ensemble CNNs in transform domains can reveal finer details in the material texture and help to improve the quality control capabilities for carbon nano-tube sheet production with only a small collection of training data.
Deep learning-based models have demonstrated unprecedented success in image super-resolution (SR) tasks. However, more attention has been paid to lightweight SR models lately, due to the increasing demand for on-devic...
详细信息
ISBN:
(纸本)9798400701085
Deep learning-based models have demonstrated unprecedented success in image super-resolution (SR) tasks. However, more attention has been paid to lightweight SR models lately, due to the increasing demand for on-device inference. In this paper, we propose a novel Separable Modulation Network (SMN) for efficient image SR. The key parts of the SMN are the Separable Modulation Unit (SMU) and the Locality Self-enhanced Network (LSN). SMU enables global relational interactions but significantly eases the process by separating spatial modulation from channel aggregation, hence making the long-range interaction efficient. Specifically, spatial modulation extracts global contexts from spatial, and channel aggregation condenses all global context features into the channel modulator, ultimately the aggregated contexts are fused into the final features. In addition, LSN allows guiding the network to focus on more refined image attributes by encoding local contextual information. By coupling two complementary components, SMN can capture both short- and long-range contexts for accurate imagereconstruction. Extensive experimental results demonstrate that our SMN achieves state-of-the-art performance among the existing efficient SR methods with less complexity.
暂无评论