检索结果-内蒙古大学图书馆

ProbIBR: Fast image-based rendering With Learned Probability-Guided Sampling

IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2025年第3期31卷 1888-1901页

作者： Zhou, Yuemei Yu, Tao Zheng, Zerong Wu, Gaochang Zhao, Guihua Jiang, Wenbo Fu, Ying Liu, Yebin Tsinghua Univ Dept Automat Beijing 100084 Peoples R China Northeastern Univ State Key Lab Synthet Automat Proc Ind Shenyang 110004 Peoples R China State Key Lab UHD Commun & Presentat China Media Grp Beijing 100084 Peoples R China Beijing Inst Technol Sch Comp Sci & Technol Beijing 100081 Peoples R China Tsinghua Univ Automat Beijing 100084 Peoples R China

We present a general, fast, and practical solution for interpolating novel views of diverse real-world scenes given a sparse set of nearby views. Existing generic novel view synthesis methods rely on time-consuming scene geometry pre-computation or redundant sampling of the entire space for neural volumetric rendering, limiting the overall efficiency. Instead, we incorporate learned MVS priors into the neural volume rendering pipeline while improving the rendering efficiency by reducing sampling points under the guidance of depth probability distributions. Specifically, fewer but important points are sampled under the guidance of depth probability distributions extracted from the learned MVS architecture. based on the learned probability-guided sampling, we develop a sophisticated neural volume rendering module that effectively integrates source view information with the learned scene structures. We further propose confidence-aware refinement to improve the rendering results in uncertain, occluded, and unreferenced regions. Moreover, we build a four-view camera system for holographic display and provide a real-time version of our framework for free-viewpoint experience, where novel view images of a spatial resolution of 512x512 can be rendered at around 20 fps on a single GTX 3090 GPU. Experiments show that our method achieves 15 to 40 times faster rendering compared to state-of-the-art baselines, with strong generalization capacity and comparable high-quality novel view synthesis performance.

关键词： image-based rendering view synthesis volume rendering image-based rendering view synthesis volume rendering

来源：评论

学校读者我要写书评

暂无评论

image-based rendering in the Gradient Domain

引用

ACM TRANSACTIONS ON GRAPHICS 2013年第6期32卷 1-9页

作者： Kopf, Johannes Langguth, Fabian Scharstein, Daniel Szeliski, Richard Goesele, Michael Tech Univ Darmstadt Darmstadt Germany Middlebury Coll Middlebury VT USA

We propose a novel image-based rendering algorithm for handling complex scenes that may include reflective surfaces. Our key contribution lies in treating the problem in the gradient domain. We use a standard technique to estimate scene depth, but assign depths to image gradients rather than pixels. A novel view is obtained by rendering the horizontal and vertical gradients, from which the final result is reconstructed through Poisson integration using an approximate solution as a data term. Our algorithm is able to handle general scenes including reflections and similar effects without explicitly separating the scene into reflective and transmissive parts, as required by previous work. Our prototype renderer is fully implemented on the GPU and runs in real time on commodity hardware.

关键词： image-based rendering gradient domain processing

来源：评论

学校读者我要写书评

暂无评论

image-based rendering for Large-Scale Outdoor Scenes With Fusion of Monocular and Multi-View Stereo Depth

引用

IEEE ACCESS 2020年 8卷 117551-117565页

作者： Liu, Shaohua Li, Minghao Zhang, Xiaona Liu, Shuang Li, Zhaoxin Liu, Jing Mao, Tianlu Beijing Univ Posts & Telecommun Sch Elect Engn Beijing 100876 Peoples R China Univ Elect Sci & Technol China Inst Elect & Informat Engn Guangdong Dongguan 523808 Peoples R China Hebei Normal Univ Coll Comp & Cyber Secur Shijiazhuang 050024 Hebei Peoples R China Chinese Acad Sci Beijing Key Lab Mobile Comp & Pervas Device Inst Comp Technol Beijing 100190 Peoples R China

image-based rendering (IBR) attempts to synthesize novel views using a set of observed images. Some IBR approaches (such as light fields) have yielded impressive high-quality results on small-scale scenes with dense photo capture. However, available wide-baseline IBR methods are still restricted by the low geometric accuracy and completeness of multi-view stereo (MVS) reconstruction on low-textured and non-Lambertian surfaces. The issues become more significant in large-scale outdoor scenes due to challenging scene content, e.g., buildings, trees, and sky. To address these problems, we present a novel IBR algorithm that consists of two key components. First, we propose a novel depth refinement method that combines MVS depth maps with monocular depth maps predicted via deep learning. A lookup table remap is proposed for converting the scale of the monocular depths to be consistent with the scale of the MVS depths. Then, the rescaled monocular depth is used as the constraint in the minimum spanning tree (MST)-based nonlocal filter to refine the per-view MVS depth. Second, we present an efficient shape-preserving warping algorithm that uses superpixels to generate the warped images and blend expected novel views of scenes. The proposed method has been evaluated on public MVS and view synthesis datasets, as well as newly captured large-scale outdoor datasets. In comparison with state-of-the-art methods, the experimental results demonstrated that the proposed method can obtain more complete and reliable depth maps for the challenging large-scale outdoor scenes, thereby resulting in more promising novel view synthesis.

关键词： image-based rendering multi-view stereo monocular depth estimation view synthesis outdoor scenes

来源：评论

学校读者我要写书评

暂无评论

image-based rendering using parameterized image varieties

引用

INTERNATIONAL JOURNAL OF COMPUTER VISION 2001年第3期41卷 143-170页

作者： Genc, Y Ponce, J Siemens Corp Res Inc Imaging & Visualizat Dept Princeton NJ 08540 USA Univ Illinois Dept Comp Sci Urbana IL 61801 USA Univ Illinois Beckman Inst Urbana IL 61801 USA

This paper addresses the problem of characterizing the set of all images of a rigid set of m points and n lines observed by a weak perspective or paraperspective camera. By taking explicitly into account the Euclidean constraints associated with calibrated cameras, we show that the corresponding image space can be represented by a six-dimensional variety embedded in R2(m+n) and parameterized by the image positions of three reference points. The coefficients defining this parameterized image variety (or PIV for short) can be estimated from a sample of images of a scene via linear and non-linear least squares. The PIV provides an integrated framework for using both point and line features to synthesize new images from a set of pre-recorded pictures (image-based rendering). The proposed technique does not perform any explicit three-dimensional scene reconstruction but it supports hidden-surface elimination, texture mapping and interactive image synthesis at frame rate on ordinary PCs. It has been implemented and extensively tested on real data sets.

关键词： image-based rendering parameterized image varieties weak perspective and paraperspective projections motion analysis multi-view geometry

来源：评论

学校读者我要写书评

暂无评论

image-based rendering for Scenes with Reflections

引用

ACM TRANSACTIONS ON GRAPHICS 2012年第4期31卷 1-10页

作者： Sinha, Sudipta N. Kopf, Johannes Goesele, Michael Scharstein, Daniel Szeliski, Richard Tech Univ Darmstadt Darmstadt Germany Middlebury Coll Middlebury VT USA

We present a system for image-based modeling and rendering of real-world scenes containing reflective and glossy surfaces. Previous approaches to image-based rendering assume that the scene can be approximated by 3D proxies that enable view interpolation using traditional back-to-front or z-buffer compositing. In this work, we show how these can be generalized to multiple layers that are combined in an additive fashion to model the reflection and transmission of light that occurs at specular surfaces such as glass and glossy materials. To simplify the analysis and rendering stages, we model the world using piecewise-planar layers combined using both additive and opaque mixing of light. We also introduce novel techniques for estimating multiple depths in the scene and separating the reflection and transmission components into different layers. We then use our system to model and render a variety of real-world scenes with reflections.

关键词： image-based rendering image-based modeling stereo reflections layers

来源：评论

学校读者我要写书评

暂无评论

image-based rendering by joint view triangulation

引用

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 2003年第11期13卷 1051-1063页

作者： Lhuillier, M Quan, L Univ Blaise Pascal CNRS F-63177 Clermont Ferrand France Hong Kong Univ Sci & Technol Kowloon Hong Kong Peoples R China

The creation of novel views using prestored images or image-based rendering has many potential applications, such as visual simulation, virtual reality, and telepresence, for which traditional computer graphics based on geometric modeling would be unsatisfactory particularly with very complex three-dimensional scenes. This paper presents a new image-based rendering system that tackles the two most difficult problems of image-based modeling: pixel matching and visibility handling. We first introduce the joint view triangulation (JVT), a novel representation for pairs of images that handles the visibility and occlusion problems created by the parallaxes between the images. The JVT is built from matched planar patches regularized by local smooth constraints encoded by plane homographies. Then, we introduce an incremental edge-constrained construction algorithm. Finally, we present a pseudo-painter's rendering algorithm for the JVT and demonstrate the performance of these methods experimentally.

关键词： image-based rendering interpolation matching occlusions triangulation

来源：评论

学校读者我要写书评

暂无评论

image-based rendering of intersecting surfaces for dynamic comparative visualization

引用

VISUAL COMPUTER 2011年第5期27卷 347-363页

作者： Busking, Stef Botha, Charl P. Ferrarini, Luca Milles, Julien Post, Frits H. Delft Univ Technol Data Visualizat Grp Delft Netherlands Leiden Univ Med Ctr Div Image Proc LKEB Dept Radiol Leiden Netherlands

Nested or intersecting surfaces are proven techniques for visualizing shape differences between static 3D objects (Weigle and Taylor II, IEEE Visualization, Proceedings, pp. 503-510, 2005). In this paper we present an image-based formulation for these techniques that extends their use to dynamic scenarios, in which surfaces can be manipulated or even deformed interactively. The formulation is based on our new layered rendering pipeline, a generic image-based approach for rendering nested surfaces based on depth peeling and deferred shading. We use layered rendering to enhance the intersecting surfaces visualization. In addition to enabling interactive performance, our enhancements address several limitations of the original technique. Contours remove ambiguity regarding the shape of intersections. Local distances between the surfaces can be visualized at any point using either depth fogging or distance fields: Depth fogging is used as a cue for the distance between two surfaces in the viewing direction, whereas closest-point distance measures are visualized interactively by evaluating one surface's distance field on the other surface. Furthermore, we use these measures to define a three-way surface segmentation, which visualizes regions of growth, shrinkage, and no change of a test surface compared with a reference surface. Finally, we demonstrate an application of our technique in the visualization of statistical shape models. We evaluate our technique based on feedback provided by medical image analysis researchers, who are experts in working with such models.

关键词： Comparative visualization image-based rendering Surface comparison Nested surfaces

来源：评论

学校读者我要写书评

暂无评论

image-based rendering using image-based priors

引用

INTERNATIONAL JOURNAL OF COMPUTER VISION 2005年第2期63卷 141-151页

作者： Fitzgibbon, A Wexler, Y Zisserman, A Univ Oxford Oxford OX1 2JD England Weizmann Inst Sci IL-76100 Rehovot Israel

Given a set of images acquired from known viewpoints, we describe a method for synthesizing the image which would be seen from a new viewpoint. In contrast to existing techniques, which explicitly reconstruct the 3D geometry of the scene, we transform the problem to the reconstruction of colour rather than depth. This retains the benefits of geometric constraints, but projects out the ambiguities in depth estimation which occur in textureless regions. On the other hand, regularization is still needed in order to generate high-quality images. The paper's second contribution is to constrain the generated views to lie in the space of images whose texture statistics are those of the input images. This amounts to an image-based prior on the reconstruction which regularizes the solution, yielding realistic synthetic views. Examples are given of new view generation for cameras interpolated between the acquisition viewpoints-which enables synthetic steadicam stabilization of a sequence with a high level of realism.

关键词： new view synthesis image-based rendering

来源：评论

学校读者我要写书评

暂无评论

image-based rendering of Cars using Semantic Labels and Approximate Reflection Flow

引用

PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES 2020年第1期3卷 1–17页

作者： Rodriguez, Simon Prakash, Siddhant Hedman, Peter Drettakis, George Univ Cote Azur Nice France INRIA Sophia Antipolis France UCL London England

image-based rendering (IBR) has made impressive progress towards highly realistic, interactive 3D navigation for many scenes, including cityscapes. However, cars are ubiquitous in such scenes;multi-view stereo reconstruction provides proxy geometry for IBR, but has difficulty with shiny car bodies, and leaves holes in place of reflective, semi-transparent windows on cars. We present a new approach allowing free-viewpoint IBR of cars based on an approximate analytic reflection flow computation on curved windows. Our method has three components: a refinement step of reconstructed car geometry guided by semantic labels, that provides an initial approximation for missing window surfaces and a smooth completed car hull;an efficient reflection flow computation using an ellipsoid approximation of the curved car windows that runs in real-time in a shader and a reflection/background layer synthesis solution. These components allow plausible rendering of reflective, semi-transparent windows in free viewpoint navigation. We show results on several scenes casually captured with a single consumer-level camera, demonstrating plausible car renderings with significant improvement in visual quality over previous methods.

关键词： image-based rendering semantic labeling reflection rendering

来源：评论

学校读者我要写书评

暂无评论

image-based rendering of surfaces from volume data 2

Image-based rendering of surfaces from volume data

引用

2nd International Workshop on Volume Graphics (VG 01)

作者： Chen, BQ Kaufman, A Tang, QY Univ Minnesota Dept Comp Sci & Engn Minneapolis MN 55455 USA

ISBN: (纸本)321183737X

We present an image-based rendering technique to accelerate rendering of surfaces from volume data. We cache the fully volume rendered image (called keyview) and use it to generate novel views without ray-casting every pixel. This is achieved by first constructing an underlying surface model of the volume and then texture mapping the keyview onto the geometry. When the novel view moves slightly away from the keyview, most of the original visible regions in the keyview are still visible in the novel view. Therefore, we only need to cast rays for pixels in the newly visible regions, which usually occupy only a small portion of the whole image, resulting in a substantial speedup. We have applied our technique to a virtual colonoscopy system and have obtained an interactive navigation speed through a 512(3) size patient colon. Our experiments demonstrate an average of an order of magnitude speedup over that of traditional volume rendering, compromising very little on image quality.

关键词： image-based rendering volume rendering

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：