检索结果-内蒙古大学图书馆

ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D)

作者： Philip, Julien Drettakis, George Univ Cote Azur INRIA Nice France

ISBN: (纸本)9781450357050

image-based rendering (IBR) allows high-fidelity free-viewpoint navigation using only a set of photographs and 3D reconstruction as input. It is often necessary or convenient to remove objects from the captured scenes, allowing a form of scene editing for IBR. This requires multi-view inpainting of the input images. Previous methods suffer from several major limitations: they lack true multi-view coherence, resulting in artifacts such as blur, they do not preserve perspective during inpainting, provide inaccurate depth completion and can only handle scenes with a few tens of images. Our approach addresses these limitations by introducing a new multi-view method that performs inpainting in intermediate, locally common planes. Use of these planes results in correct perspective and multi-view coherence of inpainting results. For efficient treatment of large scenes, we present a fast planar region extraction method operating on small image clusters. We adapt the resolution of inpainting to that required in each input image of the multi-view dataset, and carefully handle image resampling between the input images and rectified planes. We show results on large indoors and outdoors environments.

关键词： Inpainting Multi-View image-based rendering

来源：评论

学校读者我要写书评

暂无评论

Deep Blending for Free-Viewpoint image-based rendering

引用

ACM TRANSACTIONS ON GRAPHICS 2018年第6期37卷 257-257页

作者： Hedman, Peter Philip, Julien Price, True Frahm, Jan-Michael Drettakis, George Brostow, Gabriel UCL London England Univ Cote dAzur Inria Nice France Univ N Carolina Chapel Hill NC USA UCL Niantic London England

Free-viewpoint image-based rendering (IBR) is a standing challenge. IBR methods combine warped versions of input photos to synthesize a novel view. The image quality of this combination is directly affected by geometric inaccuracies of multi-view stereo (MVS) reconstruction and by view-and image-dependent effects that produce artifacts when contributions from different input views are blended. We present a new deep learning approach to blending for IBR, in which we use held-out real image data to learn blending weights to combine input photo contributions. Our Deep Blending method requires us to address several challenges to achieve our goal of interactive free-viewpoint IBR navigation. We first need to provide sufficiently accurate geometry so the Convolutional Neural Network (CNN) can succeed in finding correct blending weights. We do this by combining two different MVS reconstructions with complementary accuracy vs. completeness tradeoffs. To tightly integrate learning in an interactive IBR system, we need to adapt our rendering algorithm to produce a fixed number of input layers that can then be blended by the CNN. We generate training data with a variety of captured scenes, using each input photo as ground truth in a held-out approach. We also design the network architecture and the training loss to provide high quality novel view synthesis, while reducing temporal flickering artifacts. Our results demonstrate free-viewpoint IBR in a wide variety of scenes, clearly surpassing previous methods in visual quality, especially when moving far from the input cameras.

关键词： image-based rendering Free-viewpoint Deep learning

来源：评论

学校读者我要写书评

暂无评论

Spectral analysis of image-based rendering data with scene geometry

引用

MULTIMEDIA SYSTEMS 2017年第5期23卷 627-644页

作者： Zhu, Chang-Jian Yu, Li Huazhong Univ Sci & Technol Sch Elect Informat & Commun Wuhan 430074 Hubei Peoples R China

The plenoptic function is commonly used to model image-based rendering (IBR) in terms of sampling and reconstruction. In this paper, we study the influence of scene geometry on the spectrum of a plenoptic function using spectral analysis. As the scene geometry becomes more complicated, the spectrum of the plenoptic function will broaden. Therefore, the bandwidth of the plenoptic function is closely related to the scene geometry, and the end goal of the bandwidth is to determine the minimum sampling rate (i.e., the minimum number of cameras) for IBR. Under the spectral analysis, we mathematically derive an analytical function to determine the spectral support of the plenoptic function. based on the support of the plenoptic spectrum, the minimum number of cameras is determined to reconstruct the plenoptic function up to a certain frequency that allows a certain reconstruction quality when performing IBR. Furthermore, we derive a reconstruction filter for the plenoptic sampling for irregularly shaped scenes. Last, the experimental results are presented and compared with the theory.

关键词： Plenoptic function Sampling Spectral analysis image-based rendering Scene geometry

来源：评论

学校读者我要写书评

暂无评论

HMD-Guided image-based Modeling and rendering of Indoor Scenes 15th

HMD-Guided Image-Based Modeling and Rendering of Indoor Scen...

引用

15th Annual EuroVR International Conference (EuroVR) on Virtual Reality and Augmented Reality

作者： Andersen, Daniel Popescu, Voicu Purdue Univ W Lafayette IN 47907 USA

ISBN: (纸本)9783030017903;9783030017897

We present a system that enables a novice user to acquire a large indoor scene in minutes as a collection of images sufficient for five degrees-of-freedom virtual navigation by image morphing. The user walks through the scene wearing an augmented reality head-mounted display (AR HMD) enhanced with a panoramic video camera. The AR HMD shows a 2D grid of a dynamically generated floor plan, which guides the user to acquire a panorama from each grid cell. After acquisition, panoramas are preliminarily registered using the AR HMD tracking data, corresponding features are detected in pairs of neighboring panoramas, and the correspondences are used to refine panorama registration. The registered panoramas and their correspondences support rendering the scene interactively with any view direction and from any viewpoint on the acquisition plane. An HMD VR interface guides the user who optimizes visualization fidelity interactively, by aligning the viewpoint with one of the hundreds of acquisition locations evenly sampling the floor plane.

关键词： Augmented reality 3D acquisition image-based rendering

来源：评论

学校读者我要写书评

暂无评论

Scalable Inside-Out image-based rendering

引用

ACM TRANSACTIONS ON GRAPHICS 2016年第6期35卷 1-11页

作者： Hedman, Peter Ritschel, Tobias Drettakis, George Brostow, Gabriel UCL London WC1E 6BT England Inria Rocquencourt France

ISBN: (纸本)9781450342797

Our aim is to give users real-time free-viewpoint rendering of real indoor scenes, captured with off-the-shelf equipment such as a high-quality color camera and a commodity depth sensor. image-based rendering (IBR) can provide the realistic imagery required at real-time speed. For indoor scenes however, two challenges are especially prominent. First, the reconstructed 3D geometry must be compact, but faithful enough to respect occlusion relationships when viewed up close. Second, man-made materials call for view-dependent texturing, but using too many input photographs reduces performance. We customize a typical RGB-D 3D surface reconstruction pipeline to produce a coarse global 3D surface, and local, per-view geometry for each input image. Our tiled IBR preserves quality by economizing on the expected contributions that entire groups of input pixels make to a final image. The two components are designed to work together, giving real-time performance, while hardly sacrificing quality. Testing on a variety of challenging scenes shows that our inside-out IBR scales favorably with the number of input images.

关键词： image-based rendering RGB-D 3D reconstruction tiled rendering

来源：评论

学校读者我要写书评

暂无评论

A Panoramic Geology Field Trip System Using image-based rendering 40

A Panoramic Geology Field Trip System Using Image-Based Rend...

引用

40th Annual IEEE Computer Software and Applications Conference Symposium (COMPSAC)

作者： Deng, Chunyan Zhou, Zhiguo Li, Wenqing Hou, Boyu Jilin Univ Coll Comp Sci & Technol Changchun Peoples R China Northeast Normal Univ Sch Comp Sci & Informat Technol Changchun Peoples R China Jilin Univ Coll Earth Sci Changchun Peoples R China Kennesaw State Univ Coll Comp & Software Engn Marietta GA 30060 USA

ISBN: (纸本)9781467388450

Geology field trip is an important teaching step for the majors of geology, natural resources prospecting engineering and geographical sciences to learn geology knowledge and grasp field working skills. There are some problems in the traditional geology field trip teaching. Inspired by the Google Maps Street View, the author proposes applying the image-based rendering (IBR), a branch of Virtual Reality (VR), to the field of geology field trip teaching. In this paper, the author designs and implements a panoramic geology field trip system for College of Earth Sciences of Jilin University, in which students can preview the geology field trip location by roaming in the three-dimension (3D) virtual environment. The practice shows that not only can the system help teach 3D thinking, but also reduce the teaching cost, improve students' learning efficiency and enhance learning interest.

关键词： image-based rendering Geology Field Trip Virtual Reality

来源：评论

学校读者我要写书评

暂无评论

GHOSTING AND POPPING DETECTION FOR image-based rendering

GHOSTING AND POPPING DETECTION FOR IMAGE-BASED RENDERING

引用

3DTV-Conference - The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON)

作者： Guthe, S. Schardt, P. Goesele, M. Cunningham, D. Tech Univ Darmstadt Darmstadt Germany BTU Cottbus Senftenberg Senftenberg Germany

ISBN: (纸本)9781509033133

Film sequences generated using image-based rendering techniques are commonly used in broadcasting, especially for sporting events. In many cases, however, image-based rending sequences contain artifacts, and these must be manually located. Here, we propose an algorithm to automatically detect not only the presence of the two most disturbing classes of artifact (popping and ghosting), but also the strength of each instance of an artifact. A simple perceptual evaluation of the technique shows that it performs well.

关键词： image-based rendering artifact detection

来源：评论

学校读者我要写书评

暂无评论

VARIATIONAL image-based rendering WITH GRADIENT CONSTRAINTS 6

VARIATIONAL IMAGE-BASED RENDERING WITH GRADIENT CONSTRAINTS

引用

6th International Conference on 3D Imaging (IC3D)

作者： Nieto, Gregoire Devernay, Frederic Crowley, James Univ Grenoble Alpes Lab Jean Kuntzmann Grenoble France INRIA Rocquencourt France Univ Grenoble Alpes Lab Informat Grenoble Grenoble France

ISBN: (纸本)9781509057436

Multi-view image-based rendering consists in generating a novel view of a scene from a set of source views. In general, this works by first doing a coarse 3D reconstruction of the scene, and then using this reconstruction to establish correspondences between source and target views, followed by blending the warped views to get the final image. Unfortunately, discontinuities in the blending weights, due to scene geometry or camera placement, result in artifacts in the target view. In this paper, we show how to avoid these artifacts by imposing additional constraints on the image gradients of the novel view. We propose a variational framework in which an energy functional is derived and optimized by iteratively solving a linear system. We demonstrate this method on several structured and unstructured multi-view datasets, and show that it numerically outperforms state-of-the-art methods, and eliminates artifacts that result from visibility discontinuities.

关键词： image-based rendering Computational Photography Computer Graphics

来源：评论

学校读者我要写书评

暂无评论

Constructing interactive multi-view videos based on image-based rendering

引用

INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING 2015年第4期10卷 402-414页

作者： Chang, Shih-Ming Tsai, Joseph C. Yen, Shwu-Huey Shih, Timothy K. Tamkang Univ Dept Comp Sci & Informat Engn New Taipei 25137 Taiwan Natl Cent Univ Dept Comp Sci & Informat Engn Taoyuan 30201 Taiwan

In this paper, we use image-based rendering (IBR) to develop a scene rotation mechanism. We shot several images in the same scene and computed the angles between images. A video is then composed, allowing users to select viewing angles when the video is playing. We made three kinds of assumptions that may affect the resulting video, and proved our assumptions by a series of experiments. Finally, we use video of realistic scenario and produce interactive video by the proposed method. The contribution also includes techniques to compute geometric parameters of the scene from one or more images.

关键词： SIFT algorithm mean-shift algorithm homography matrix image-based rendering IBR

来源：评论

学校读者我要写书评

暂无评论

Is it possible to use highly realistic virtual reality in the elderly? A feasibility study with image-based rendering

引用

NEUROPSYCHIATRIC DISEASE AND TREATMENT 2015年 11卷 557-563页

作者： Benoit, Michel Guerchouche, Rachid Petit, Pierre-David Chapoulie, Emmanuelle Manera, Valeria Chaurasia, Gaurav Drettakis, George Robert, Philippe Univ Nice Sophia Antipolis EA CoBTeK IA Sophia Antipolis France CHU Nice Clin Psychiat Sophia Antipolis France Inst Natl Rech Informat & Automat Sophia Antipolis France CHU Nice Ctr Memoire Ressources & Rech F-06202 Nice France

Background: Virtual reality (VR) opens up a vast number of possibilities in many domains of therapy. The primary objective of the present study was to evaluate the acceptability for elderly subjects of a VR experience using the image-based rendering virtual environment (IBVE) approach and secondly to test the hypothesis that visual cues using VR may enhance the generation of autobiographical memories. Methods: Eighteen healthy volunteers (mean age 68.2 years) presenting memory complaints with a Mini-Mental State Examination score higher than 27 and no history of neuropsychiatric disease were included. Participants were asked to perform an autobiographical fluency task in four conditions. The first condition was a baseline grey screen, the second was a photograph of a well-known location in the participant's home city (FamPhoto), and the last two conditions displayed VR, ie, a familiar image-based virtual environment (FamIBVE) consisting of an image-based representation of a known landmark square in the center of the city of experimentation (Nice) and an unknown image-based virtual environment (UnknoIBVE), which was captured in a public housing neighborhood containing unrecognizable building fronts. After each of the four experimental conditions, participants filled in self-report questionnaires to assess the task acceptability (levels of emotion, motivation, security, fatigue, and familiarity). CyberSickness and Presence questionnaires were also assessed after the two VR conditions. Autobiographical memory was assessed using a verbal fluency task and quality of the recollection was assessed using the "remember/know" procedure. Results: All subjects completed the experiment. Sense of security and fatigue were not significantly different between the conditions with and without VR. The FamPhoto condition yielded a higher emotion score than the other conditions (P<0.05). The CyberSickness questionnaire showed that participants did not experience sickness during the expe

关键词： memory elderly virtual reality image-based rendering immersive environment reminiscence therapy

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：