We present the first end-to-end approach for real-time material estimation for general object shapes with uniform material that only requires a single color image as input. In addition to Lambertian surface properties...
详细信息
ISBN:
(纸本)9781538664209
We present the first end-to-end approach for real-time material estimation for general object shapes with uniform material that only requires a single color image as input. In addition to Lambertian surface properties, our approach fully automatically computes the specular albedo, material shininess, and a foreground segmentation. We tackle this challenging and ill-posed inverse rendering problem using recent advances in image-to-image translation techniques based on deep convolutional encoder-decoder architectures. The underlying core representations of our approach are specular shading, diffuse shading and mirror images, which allow to learn the effective and accurate separation of diffuse and specular albedo. In addition, we propose a novel highly efficient perceptual rendering loss that mimics real-world image formation and obtains intermediate results even during run time. The estimation of material parameters at real-time frame rates enables exciting mixed-reality applications, such as seamless illumination-consistent integration of virtual objects into real-world scenes, and virtual material cloning. We demonstrate our approach in a live setup, compare it to the state of the art, and demonstrate its effectiveness through quantitative and qualitative evaluation.
We introduce InverseFaceNet, a deep convolutional inverse rendering framework for faces that jointly estimates facial pose, shape, expression, reflectance and illumination from a single input image. By estimating all ...
详细信息
ISBN:
(纸本)9781538664209
We introduce InverseFaceNet, a deep convolutional inverse rendering framework for faces that jointly estimates facial pose, shape, expression, reflectance and illumination from a single input image. By estimating all parameters from just a single image, advanced editing possibilities on a single face image, such as appearance editing and relighting, become feasible in real time. Most previous learning-based face reconstruction approaches do not jointly recover all dimensions, or are severely limited in terms of visual quality. In contrast, we propose to recover high-quality facial pose, shape, expression, reflectance and illumination using a deep neural network that is trained using a large, synthetically created training corpus. Our approach builds on a novel loss function that measures model-space similarity directly in parameter space and significantly improves reconstruction accuracy. We further propose a self-supervised boot-strapping process in the network training loop, which iteratively updates the synthetic training corpus to better reflect the distribution of real-world imagery. We demonstrate that this strategy outperforms completely synthetically trained networks. Finally, we show high-quality reconstructions and compare our approach to several state-of-the-art approaches.
This study represents an analysis of student performance in computer information systems (CIS) courses using the Felder-Silverman Index of Learning styles (ILS) to examine academic success in CIS courses. For this stu...
详细信息
A 32-b three-dimensional (3-D) graphic processor, capable of drawing and rendering realistic 3-D images at the rate of 10M Gouraud-shaded pixel/s with a hidden-surface removal based on Z buffer algorithm, is described...
详细信息
A 32-b three-dimensional (3-D) graphic processor, capable of drawing and rendering realistic 3-D images at the rate of 10M Gouraud-shaded pixel/s with a hidden-surface removal based on Z buffer algorithm, is described. Shading algorithm implementation, pipelined architecture for preprocessing and pixel drawing, and control of dual-port DRAM function have been accomplished on the chip. Multi-chip architecture (up to four chips) for smooth shading enables 40M Gourad-shaded pixel/s performance. The functions of this chip are summarized. Besides Gouraud and constant shading, a variety of 2-D, 3-D, and bit-map graphics functions such as high-speed line drawing, depth cueing, image data bidirectional transfer between the host system, and the bit-map memory, etc. are realized on the LSI.
The introduction of high speed computers with excellent graphic rendering capabilities and software that takes advantage of those capabilities have precipitated a change in the philosophy of teaching introductory cour...
详细信息
The introduction of high speed computers with excellent graphic rendering capabilities and software that takes advantage of those capabilities have precipitated a change in the philosophy of teaching introductory courses in graphics. studies of introductory computergraphics courses have indicated that algorithms, such as line and circle drawing and polygon fills, and the study of data structures to support graphics are common topics taught in introductory courses. A cursory review of available software tools for teaching computergraphics topics indicates that there is a lack of web-based visualizations of commonly taught computergraphics algorithms. The purpose of this paper is to describe a web-based tutorial that has been used to supplement an introductory computergraphics course.
This work is devoted to the automatic detection of unwanted driver behavior such as smoking, using a mobile phone, and eating. The various existing datasets are practically unsuitable for this task. We did not find su...
详细信息
This paper explains an implementation of new media "SuiPo," or Suica Poster, which uses a combination of IC card ticket "Suica" and Internet accessible mobile phone. Customers can get e-mail inform...
详细信息
ISBN:
(纸本)1595936424
This paper explains an implementation of new media "SuiPo," or Suica Poster, which uses a combination of IC card ticket "Suica" and Internet accessible mobile phone. Customers can get e-mail information by touching their IC card ticket on the reader located near the poster. Two pilot tests are conducted before the service has begun. The first test revealed that many people preferred the interactive poster but the registration process was complicated. The second test was conducted after improving the registration process. The lessons learned through two pilot tests are that in addition to the easier registration process, the increased popularity of two dimensional barcode reader in mobile phone has lowered the barrier of registration process. The SuiPo has been introduced in July 31st, 2006 and started service at Shinjuku station and Tokyo station. We hope the implementation would change customers' perception of Suica not only as a ticket or e-money but also as an information tool.
Based on the Evolutionary Algorithm (EA) proposed by [1], this paper presents a new EA version with dynamic difficulty adjustment for a Whac-a-Mole like game used in motor rehabilitation of hand. This new version cons...
详细信息
ISBN:
(纸本)9781538677698
Based on the Evolutionary Algorithm (EA) proposed by [1], this paper presents a new EA version with dynamic difficulty adjustment for a Whac-a-Mole like game used in motor rehabilitation of hand. This new version considers user performance as input and generates the position and time that the target will stay on screen. In order to simulate different users needs, a variety of player profiles were created with diverse horizontal movement speed (ulnar deviation/radial deviation of the hand) and vertical movement speed (supination/pronation of hand), as well as distinctive player attention deficits (response time to the apparition of the targets). The results show that the developed EA can adjust the difficulty factors of the game according to the skill set of each profile.
computer Extended Descriptive Geometry (CeDG) is a new approach to computer modelling of 3D geometric systems that tries to overcome several limitations of current CAD systems. A preliminary version of CeDG for GeoGeb...
详细信息
Face recognition (FR) systems continue to spread in our daily lives with an increasing demand for higher explainability and interpretability of FR systems that are mainly based on deep learning. While bias across demo...
详细信息
暂无评论