检索结果-内蒙古大学图书馆

Efficient multi-constrained optimization for example-based synthesis

VISUAL COMPUTER 2015年第6-8期31卷 893-904页

作者： Hartmann, Stefan Trunz, Elena Krueger, Bjoern Klein, Reinhard Hullin, Matthias B. Univ Bonn Inst Comp Sci 2 D-53113 Bonn Germany

Digital media content comes in a wide variety of modalities and representations. Although they have obvious semantic and structural difference, many of them can be unwrapped into a one-dimensional parameter domain, e.g., time, one spatial dimension. Novel content can then be generated in this parameter domain by computing sequences of elements that are optimal according to an objective to be minimized and in addition satisfy a number of user-defined constraints. examples for this type of content generation task are audio synthesis, human motion synthesis or architectural texture synthesis. In that work, we present a generalized algorithm for this type of content generation task. We demonstrate the potential of our technique on a selection of content creation tasks, namely the generation of extended animation sequences from motion capture libraries and the example-based synthesis of architectural geometry such as buildings and street blocks.

关键词： example-based synthesis Data-driven animation Motion synthesis Building layouts

来源：评论

学校读者我要写书评

暂无评论

example-based Sampling with Diffusion Models 23

Example-Based Sampling with Diffusion Models

引用

SIGGRAPH Asia Conference on Technical Communications (SA Technical Communications)

作者： Doignies, Bastien Bonneel, Nicolas Coeurjolly, David Digne, Julie Paulin, Lois Iehl, Jean-Claude Ostromoukhov, Victor Univ Lyon INSA Lyon CNRS UCBL Lyon France

ISBN: (纸本)9798400703157

Much effort has been put into developing samplers with specific properties, such as producing blue noise, low-discrepancy, lattice or Poisson disk samples. These samplers can be slow if they rely on optimization processes, may rely on a wide range of numerical methods, are not always differentiable. The success of recent diffusion models for image generation suggests that these models could be appropriate for learning how to generate point sets from examples. However, their convolutional nature makes these methods impractical for dealing with scattered data such as point sets. We propose a generic way to produce 2-d point sets imitating existing samplers from observed point sets using a diffusion model. We address the problem of convolutional layers by leveraging neighborhood information from an optimal transport matching to a uniform grid, that allows us to benefit from fast convolutions on grids, and to support the example-based learning of non-uniform sampling patterns. We demonstrate how the differentiability of our approach can be used to optimize point sets to enforce properties.

关键词： diffusion models sampling point patterns example-based synthesis

来源：评论

学校读者我要写书评

暂无评论

example-based Expressive Animation of 2D Rigid Bodies

引用

ACM TRANSACTIONS ON GRAPHICS 2017年第4期36卷 1-10页

作者： Dvoroznak, Marek Benard, Pierre Barla, Pascal Wang, Oliver Sykora, Daniel Czech Tech Univ Fac Elect Engn Prague Czech Republic Univ Bordeaux CNRS UMR 5800 LaBRI Bordeaux France Inria Bordeaux Sud Ouest Talence France Adobe Res San Jose CA USA

We present approach to facilitate the creation of stylized 2D rigid body *** approach can handle multiple rigid objects following complex physically-simulated trajectories with collisions, while retaining a unique artistic style directly specified by the user. Starting with an existing target animation (e.g., produced by a physical simulation engine) an artist interactively draws over a sparse set of frames, and the desired appearance and motion stylization is automatically propagated to the rest of the sequence. The stylization process may also be performed in an off-line batch process from a small set of drawn sequences. To achieve these goals, we combine parametric deformation synthesis that generalizes and reuses hand-drawn exemplars, with non-parametric techniques that enhance the hand-drawn appearance of the synthesized sequence. We demonstrate the potential of our method on various complex rigid body animations which are created with an expressive hand drawn look using notably less manual interventions as compared to traditional techniques.

关键词： 2D animation example-based synthesis

来源：评论

学校读者我要写书评

暂无评论

On Facial Age Progression based on Modified Active Appearance Models with Face Texture 16th

On Facial Age Progression Based on Modified Active Appearanc...

引用

16th UK Workshop on Computational Intelligence (UKCI)

作者： Bukar, Ali Maina Ugail, Hassan Hussain, Nosheen Univ Bradford Ctr Visual Comp Richmond Rd Bradford BD7 1DP W Yorkshire England

ISBN: (纸本)9783319465623;9783319465616

Age progression that involves the reconstruction of facial appearance with a natural ageing effect has several applications. These include the search for missing people and identification of fugitives. The majority of age progression methods reported in the literature are data driven. Hence, such methods learn from training data and utilise statistical models such as 3D morphable models and active appearance models (AAM). Principal component analysis (PCA) which is a vital part of these models has an unfortunate drawback of averaging out texture details. Therefore, they work as a low pass filter and as such many of the face skin deformations and minor details become faded. Interestingly, recent work in 2D and 3D animation has shown that patches of the human face are somewhat similar when compared in isolation. Thus, researchers have proposed generating novel faces by compositing small face patches, usually from large image databases. Following these ideas, we propose a novel age progression model which synthesises aged faces using a hybrid of these two techniques. First, an invertible model of age synthesis is developed using AAM and sparse partial least squares regression (sPLS). Then the texture details of the face are enhanced using the patch-based synthesis approach. Our results show that the hybrid algorithm produces both unique and realistic images. Furthermore, our method demonstrates that the identity and ageing effects of subjects can be more emphasised.

关键词： Age progression Age synthesis Active appearance model example-based synthesis Principal component analysis

来源：评论

学校读者我要写书评

暂无评论

CONSTRAINED example-based AUDIO synthesis

CONSTRAINED EXAMPLE-BASED AUDIO SYNTHESIS

引用

IEEE International Conference on Multimedia and Expo (ICME)

作者： Wenger, Stephan Magnor, Marcus TU Braunschweig Inst Comp Graph Braunschweig Germany

ISBN: (纸本)9781612843490

Music and sound play an important role for the emotional involvement of the spectator in visual media such as movies, video games or artistic shows. However, the generation of suitable background music and atmospheric sound matching the visual context is a tedious and typically completely manual task. For content creators, it would be desirable to be able to specify a sound example and a few key points at which certain parts are to be played, and to then automatically generate a soundtrack subject to these constraints. For interactive media such as video games, on the other hand, example-based background sound could automatically adapt to the game events. We propose a new example-based audio synthesis method for both applications which works for musical and texture-like sound examples alike. Our algorithm is evaluated on a variety of musical styles, from classical music to punk rock, and on several texture-like atmospheric sounds.

关键词： audio synthesis example-based synthesis sound textures

来源：评论

学校读者我要写书评

暂无评论

SINGLE IMAGE SUPER-RESOLUTION VIA PHASE CONGRUENCY ANALYSIS

SINGLE IMAGE SUPER-RESOLUTION VIA PHASE CONGRUENCY ANALYSIS

引用

IEEE International Conference on Visual Communications and Image Processing (VCIP)

作者： Yu, Licheng Xu, Yi Zhang, Bo Shanghai Jiao Tong Univ Dept Elect Engn Shanghai Key Lab Digital Media Proc & Commun Shanghai 200240 Peoples R China

ISBN: (纸本)9781479902880

Single image super-resolution (SR) is a severely unconstrained task. While the self-example-based methods are able to reproduce sharp edges, they perform poorly for textures. For recovering the fine details, higher-level image segmentation and corresponding external texture database are employed in the example-based SR methods, but they involve too much human interaction. In this paper, we discuss the existing problems of example-based technique using scale space analysis. Accordingly, a robust pixel classification method is designed based on the phase congruency model in scale space, which can effectively divide images into edges, textures and flat regions. Then a super-resolution framework is proposed, which can adaptively emphasize the importance of high-frequency residuals in structural examples and scale invariant fractal property in textural regions. Experimental results show that our SR approach is able to present both sharp edges and vivid textures with few artifacts.

关键词： Phase congruency quaternion Gabor super-resolution example-based synthesis fractal-based enhancement

来源：评论

学校读者我要写书评

暂无评论

Adaptive synthesis of Distance Fields

引用

IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2012年第7期18卷 1135-1145页

作者： Lee, Sung-Ho Park, Taejung Kim, Jong-Hyeon Kim, Chang-Hun Korea Univ Comp Graph Lab Seoul 136713 South Korea

We address the computational resource requirements of 3D example-based synthesis with an adaptive synthesis technique that uses a tree-based synthesis map. A signed-distance field (SDF) is determined for the 3D exemplars, and then new models can be synthesized as SDFs by neighborhood matching. Unlike voxel synthesis approach, our input is posed in the real domain to preserve maximum detail. In comparison to straightforward extensions to the existing volume texture synthesis approach, we made several improvements in terms of memory requirements, computation times, and synthesis quality. The inherent parallelism in this method makes it suitable for a multicore CPU. Results show that computation times and memory requirements are very much reduced, and large synthesized scenes exhibit fine details which mimic the exemplars.

关键词： 3D shape synthesis example-based synthesis

来源：评论

学校读者我要写书评

暂无评论

synthesis-based Texture Video Coding with Side Information

引用

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 2011年第5期21卷 647-659页

作者： Oh, Byung Tae Su, Yeping Segall, C. Andrew Kuo, C. -C. Jay Samsung Adv Inst Technol Younggin Si 449712 Gyunggi Do South Korea Sharp Labs Amer Camas WA 98607 USA Univ So Calif Dept Elect Engn Los Angeles CA 90089 USA Univ So Calif Signal & Image Proc Inst Los Angeles CA 90089 USA

The addition of a new component to the traditional synthesis-based texture video coding algorithm is investigated in this paper. That is, we add the side information in the form of low-quality video to enhance the texture video synthesis performance with reducing the unpleasant mismatch between analyzed and synthesized regions. As compared with the conventional synthesis algorithm, our algorithm is more flexible since the behavior and quality of the output texture can be adjusted by the amount of the side information, which is determined by the user. To this end, we develop an area-adaptive side information selection scheme that chooses the proper amount of the side information for a given bit budget. Furthermore, we propose a texture decomposition scheme that extracts the non-synthesizable illumination component from the source video for separate coding so as to maximize the synthesis functionality. The superior performance of the proposed texture video synthesis technique is demonstrated by several coding examples.

关键词： Coding efficiency example-based synthesis illumination variant non-parametric synthesis side information synthesis-based coding texture decomposition texture synthesis video compression

来源：评论

学校读者我要写书评

暂无评论

Interactive image completion with perspective correction

引用

VISUAL COMPUTER 2006年第9-11期22卷 671-681页

作者： Pavic, Darko Schoenefeld, Volker Kobbelt, Leif Rhein Westfal TH Aachen Comp Graph Grp Aachen Germany

We present an interactive system for fragment-based image completion which exploits information about the approximate 3D structure in a scene in order to estimate and apply perspective corrections when copying a source fragment to a target position. Even though implicit 3D information is used, the interaction is strictly 2D, which makes the user interface very simple and intuitive. We propose different interaction metaphors in our system for providing 3D information interactively. Our search and matching procedure is done in the Fourier domain, and hence it is very fast and it allows us to use large fragments and multiple source images with high resolution while still obtaining interactive response times. Our image completion technique also takes user-specified structure information into account where we generalize the concept of feature curves to arbitrary sets of feature pixels. We demonstrate our technique on a number of difficult completion tasks.

关键词： image completion image repair example-based synthesis user interface

来源：评论

学校读者我要写书评

暂无评论

Fragment-based image completion

引用

ACM TRANSACTIONS ON GRAPHICS 2003年第3期22卷 303-312页

作者： Drori, I Cohen-Or, D Yeshurun, H Tel Aviv Univ Sch Comp Sci IL-69978 Tel Aviv Israel

We present a new method for completing missing parts caused by the removal of fore.-round or background elements from an image. Our goal is to synthesize a complete, visually plausible and coherent image. The visible parts of the image serve as a training set to infer the unknown parts. Our method iteratively approximates the unknown regions and composites adaptive image fragments into the image. Values of an inverse matte are used to compute a confidence map and a level set that direct an incremental traversal within the unknown area from high to low confidence. In each step, guided by a fast smooth approximation, an image fragment is selected from the most similar and frequent examples. As the selected fragments are composited. their likelihood increases along with the mean confidence of the image, until reaching a complete image. We demonstrate our method by completion of photographs and paintings.

关键词： image completion example-based synthesis digital matting compositing

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：