检索结果-内蒙古大学图书馆

A survey for light field super-resolution

High-Confidence Computing 2024年第1期4卷 118-129页

作者： Mingyuan Zhao Hao sheng Da Yang Sizhe Wang Ruixuan Cong Zhenglong Cui Rongshan Chen Tun Wang Shuai Wang Yang Huang Jiahao shen State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and EngineeringBeihang UniversityBeijing 100191China Key Laboratory of Data Science and Intelligent Computing International Innovation InstituteBeihang UniversityHangzhou 311115China State Key Laboratory of Software Development Environment School of Computer Science and EngineeringBeihang UniversityBeijing 100191China

Compared to 2D imaging data,the 4D light field(LF)data retains richer scene’s structure information,which can significantly improve the computer’s perception capability,including depth estimation,semantic segmentation,and LF ***,there is a contradiction between spatial and angular resolution during the LF image acquisition *** overcome the above problem,researchers have gradually focused on the light field super-resolution(LFSR).In the traditional solutions,researchers achieved the LFSR based on various optimization frameworks,such as Bayesian and Gaussian *** learning-based methods are more popular than conventional methods because they have better performance and more robust generalization *** this paper,the present approach can mainly divided into conventional methods and deep learning-based *** discuss these two branches in light field spatial super-resolution(LFSSR),light field angular super-resolution(LFASR),and light field spatial and angular super-resolution(LFSASR),***,this paper also introduces the primary public datasets and analyzes the performance of the prevalent approaches on these ***,we discuss the potential innovations of the LFSR to propose the progress of our research field.

关键词： Light field super-resolution Convolutional neural network Transformer Sub-aperture image Epipolar-plane image

来源：评论

学校读者我要写书评

暂无评论

Expression Fusion to Enhance Video and Speech-Driven 3D Facial Animation 41st

Expression Fusion to Enhance Video and Speech-Driven 3D Fa...

引用

41st Computer Graphics International Conference, CGI 2024

作者： Liu, Yangyue Hu, Yong shen, xukun State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing100191 China School of New Media Art and Design Beihang University Beijing100191 China

ISBN: (纸本)9783031820205

Currently, monocular 3D face capture and tracking methods are difficult to ensure the accuracy of identity and expression, and speech-driven 3D facial animation methods are challenging to acquire head pose and upper facial expression. In response, we propose a video- and speech-driven 3D facial animation synthesis method that attempts to combine the benefits of these methods and avoid their weaknesses. Specifically, to facilitate animation and handle the problem of character identity accuracy, we generate character appearance templates by registering a 3D morphable model (3DMM) to a rigid model. To address the limitations of different methods for acquiring expressions and poses, we design an expression fusion network based on the 3DMM space to fuse the expression data acquired by different modalities and output unified facial expression data. Finally, due to the limitation of the dataset ignoring the eye movements, we design an eye movement enhancement network to add eyelid movements by modifying the facial expression data and then replacing the eye region to get the final 3D face mesh animation. Through detailed experiments, we demonstrate that our method can generate speech-visual synchronized 3D face animations while obtaining better performance results than the current concerns of using monocular video images or speech-driven generation of 3D face animation methods independently. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Animation

来源：评论

学校读者我要写书评

暂无评论

JGHand: Joint-Driven Animatable Hand Avater via 3D Gaussian Splatting

arXiv

引用

arXiv 2025年

作者： Sun, Zhoutao shen, xukun Hu, Yong Zhong, Yuyou Zhou, Xueyang State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing100191 China

Since hands are the primary interface in daily interactions, modeling high-quality digital human hands and rendering realistic images is a critical research problem. Furthermore, considering the requirements of interactive and rendering applications, it is essential to achieve real-time rendering and driveability of the digital model without compromising rendering quality. Thus, we propose Jointly 3D Gaussian Hand (JGHand), a novel joint-driven 3D Gaussian Splatting (3DGS)-based hand representation that renders high-fidelity hand images in real-time for various poses and characters. Distinct from existing articulated neural rendering techniques, we introduce a differentiable process for spatial transformations based on 3D key points. This process supports deformations from the canonical template to a mesh with arbitrary bone lengths and poses. Additionally, we propose a real-time shadow simulation method based on per-pixel depth to simulate self-occlusion shadows caused by finger movements. Finally, we embed the hand prior and propose an animatable 3DGS representation of the hand driven solely by 3D key points. We validate the effectiveness of each component of our approach through comprehensive ablation studies. Experimental results on public datasets demonstrate that JGHand achieves real-time rendering speeds with enhanced quality, surpassing state-of-the-art methods. Copyright © 2025, The Authors. All rights reserved.

关键词： Digital elevation model

来源：评论

学校读者我要写书评

暂无评论

Text-driven 3D Human Generation via Contrastive Preference Optimization

arXiv

引用

arXiv 2025年

作者： Zhou, Pengfei shen, xukun Hu, Yong State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing100191 China

Recent advancements in Score Distillation Sampling (SDS) have significantly improved text-driven 3D human generation, enabling plausible synthesis from natural language descriptions. However, existing methods struggle with fine-grained semantic alignment, leading to inconsistencies in structure, texture, and attribute representation. To address these challenges, we propose a contrastive preference modeling framework that integrates both positive and negative prompts to enhance SDS. This approach refines text-conditioned generation, improving semantic consistency and 3D fidelity. Specifically, we introduce a preference optimization module that aggregates knowledge from multiple preference models to ensure accurate representation of intricate attributes and nuanced details. Additionally, we propose a negation preference module with static-dynamic negation prompts to systematically distinguish relevant details from extraneous elements, ensuring geometric and textural consistency. To further mitigate artifacts and prevent reward hacking, we develop an LLM-driven dynamic negation prompting mechanism that analyzes textual inputs, decomposes complex attributes, and filters irrelevant components. Extensive experiments demonstrate that our method achieves state-of-the-art performance, significantly enhancing texture realism, structure coherence, and overall visual alignment, particularly for complex and lengthy textual descriptions. © 2025, CC BY.

关键词： Three dimensional computer graphics

来源：评论

学校读者我要写书评

暂无评论

Crossing Narrative: Exploring the Possibilities of Crossing the virtuality and reality in Interactive Narrative Experiences 23

Crossing Narrative: Exploring the Possibilities of Crossing ...

引用

2023 SIGGRAPH Asia Posters, SA 2023

作者： Liu, Zixiao Yan, Shuo shen, xukun School of New Media Art and Design Beihang University China School of New Media Art and Design State Key Laboratory of Virtual Reality Technology and Systems Beihang University China

ISBN: (纸本)9798400703133

With the development of mixed reality technology, the convergence of virtual and real experiences has emerged as a trend in the interactive narratives. In this paper, we introduce "Crossing Narrative", an interactive narrative experience that seamlessly blends virtuality and reality by utilizing real-world views and bystanders. We discuss specific methods for designing cross-reality narrative experience, focusing on three key aspects of cross-reality interactions: diegetic objects, transition effects, and bystander’s avatar. Our design methods aim to enhance audience social interactions and understanding of the immersive narrative. © 2023 Copyright held by the owner/author(s).

关键词： Mixed reality

来源：评论

学校读者我要写书评

暂无评论

A Multilayer Component Pane 3D Layout Frame Design for Responsive Websites

A Multilayer Component Pane 3D Layout Frame Design for Respo...

引用

2023 IEEE International Symposium on Mixed and Augmented reality Adjunct, ISMAR-Adjunct 2023

作者： Xu, Guohui Wang, Shan Hu, Yong shen, xukun Beihang University School of New Media Art and Design China Beihang University State Key Laboratory of Virtual Reality Technology and Systems China Yunnan Innovation Institute of Beihang University China

ISBN: (纸本)9798350328912

With a virtual reality (VR) head-mounted display (HMD), users can easily achieve immersive browsing. However, popular VR browsers use a virtual floating screen for web presentations, which severely limits the user experience. In this paper, we propose a responsive website based on Web VR and a 3D UI layout framework equipped with VR device features. The framework consists of two parts: Main Content and 3D Navigation. To test the usability of the framework, we designed an experimental prototype and conducted user tests with 24 participants. The experiments show that the framework can effectively improve the quality of the user experience when browsing the web in a virtual reality environment. The research shows the possible design direction of the user interface for presenting web pages in the future virtual environment. © 2023 IEEE.

关键词： User interfaces

来源：评论

学校读者我要写书评

暂无评论

An Immersive Layout Framework for Web Design in virtual reality

An Immersive Layout Framework for Web Design in Virtual Real...

引用

Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing systems, CHI EA 2023

作者： Lu, Yu Hu, Yong shen, xukun Chen, Zhaojia School of New Media Art and Design Beihang University China State Key Laboratory of Virtual Reality Technology and Systems Beihang University China Yunnan Innovation Institute Beihang University China

ISBN: (纸本)9781450394222

In recent years, many consumer-grade VR devices have emerged, and VR devices have the potential to become the next generation of terminals for visiting websites. Compared to traditional PC and mobile devices, VR moves away from the desktop concept and can show information in a 3D environment. This two-dimensional to three-dimensional transformation means that website layouts, media content, and interactions can make the user experience more immersive. Currently, VR users can visit websites through built-in or third-party browsers, but most website content and UI visuals are consistent with the desktop version instead of the VR version. The website has no separate visual and interactive designs for VR devices. Therefore, this paper analyzes the design elements from three aspects: spatial layout design of website hierarchical structures, presentation of multimedia contents, and interaction modes, and proposes a VR website design framework based on the fan-shaped layout using the spatial depth cue. Based on this design framework, we built a prototype of the VR version of the website in the context of the online museum website of intangible cultural heritage in Yunnan Province. We provided a reference for spatial layout and visual style design for developing the VR website. © 2023 Owner/Author.

关键词： Web Design

来源：评论

学校读者我要写书评

暂无评论

"embark the Journey · Embrace the Universe": An Interactive System of Astronomy Education Based on Spherical TUI in MR 23

"embark the Journey · Embrace the Universe": An Interactive...

引用

2023 SIGGRAPH Asia 2023 XR, SA 2023

作者： Liang, Xiaozhan Hu, Yong shen, xukun School of New Media Art and Design Beihang University Beijing China State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing China Yunnan Innovation Institute of Beihang University Yunnan China

ISBN: (纸本)9798400703164

The widespread adoption and application of MR technology have opened up new possibilities in the field of education. Integrating physical objects and virtual contents in the physical interactive interface provides a larger practical platform for astronomy science education. However, very few attempts are currently at this form of science education. Therefore, we have summarized the design principles for the spherical TUI regarding both interactive interfaces and behaviors. Based on this, we have developed a spherical TUI-based astronomical knowledge system. It delivers users with a more diverse knowledge presentation by a fusion of virtual and reality and mapping interaction of spherical TUI in MR. © 2023 Owner/Author.

关键词： Spheres

来源：评论

学校读者我要写书评

暂无评论

Beyond Realities: Designing Cross-reality Interactions in the Immersive Narrative Experience

Beyond Realities: Designing Cross-Reality Interactions in th...

引用

IEEE International Symposium on Mixed and Augmented reality Workshops (ISMARW)

作者： Zixiao Liu Shuo Yan Wenjie He Xiaomeng Wan xukun shen School of New Media Art and Design Beihang University State Key Laboratory of Virtual Reality Technology and Systems Beihang University

ISBN: (数字)9798331506919

ISBN: (纸本)9798331506926

As closed head-mounted displays (HMDs) limit users’ reality awareness, the cross-reality (CR) interaction has emerged to introduce realities across different stages on the reality-virtuality Continuum (RVC). Although current CR interaction presents passthrough to switch different environments, it results in visual differences that limit a truly immersive and coherent experience. Therefore, it is essential to design seamless and bidirectional CR interactions, rather than sudden switching. In this paper, we propose four CR interactions to bind the virtual and real elements contextually in the highly immersive experience. We designed an immersive narrative "Beyond Realities", and implemented four CR interactions in it: Portal Passthrough, virtual Guidance, Object Passthrough, and Bystander Avatar. We investigated further through a qualitative study (n=11), to explore the impacts of CR interactions on immersive experience, narrative comprehension, and interaction usability. In the highly immersive experience, CR interactions can offer a harmonious blend of virtual and real scenarios.

关键词： Visualization Head-mounted displays Avatars Role playing games Medical treatment Immersive experience Switches Usability Portals

来源：评论

学校读者我要写书评

暂无评论

Reconstructing and editing fluids using the adaptive multilayer external force guiding model

引用

Science China(Information Sciences) 2022年第11期65卷 107-122页

作者： Xiaoying NIE Yong HU xukun shen Zhiyuan SU State Key Laboratory of Virtual Reality Technology and Systems Beihang University School of New Media Art and Design Beihang University

Reconstructing monocular fluids usually involves a tedious trial-and-error process, and editing desired fluid behaviors is notoriously difficult to predict and control. To address these problems, we propose an adaptive multilayer external force guiding model that alleviates the challenging parameter tuning and satisfies user-defined requirements. External forces cause the effect of target particles on fluid *** adaptive multilayer scheme makes the whole 3D fluid volume subject to the shape and motion of the water captured by the input video or designed by users. Therefore, we can avoid the tedious and laborious parameter tuning and easily balance the smoothness of fluid volume and the details of the water ***, to vividly reproduce the inflow and outflow of the video scene, we construct a generation and extinction model to add or delete fluid particles according to the three-dimensional velocity field of target particles calculated using a hybrid model coupling shape-from-shading with optical flow. Besides, we edit fluids by subtly extracting features selected by users using the off-screen rendering method and seamlessly integrating them using the dynamic weight approach. Experiments show that our approach is comparable to the state-of-the-art reconstruction quality and is remarkably convenient in authoring flows by editing ***, our results can be effectively applied to any desired new scenario.

关键词： reconstructing fluids editing fluids monocular videos adaptive multilayer external force guiding model generation and extinction model

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：