检索结果-内蒙古大学图书馆

International Symposium on Mixed and Augmented Reality (ISMAR)

作者： Zhimin Wang Jingyi Sun Mingwei Hu Maohang Rao Weitao Song Feng Lu State Key Laboratory of VR Technology and Systems School of CSE Beihang University Beijing China School of Optics and Photonics Beijing Institute of Technology Beijing China

ISBN: (数字)9798331516475

ISBN: (纸本)9798331516482

Hand-eye coordination techniques find widespread utility in augmented reality and virtual reality headsets, as they retain the speed and intuitiveness of eye gaze while leveraging the precision of hand gestures. However, in contrast to obvious interactive gestures, users prefer less noticeable interactions in public settings due to concerns about social acceptance. To address this, we propose GazeRing, a multimodal interaction technique that combines eye gaze with a smart ring, enabling private and subtle hand-eye coordination while allowing users’ hands complete freedom of movement. Specifically, we design a pressure-sensitive ring that supports sliding interactions in eight directions to facilitate efficient 3D object manipulation. Additionally, we introduce two control modes for the ring: finger-tap and finger-slide, to accommodate diverse usage scenarios. Through user studies involving object selection and translation tasks under two eye-tracking accuracy conditions, with two degrees of occlusion, GazeRing demonstrates significant advantages over existing techniques that do not require obvious hand gestures (e.g., gaze-only and gaze-speech interactions). Our GazeRing technique achieves private and subtle interactions, potentially improving the user experience in public settings. A demo video can be found at ***/***.

关键词： Headphones Privacy Three-dimensional displays Accuracy Gaze tracking User experience Usability Augmented reality

来源：评论

学校读者我要写书评

暂无评论

"dongba Script Character Construction Space": vr science-based interactive experience of pictographs in intangible cultural heritage 23

"dongba Script Character Construction Space": VR science-bas...

引用

2023 SIGGRAPH Asia 2023 XR, SA 2023

作者： Lu, Yulu Dai, Wensi Yan, Shuo School of New Media Art and Design Beihang University Beijing China State Key Laboratory of Virtual Reality Technology and Systems Beihang University China

ISBN: (纸本)9798400703164

The "Dongba Script Character Construction Space"is an interactive science vr experience based on the Dongba script of the Naxi people in Yunnan Province, China, which provides an immersive virtual reality experience based on the traditional Yiyin script theory. [Selmanović et al., 2020] Specifically, this work combines the character construction characteristics of "pictogram", "simple ideographs"and "compound ideographs"to explore the meaning and visual symbolic characteristics of Naxi pictograms through three interesting forms of interaction, and provides more possibilities for the inheritance and development of Dongba in the future by using various forms of interaction. © 2023 Owner/Author.

关键词： Virtual reality

来源：评论

学校读者我要写书评

暂无评论

Transitioning360: Content-aware NFoV Virtual Camera Paths for 360° Video Playback 19

Transitioning360: Content-aware NFoV Virtual Camera Paths fo...

引用

19th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2020

作者： Wang, Miao Li, Yi-Jun Zhang, Wen-Xuan Richardt, Christian Hu, Shi-Min Beihang University State Key Laboratory of Virtual Reality Technology and Systems China University of Bath United Kingdom Tsinghua University BNRist Beijing China

ISBN: (纸本)9781728185088

Despite the increasing number of head-mounted displays, many 360° vr videos are still being viewed by users on existing 2D displays. To this end, a subset of the 360° video content is often shown inside a manually or semi-automatically selected normal-field-of-view (NFoV) window. However, during the playback, simply watching an NFoV video can easily miss concurrent off-screen content. We present Transitioning360, a tool for 360° video navigation and playback on 2D displays by transitioning between multiple NFoV views that track potentially interesting targets or events. Our method computes virtual NFoV camera paths considering content awareness and diversity in an offline preprocess. During playback, the user can watch any NFoV view corresponding to a precomputed camera path. Moreover, our interface shows other candidate views, providing a sense of concurrent events. At any time, the user can transition to other candidate views for fast navigation and exploration. Experimental results including a user study demonstrate that the viewing experience using our method is more enjoyable and convenient than previous methods. © 2020 IEEE.

关键词： Cameras

来源：评论

学校读者我要写书评

暂无评论

Efficient Metaballs-Based Collision Detection for vr Neurosurgery Simulation on GPU 33rd

Efficient Metaballs-Based Collision Detection for VR Neurosu...

引用

33rd International Conference on Computer Animation and Social Agents, CASA 2020

作者： Shen, Yang Feng, Huiwei Su, Jian Pan, Junjun National Engineering Laboratory for Cyberlearning and Intelligent Technology Beijing Normal University Beijing China State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing China Peng Cheng Lab Shenzhen China

ISBN: (纸本)9783030634254

This paper presents a novel hybrid model comprising both surface mesh and the metaballs which occupy organs’ interior for the soft tissue modeling. Through the utility of metaballs, we are capable of simplifying the organ interior using a set of overlapping spheres with different radii. We first develop an adaptive approach based on Voronoi Diagram for the initialization of inner metaballs. Then, we resort to global optimization and devise an electrostatic attraction technique to drive the metaballs to best fill the space inside the organ’s boundary. We simplify the surgical instrument as a collection of cylinders with different radii and orientation, and develop an adaptive collision detection method to facilitate the collision between the surgical instrument and metaballs. Our framework is built on the parallel computation architecture of CUDA, and thus can afford interactive performance on a commodity desktop. To illustrate the effectiveness, the above techniques have all been integrated into a vr-based ventriculoscopic surgery simulator. © 2020, Springer Nature Switzerland AG.

关键词： Graphics processing unit

来源：评论

学校读者我要写书评

暂无评论

GazeOnce: Real-Time Multi-Person Gaze Estimation

arXiv

引用

arXiv 2022年

作者： Zhang, Mingfang Liu, Yunfei Lu, Feng Peng Cheng Laboratory China The University of Tokyo Japan State Key Lab. of VR Technology and Systems School of CSE Beihang University China

Appearance-based gaze estimation aims to predict the 3D eye gaze direction from a single image. While recent deep learning-based approaches have demonstrated excellent performance, they usually assume one calibrated face in each input image and cannot output multi-person gaze in real time. However, simultaneous gaze estimation for multiple people in the wild is necessary for real-world applications. In this paper, we propose the first one-stage end-to-end gaze estimation method, GazeOnce, which is capable of simultaneously predicting gaze directions for multiple faces (>10) in an image. In addition, we design a sophisticated data generation pipeline and propose a new dataset, MPSGaze, which contains full images of multiple people with 3D gaze ground truth. Experimental results demonstrate that our unified framework not only offers a faster speed, but also provides a lower gaze estimation error compared with state-of-the-art methods. This technique can be useful in real-time applications with multiple users. Copyright © 2022, The Authors. All rights reserved.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

An integrated enhancement solution for 24-hour colorful imaging

arXiv

引用

arXiv 2020年

作者： Lv, Feifan Zheng, Yinqiang Li, Yicheng Lu, Feng State Key Laboratory of VR Technology and Systems School of CSE Beihang University Beijing China National Institute of Informatics Tokyo Japan Peng Cheng Laboratory Shenzhen China

The current industry practice for 24-hour outdoor imaging is to use a silicon camera supplemented with near-infrared (NIR) illumination. This will result in color images with poor contrast at daytime and absence of chrominance at nighttime. For this dilemma, all existing solutions try to capture RGB and NIR images separately. However, they need additional hardware support and suffer from various drawbacks, including short service life, high price, specific usage scenario, etc. In this paper, we propose a novel and integrated enhancement solution that produces clear color images, whether at abundant sunlight daytime or extremely low-light nighttime. Our key idea is to separate the VIS and NIR information from mixed signals, and enhance the VIS signal adaptively with the NIR signal as assistance. To this end, we build an optical system to collect a new VIS-NIR-MIX dataset and present a physically meaningful image processing algorithm based on CNN. Extensive experiments show outstanding results, which demonstrate the effectiveness of our solution. Copyright © 2020, The Authors. All rights reserved.

关键词： Infrared devices

来源：评论

学校读者我要写书评

暂无评论

Whole-Body Interaction and Representative Applications in Virtual Reality 24th

Whole-Body Interaction and Representative Applications in Vi...

引用

24th International Conference on Human-Computer Interaction, HCI International, HCII 2022

作者： Lou, Xiaolong Li, Xinyi Zheng, Yuhaozhe Shi, Yan School of Humanity Art and Digital Media Hangzhou Dianzi University Hangzhou China State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing China

ISBN: (纸本)9783031063879

A sufficiently qualified virtual reality (vr) application should be an immersive environment where all natural actions and behaviors, e.g., head expressive motions, torso postures, limb gestures and body signs, should be recognized and translated to interactive operations or commands. But according to our survey on the state-of-the-art applications, there is still a large gap between the actuality and the ideal. To fill this gap, we carried out a focus group discussion through which a descriptive framework of whole-body interaction (WBI) techniques was formed. The framework provides a comprehensive illustration about the natural interaction forms derived from human bodily natural actions and behaviors. We also discussed and proposed technical principles for implementing WBI techniques. Based on these, we developed experiencing prototypes and had them evaluated. An empirical user study proved the feasibility and benefits of the WBI techniques. © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： User interfaces

来源：评论

学校读者我要写书评

暂无评论

Learning From Synthetic Photorealistic Raindrop for Single Image Raindrop Removal

Learning From Synthetic Photorealistic Raindrop for Single I...

引用

International Conference on Computer Vision Workshops (ICCV Workshops)

作者： Zhixiang Hao Shaodi You Yu Li Kunming Li Feng Lu State Key Laboratory of VR Technology and Systems Beihang University Beijing China Data61-CSIRO Tencent Australian National University Peng Cheng Laboratory Shenzhen China

ISBN: (数字)9781728150239

ISBN: (纸本)9781728150246

Raindrops adhered to camera lens or windshield are inevitable in rainy scenes and can become an issue for many computer vision systems such as autonomous driving. Because raindrop appearance is affected by too many parameters, therefore it is unlikely to find an effective model based solution. Learning based methods are also problematic, because traditional learning method cannot properly model the complex appearance. Whereas deep learning method lacks sufficiently large and realistic training data. To solve it, in our work, we propose the first photo-realistic dataset of synthetic adherent raindrops for training. The rendering is physics based with consideration of the water dynamic, geometric and photometry. The dataset contains various types of rainy scenes and particularly the rainy driving scenes. Based on the modeling of raindrop imagery, we introduce a detection network which has the awareness of the raindrop refraction as well as its blurring. Based on that, we propose the removal network that can well recover the image structure. Rigorous experiments demonstrate the state-of-the-art performance of our proposed framework.

关键词： Glass Cameras Rain Image reconstruction Training Shape

来源：评论

学校读者我要写书评

暂无评论

What i see is what you see: Joint attention learning for first and third person video co-analysis

arXiv

引用

arXiv 2019年

作者： Yu, Huangyue Cai, Minjie Liu, Yunfei Lu, Feng State Key Laboratory of VR Technology and Systems School of Computer Science and Engineering Beihang University Beijing China Hunan University Hunan China Peng Cheng Laboratory Shenzhen China

In recent years, more and more videos are captured from the firstperson viewpoint by wearable cameras. Such first-person video provides additional information besides the traditional third-person video, and thus has a wide range of applications. However, techniques for analyzing the first-person video can be fundamentally different from those for the third-person video, and it is even more difficult to explore the shared information from both viewpoints. In this paper, we propose a novel method for first- and third-person video co-analysis. At the core of our method is the notion of "joint attention", indicating the learnable representation that corresponds to the shared attention regions in different viewpoints and thus links the two viewpoints. To this end, we develop a multi-branch deep network with a triplet loss to extract the joint attention from the first- and third-person videos via self-supervised learning. We evaluate our method on the public dataset with cross-viewpoint video matching tasks. Our method outperforms the state-of-the-art both qualitatively and quantitatively. We also demonstrate how the learned joint attention can benefit various applications through a set of additional experiments. Copyright © 2019, The Authors. All rights reserved.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

Computer vision based geometric calibration in curved multi-projector displays

Computer vision based geometric calibration in curved multi-...

引用

International Conference on Computer Science and Information technology (CSIT)

作者： Yi Sun Shuling Dai Cheng Ren Na Chen State Key Laboratory of VR Technology and System Beihang University Beijing China Virtual Environments Laboratory Northeastern University Boston USA

In a multi-projector display system, geometric calibration is usually time-consuming and tedious. In this paper, we propose a multi-projector tiled display method with geometry parameters estimation. The method is used for analytic curved surface, such as cylindrical or spherical shaped display. The calibration process is automatic by using computer vision techniques; and in order to estimate the screen and projector parameters, a camera stereo pair with given internals is used to reconstruct 3D points on the screen. In this parametric approach, the camera doesn't have to cover the entire screen and the projectors can be placed roughly, which give the flexibility for various multi-projector display system. For scene rendering, our implementation is distributed, which is more efficient than the image transfer method with modern GPU. At last, we analyzed the effectiveness of the proposed method. Experimental results show that our approach supplied sufficient accuracy and enhanced the immersiveness.

关键词： Laboratories Computational modeling Rotation measurement

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：