检索结果-内蒙古大学图书馆

FDCPNet:feature discrimination and context propagation network for 3D shape representation

虚拟现实与智能硬件(中英文) 2025年第1期7卷 83-94页

作者： Weimin SHI Yuan XIONG Qianwen WANG Han JIANG Zhong ZHOU State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and EngineeringBeihang UniversityBeijing 100191China

Background Three-dimensional(3D)shape representation using mesh data is essential in various applications,such as virtual reality and simulation *** methods for extracting features from mesh edges or faces struggle with complex 3D models because edge-based approaches miss global contexts and face-based methods overlook variations in adjacent areas,which affects the overall *** address these issues,we propose the Feature Discrimination and Context Propagation Network(FDCPNet),which is a novel approach that synergistically integrates local and global features in mesh *** FDCPNet is composed of two modules:(1)the Feature Discrimination Module,which employs an attention mechanism to enhance the identification of key local features,and(2)the Context Propagation Module,which enriches key local features by integrating global contextual information,thereby facilitating a more detailed and comprehensive representation of crucial areas within the mesh *** Experiments on popular datasets validated the effectiveness of FDCPNet,showing an improvement in the classification accuracy over the baseline ***,even with reduced mesh face numbers and limited training data,FDCPNet achieved promising results,demonstrating its robustness in scenarios of variable complexity.

关键词： 3D shape representation Mesh model MeshNet Feature discrimination Context propagation

来源：评论

学校读者我要写书评

暂无评论

Subthreshold Depression Recognition and Correlation Study from Pulse Condition via Stacking Ensemble Algorithm 1st

Subthreshold Depression Recognition and Correlation Study f...

引用

1st International Conference on Extended Reality, ICXR 2024

作者： Jiang, Han Li, Ming Gao, Yang Li, Peiru State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing China School of Computer Science and Engineering Beihang University Beijing China

ISBN: (纸本)9789819636785

Subthreshold depression, a transition state to depression, seriously hinders the early diagnosis of depression. Current studies mostly use heterogeneous definitions of subthreshold depression, making the results of such meta-analyses questionable. Therefore, it is of vital significance to develop an objective method for the diagnosis of subthreshold depression based on objective criteria. In traditional Chinese medicine (TCM), symptoms similar to subthreshold depression have been extensively explored. However, diagnostic methods in TCM still depend heavily on the experience of doctors and lack integration with modern diagnostic techniques, which makes it challenging to explain the pathogenesis of subthreshold depression. Consequently, we propose an explainable framework, based on a stacking ensemble algorithm, for subthreshold depression recognition from biomarkers in the pulse waveform and concepts of pulse in TCM. In this method, Naive Bayes, Random Forest, Extremely Randomized Trees, Categorical Boosting and Logistic Regression are chosen as basic learners, and XGBoost is selected as the meta-classifier. Based on the five-fold cross-validation method, grid search method and repetition of training, the stacking ensemble model shows superiority on most performance evaluation metrics including AUC, F1 scores, MCC, precision and sensitivity. Besides, by analyzing the Adjusted Odds Ratio of features in the pulse waveform, we obtained four features that have a high correlation with the occurrence of subthreshold depression and derived physiological changes in patients with subthreshold depression based on their physiological significance. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Diagnosis

来源：评论

学校读者我要写书评

暂无评论

RDM: A Light Field Super-Resolution Model Improved with Retinex Decomposition 16

RDM: A Light Field Super-Resolution Model Improved with Reti...

引用

16th International Conference on Signal Processing Systems, ICSPS 2024

作者： Lyu, Wenqi Ke, Wei Sheng, Hao Ma, Xiao Liu, Lixue Faculty of Applied Sciences Macao Polytechnic University China State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing100191 China

ISBN: (纸本)9781510689251

Light field cameras hold significant value in applications such as depth estimation, 3D video acquisition, and image super-resolution. Compared to traditional single-image super-resolution methods, light field images can capture object information from multiple spatial and angular perspectives, which is more conducive to capturing detail information. However, current advanced light field super-resolution models still exhibit issues like blurriness, jaggedness, and dimness in 4x light field super-resolution. To address this, we propose a novel light field super-resolution framework that utilizes the Retinex decomposition concept to solve common problems such as ghosting and overlap, thereby improving image quality. By decomposing the light field image into illumination and reflection components and processing them separately, our model significantly enhances detail preservation and color consistency. Experimental results on multiple datasets demonstrate that our model exhibits outstanding performance, both subjectively and objectively, highlighting the effectiveness of this framework and its broad application potential in the field of computational imaging. © 2025 SPIE.

关键词： Image acquisition

来源：评论

学校读者我要写书评

暂无评论

Segmentation of CAD models using hybrid representation

引用

虚拟现实与智能硬件(中英文) 2025年第2期7卷 188-202页

作者： Claude UWIMANA Shengdi ZHOU Limei YANG Zhuqing LI Norbelt MUTAGISHA Edouard NIYONGABO Bin ZHOU State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and EngineeringBeihang UniversityBeijing 100191China Peace-Bay Academy of Virtual Reality Shenyang 110004China China Aerospace Systems Engineering Corporation Beijing 100070China Department of Signal and Information Processing Beihang UniversityBeijing 100191China Department of Computer Science University of SherbrookeSherbrooke J1C0A1Canada

In this paper,we introduce an innovative method for computer-aided design(CAD)segmentation by concatenating meshes and CAD *** previous CAD segmentation methods have achieved impressive performance using single representations,such as meshes,CAD,and point ***,existing methods cannot effectively combine different three-dimensional model types for the direct conversion,alignment,and integrity maintenance of geometric and topological ***,we propose an integration approach that combines the geometric accuracy of CAD data with the flexibility of mesh representations,as well as introduce a unique hybrid representation that combines CAD and mesh models to enhance segmentation *** combine these two model types,our hybrid system utilizes advanced-neural-network techniques to convert CAD models into mesh *** complex CAD models,model segmentation is crucial for model retrieval and *** partial retrieval,it aims to segment a complex CAD model into several simple *** first component of our hybrid system involves advanced mesh-labeling algorithms that harness the digitization of CAD properties to mesh *** second component integrates labelled face features for CAD segmentation by leveraging the abundant multisemantic information embedded in CAD *** combination of mesh and CAD not only refines the accuracy of boundary delineation but also provides a comprehensive understanding of the underlying object *** study uses the Fusion 360 Gallery *** results indicate that our hybrid method can segment these models with higher accuracy than other methods that use single representations.

关键词： B-RepNet hybrid segmentation CAD models classification MeshCNN MeshCAD-Net

来源：评论

学校读者我要写书评

暂无评论

LipText: Lip Tracking Based Text Entry in VR 1st

LipText: Lip Tracking Based Text Entry in VR

引用

1st International Conference on Extended Reality, ICXR 2024

作者： Leng, Jiaye Wang, Zijun Wu, Jian Wang, Lili School of Creative Media City University of Hong Kong Kowloon Tong Hong Kong State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing100191 China

ISBN: (纸本)9789819636785

Text entry is an important task in virtual reality (VR), and most existing methods require hand involvement, while hands-free typing has great potential for applications in mobile scenarios. Existing hands-free text entry methods are usually implemented by combining the head and eyes with techniques such as Dwell, Blink and Gesture, which can easily fatigue the user. In this paper, we propose LipText, a lip-tracking-based text entry method in VR. We use a neural network to perform letter-level prediction on the lip data captured by the facial tracker and use head-based selection as an auxiliary to improve the accuracy. We conduct a user study to evaluate our method, the results show a typing speed of 8.63 WPM for the novice group, 9.81 WPM for the potential expert group, and the highest recorded typing speed is 11.13 WPM achieved by a potential expert. Our method is also novice-friendly, and their typing speed increased by 64.38% over a six-day practice. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： virtual environments

来源：评论

学校读者我要写书评

暂无评论

Refining Boundary Sample Space for Differentiable Rendering 16

Refining Boundary Sample Space for Differentiable Rendering

引用

2024 16th International Conference on Graphics and Image Processing, ICGIP 2024

作者： Gao, Ruicheng Qi, Yue State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing100191 China Jingdezhen Research Institute Beihang University Jingdezhen333000 China Qingdao Research Institute Beihang University Qingdao266104 China

ISBN: (数字)9781510688780

ISBN: (纸本)9781510688773

The objective of physics-based differentiable rendering (PBDR) is to propagate gradients between scene parameters and the intensities of image pixels in a manner that is physically correct. The gradients obtained can be applied in optimization algorithms for the reconstruction of 3D geometry or materials, or they can be further propagated into neural network to learn neural representations of the scene. However, applying automatic differentiation techniques directly to the primary rendering process will result in biased gradients, as the rendering integral contains moving high-dimensional discontinuities. Based on how these discontinuities are managed-either implicitly or explicitly-existing PBDR methods can be categorized into two groups: reparameterization methods and boundary sampling methods. Boundary sampling methods need to construct paths that have one segment tangent to the geometry being differentiated in order to estimate a boundary integral to address the discontinuities explicitly. Such paths are usually constructed by sampling the tangent segment first and then extending it to complete the paths for subsequent processing. Fortunately, the number of dimensions in the space composed of such tangent segments is only three. In scenes comprised solely of triangle meshes, the first dimension is used to parameterize all the edges on the mesh, which determines a point on the tangent segment. The remaining two dimensions are used to parameterize the direction of the tangent segment. However, state-of-the-art boundary sampling methods parameterize the first dimension uniformly, which is inefficient because only a small portion of the edges contributes to the boundary integral, resulting in wasted parameter space. In this paper, we parameterize the first dimension by considering both edge length and contributions, thereby allocating more parameter space to important edges. Experiments demonstrate that our methods achieve lower variance gradients in the forward dif

关键词： Mesh generation

来源：评论

学校读者我要写书评

暂无评论

SSCCPC-Net: Simultaneously Learning 2D and 3D Features with CLIP for Semantic Scene Completion on Point Cloud 41st

SSCCPC-Net: Simultaneously Learning 2D and 3D Features with...

引用

41st computer Graphics International Conference, CGI 2024

作者： Duan, Wantong Bao, Yongtang Qi, Yue State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing100191 China Shandong University of Science and Technology Qingdao266590 China Jingdezhen Research Institute of Beihang University Jingdezhen333000 China Qingdao Research Institute of Beihang University Qingdao266000 China

ISBN: (纸本)9783031820236

Compare to traditional Scene Completion (SC), Semantic Scene Completion (SSC) is a challenging task that aims to generate complete and semantically consistent 3D scene from partial and sparse input data, which is fundamental to fully understanding the scene and being able to interact with it. Consequently, the SSC task has received much attention in recent years. Most of the methods are voxel-based approaches, but they have high computational and memory requirements. A few works based on point cloud do not sufficiently exploit the correlation between semantic segmentation and geometric completion subtasks, while focusing too much on point cloud shape features and ignoring the rich texture information that RGB images can provide. In this paper, we present SSCCPC-Net (Semantic Scene Completion with CLIP on Point Cloud-Net), a novel network architecture for point cloud semantic scene completion using a combination of 2D and 3D features. Inspired by recent works of large pretrained vision-language models in semantic segmentation, we explore to accomplish SSC task with the help of Contrastive Language-Image Pre-Training (CLIP) model. Specifically, we use the CLIP features for guidance to fuse the 2D features extracted from the RGB image and the 3D features extracted from the point cloud. The fused features are then fed into our designed Semantic-Completion Decoder for per-point semantic prediction and semantic labeling-assisted point cloud completion. Finally, we obtain the complete semantically point cloud. Numerous experiments have demonstrated that our method has higher effectiveness and generalizability compared to state-of-the-art methods. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Optimized Breast Lesion Segmentation in Ultrasound Videos Across Varied Resource-Scant Environments 17th

Optimized Breast Lesion Segmentation in Ultrasound Videos A...

引用

17th Asian Conference on computer Vision, ACCV 2024

作者： Li, Yunhao Chen, Zibin Yan, Junming Ding, Ziyu Li, Jie Huang, Teng Pei, Xiaoqing Zhang, Zheng Wang, Qiong Pang, Yan Institute of Artificial Intelligence Guangzhou University Guangzhou China Cancer Center Sun Yat-sen University Guangzhou China Moxibustion and Rehabilitation Guangzhou University of Chinese Medicine Guangzhou China Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Beijing China

ISBN: (纸本)9789819609659

Medical video segmentation plays a crucial role in clinical diagnosis and therapeutic procedures by enabling dynamic tracking of breast lesions across frames in ultrasound videos, thereby improving segmentation accuracy. However, the existing methods struggle to strike a balance between segmentation accuracy and inference speed, which impedes their real-time deployment in resource-limited medical environments. To overcome these challenges, we introduce a rapid breast lesion segmentation framework named RbS. RbS employs the Stem module and RbSBlock to enhance representations through intra-frame analysis of ultrasound videos. Moreover, we have developed two versions of RbS: RbS-S boasts enhanced segmentation accuracy, while RbS-L ensures faster inference speeds. Experimental evidence indicates that RbS surpasses current leading models in both segmentation efficiency and prediction accuracy, particularly on resource-limited devices. Our contribution significantly propels the progress of developing efficient medical video segmentation frameworks suitable for various medical platforms. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Image segmentation

来源：评论

学校读者我要写书评

暂无评论

Semantics-Aware Avatar Locomotion Adaption for Indoor Cross-Scene AR Telepresence

引用

IEEE Transactions on Visualization and computer Graphics 2025年 PP卷 PP页

作者： Li, Yi-Jun Yang, Hao-Zhong Shu, Wen-Tong Wang, Miao Tsinghua University Department of Computer Science and Technology Beijing100084 China Beihang University China Beihang University State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beijing100191 China Zhongguancun Laboratory Beijing100094 China

Geographically dispersed users often rely on virtual avatars as intermediaries to facilitate interactive communication and collaboration. However, existing methods for augmented reality (AR) telepresence applications exhibit limitations, including restricted movement within confined sub-areas, lack of smooth transitions, and the necessity for manually establishing object mapping between dissimilar environments. We present a novel interactive AR framework for virtual avatar locomotion adaption while preserving semantic coherence across dissimilar indoor scenes. Initially, we conduct a preliminary user study to identify key attributes influencing preferred avatar movement. These attributes are quantified as features, and a dataset of user annotations on avatar movements is created. Based on the user interaction and scene configurations, we employ a deep reinforcement learning neural network to guide the avatar to the ideal position while maximizing semantic coherence. We validate our proposed framework through simulations and user studies by implementing an AR-based 3D telepresence prototype, demonstrating the efficacy of our framework in conveying user intentions across dissimilar environments, enabling natural and immersive 3D telepresence interactions. © 1995-2012 IEEE.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learning

arXiv

引用

arXiv 2025年

作者： Zhong, Hanwen Chen, Jiaxin Zhang, Yutong Huang, Di Wang, Yunhong State Key Laboratory of Virtual Reality Technology and Systems Beihang University China School of Computer Science and Engineering Beihang University Beijing China

Multi-Task Learning (MTL) for Vision Transformer aims at enhancing the model capability by tackling multiple tasks simultaneously. Most recent works have predominantly focused on designing Mixture-of-Experts (MoE) structures and integrating Low-Rank Adaptation (LoRA) to efficiently perform multi-task learning. However, their rigid combination hampers both the optimization of MoE and the effectiveness of reparameterization of LoRA, leading to sub-optimal performance and low inference speed. In this work, we propose a novel approach dubbed Efficient Multi-Task Learning (EMTAL) by transforming a pre-trained Vision Transformer into an efficient multi-task learner during training, and reparameterizing the learned structure for efficient inference. Specifically, we firstly develop the MoEfied LoRA structure, which decomposes the pre-trained Transformer into a low-rank MoE structure and employ LoRA to fine-tune the parameters. Subsequently, we take into account the intrinsic asynchronous nature of multi-task learning and devise a learning Quality Retaining (QR) optimization mechanism, by leveraging the historical high-quality class logits to prevent a well-trained task from performance degradation. Finally, we design a router fading strategy to integrate the learned parameters into the original Transformer, archiving efficient inference. Extensive experiments on public benchmarks demonstrate the superiority of our method, compared to the state-of-the-art multi-task learning approaches. The project page is available at https://***/Yewen1486/EMTAL. Copyright © 2025, The Authors. All rights reserved.

关键词： Multi-task learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：