检索结果-内蒙古大学图书馆

2023 IEEE/CVF Conference on computer vision and Pattern Recognition Workshops, CVPRW 2023

作者： Wang, Tun Chen, Rongshan Cong, Ruixuan Yang, Da Cui, Zhenglong Li, Fangping Sheng, Hao Beihang University State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beijing100191 China Beihang Hangzhou Innovation Institute Yuhang Xixi Octagon City Hangzhou310023 China Macao Polytechnic University Faculty of Applied Sciences 999078 China

ISBN: (纸本)9798350302493

Recent learning-based light field (LF) disparity estimation methods construct cost volume by sequentially shifting each sub-aperture image (SAI) with a series of predefined offsets. They only use the visual information of SAIs and lose the geometry of LF. In this paper, we design a simple network that can cleverly integrate EPI features with cost volume to estimate the disparity. Firstly, we propose an efficient EPI extraction module to use abundant line characteristics. Secondly, we offer an EPI-Cost volume construction module that can create volume guided by the EPI line and the color consistency of images. Finally, after completing it, we adopt an inter-volume fusion module to considerably correlate the validity of EPI lines in both directions. Experimental results show the proposed method achieves state-of-the-art performance in the quantitative and qualitative evaluation of the UrbanLF-Syn dataset. © 2023 IEEE.

关键词： Cost estimating

来源：评论

学校读者我要写书评

暂无评论

PEIE: Physics Embedded Illumination Estimation for Adaptive Dehazing 39

PEIE: Physics Embedded Illumination Estimation for Adaptive ...

引用

39th Annual AAAI Conference on Artificial Intelligence, AAAI 2025

作者： Liu, Huaizhuo Hu, Hai-Miao Jiang, Yonglong Liu, Yurui Hangzhou Innovation Institute Beihang University China State Key Laboratory of Virtual Reality Technology and Systems Beihang University China School of Computer Science and Engineering Beihang University China

ISBN: (纸本)157735897X

Deep learning-based methods have made significant progress in image dehazing. However, these methods often falter when applied to real-world hazy images, primarily due to the scarcity of paired real-world data and the limitations of current dehazing feature extractors. Toward these issues, we introduce a novel Physics Embedded Illumination Estimation (PEIE) method for adaptive real-world dehazing. Specifically, (1) we identify the limitations of the widely used Atmospheric Scattering Model and propose a new physical model, the Illumination-Adaptive Scattering Model (IASM), for more accurate illumination representation in hazy imaging;(2) we develop a robust data synthesis pipeline that leverages the physics embedded illumination estimation to generate realistic hazy images;and (3) we design an Illumination-Adaptive Dehazing Unit (IDU) to extract dehazing features consistent with our proposed IASM in the latent space. By integrating the IDU into a U-Net architecture to create IADNet, we achieve significant improvements in dehazing performance through end-to-end training on synthetic data. Extensive experiments validate the superior performance of our PEIE method, significantly surpassing the state-of-the-arts in real-world dehazing. © 2025, Association for the Advancement of Artificial Intelligence (***). All rights reserved.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

Degradation Conditioned GAN for Degradation Generalization of Face Restoration Models

Degradation Conditioned GAN for Degradation Generalization o...

引用

IEEE International Conference on Image Processing

作者： Song Qi Wu Shi Guojing Ge Liang Chang Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen Institute of Advanced Technology Chinese Academy of Sciences School of Artificial Intelligence Beijing Normal University Institute of Automation Chinese Academy of Sciences

Face restoration models are usually trained on synthetic degraded data to output an image that matches the clean version of itself. Most previous methods use a single model to deal with all the degradation levels, resulting in a domain generalization problem. We explore the value of degradation information and propose a Degradation Conditioned GAN (DeCGAN). The architecture consists of modulated convolution, bias, and fusion modules, inspired by deblurring, denoising and super-resolution. The whole network can be modulated by the degradation levels to achieve delicate and precise restoration effects. Experiments are conducted on conventional and modulated face restoration tasks. DeCGAN can achieve more faithful restoration and better metrics (FID, LPIPS, etc.) than previous methods do. Moreover, our model performs well on real-world low-quality face images.

关键词：

来源：评论

学校读者我要写书评

暂无评论

WinDB: HMD-free and Distortion-free Panoptic Video Fixation Learning

arXiv

引用

arXiv 2023年

作者： Wang, Guotao Chen, Chenglizhao Hao, Aimin Qin, Hong Fan, Deng-Ping The State Key Laboratory of Virtual Reality Technology and Systems Beihang University China The College of Computer Science and Technology China University of Petroleum China The State Key Laboratory of Virtual Reality Technology and Systems Beihang University Research Unit of Virtual Human and Virtual Surgery Chinese Academy of Medical Sciences and with Pengcheng Laboratory China The Computer Science Department Stony Brook University United States ETH Zurich Zurich Switzerland

To date, the widely adopted way to perform fixation collection in panoptic video is based on a head-mounted display (HMD), where users' fixations are collected while wearing an HMD to explore the given panoptic scene freely. However, this widely-used data collection method is insufficient for training deep models to accurately predict which regions in a given panoptic are most important when it contains intermittent salient events. The main reason is that there always exist "blind zooms" when using HMD to collect fixations since the users cannot keep spinning their heads to explore the entire panoptic scene all the time. Consequently, the collected fixations tend to be trapped in some local views, leaving the remaining areas to be the "blind zooms". Therefore, fixation data collected using HMD-based methods that accumulate local views cannot accurately represent the overall global importance - the main purpose of fixations - of complex panoptic scenes. To conquer, this paper introduces the auxiliary window with a dynamic blurring (WinDB) fixation collection approach for panoptic video, which doesn't need HMD and is able to well reflect the regional-wise importance degree. Using our WinDB approach, we have released a new PanopticVideo-300 dataset, containing 300 panoptic clips covering over 225 categories. Specifically, since using WinDB to collect fixations is blind zoom free, there exists frequent and intensive "fixation shifting" - a very special phenomenon that has long been overlooked by the previous research - in our new set. Thus, we present an effective fixation shifting network (FishNet) to conquer it. All these new fixation collection tool, dataset, and network could be very potential to open a new age for fixation-related research and applications in 360o environments. © 2023, CC BY.

关键词： Helmet mounted displays

来源：评论

学校读者我要写书评

暂无评论

Effects of virtual environment and self-representations on perception and physical performance in redirected jumping

引用

virtual reality & Intelligent Hardware 2021年第6期3卷 451-469页

作者： Yijun LI Miao WANG Derong JIN Frank STEINICKE Qinping ZHAO State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and EngineeringBeihang UniversityBeijing 100083China Peng Cheng Laboratory Shenzhen 518055China Universiẗat Hamburg Hamburg 21071Germany

Background Redirected jumping(RDJ)allows users to explore virtual environments(VEs)naturally by scaling a small real-world jump to a larger virtual jump with virtual camera motion manipulation,thereby addressing the problem of limited physical space in VR *** RDJ studies have mainly focused on detection threshold ***,the effect VE or self representation(SR)has on the perception or performance of RDJs remains *** In this paper,we report experiments to measure the perception(detection thresholds for gains,presence,embodiment,intrinsic motivation,and cybersickness)and physical performance(heart rate intensity,preparation time,and actual jumping distance)of redirected forward jumping under six different combinations of VE(low and high visual richness)and SRs(invisible,shoes,and human-like).Results Our results indicated that the detection threshold ranges for horizontal translation gains were significantly smaller in the VE with high rather than low visual *** different SRs were applied,our results did not suggest significant differences in detection thresholds,but it did report longer actual jumping distances in the invisible body case compared with the other two *** the high visual richness VE,the preparation time for jumping with a human-like avatar was significantly longer than that with other ***,some correlations were found between perception and physical performance *** All these findings suggest that both VE and SRs influence users'perception and performance in RDJ and must be considered when designing locomotion techniques.

关键词： virtual reality virtual locomotion Redirected jumping

来源：评论

学校读者我要写书评

暂无评论

Transforming vision transformer: towards efficient multi-task asynchronous learning 24

Transforming vision transformer: towards efficient multi-tas...

引用

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Hanwen Zhong Jiaxin Chen Yutong Zhang Di Huang Yunhong Wang State Key Laboratory of Virtual Reality Technology and Systems Beihang University China and School of Computer Science and Engineering Beihang University Beijing China School of Computer Science and Engineering Beihang University Beijing China

ISBN: (纸本)9798331314385

Multi-Task Learning (MTL) for vision Transformer aims at enhancing the model capability by tackling multiple tasks simultaneously. Most recent works have predominantly focused on designing Mixture-of-Experts (MoE) structures and integrating Low-Rank Adaptation (LoRA) to efficiently perform multi-task learning. However, their rigid combination hampers both the optimization of MoE and the effectiveness of reparameterization of LoRA, leading to sub-optimal performance and low inference speed. In this work, we propose a novel approach dubbed Efficient Multi-Task Learning (EMTAL) by transforming a pre-trained vision Transformer into an efficient multi-task learner during training, and reparameterizing the learned structure for efficient inference. Specifically, we firstly develop the MoEfied LoRA structure, which decomposes the pre-trained Transformer into a low-rank MoE structure and employ LoRA to fine-tune the parameters. Subsequently, we take into account the intrinsic asynchronous nature of multi-task learning and devise a learning Quality Retaining (QR) optimization mechanism, by leveraging the historical high-quality class logits to prevent a well-trained task from performance degradation. Finally, we design a router fading strategy to integrate the learned parameters into the original Transformer, archiving efficient inference. Extensive experiments on public benchmarks demonstrate the superiority of our method, compared to the state-of-the-art multi-task learning approaches. The project page is available at https://***/Yewen1486/EMTAL.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Heuristic-Driven, Type-Specific Embedding in Parallel Spaces for Enhancing Knowledge Graph Reasoning

Heuristic-Driven, Type-Specific Embedding in Parallel Spaces...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Yao Liu Yongfei Zhang Xin Wang Shan Yang Beijing Key Laboratory of Digital Media School of Computer Science and Engineering Beihang University Beijing China State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing China Department of Computer Science and Technology Tsinghua University Beijing China

Knowledge Graph Reasoning aims to derive new insights from existing Knowledge Graphs (KGs) and address any missing or incomplete data. Existing models primarily rely on explicit information while neglecting the implicit constraints imposed by entity types on relations types. For example, when the entity type is "person-person," the relation type should be constrained to interpersonal connections like "co-worker." Based on this perspective, we introduce a priori knowledge-based approach for inferring relations types. This approach utilizes the relations type distribution across different entity types in the dataset to guide the inference process. Additionally, recognizing that mapping all different relations types to a single space can decrease inference accuracy due to the diversity of semantics, we propose a parallel spaces KG embedding model that partitions the entire KG into multiple subspaces. Each subspace is dedicated to learning information associated with a specific relation type. Experimental results on three KG reasoning benchmarks demonstrate that our model outperforms other baselines in accuracy. Importantly, our model shows significant advantages when applied to datasets with a substantial number of relations.

关键词：

来源：评论

学校读者我要写书评

暂无评论

SEMANTICALLY-GUIDED DISENTANGLED REPRESENTATION FOR ROBUST GAIT RECOGNITION

SEMANTICALLY-GUIDED DISENTANGLED REPRESENTATION FOR ROBUST G...

引用

2021 IEEE International Conference on Multimedia and Expo, ICME 2021

作者： Chai, Tianrui Mei, Xinyu Li, Annan Wang, Yunhong State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing100191 China

ISBN: (纸本)9781665438643

Gait is an important biometric that can recognize people at a distance. Recently, Disentangled Representation Learning (DRL) has been introduced for distinguishing identity-irrelevant covariate features from identity features for better recognition performance. However, such a simple gait energy image (GEI) pairing operation inevitably brings in over-disentanglement effects that degrade the performance. To address this issue, we proposed a covariate feature control gate module that compensates for the discriminative feature loss by using additional semantic labels. Furthermore, a shared attention module, which allows the identity and covariate part to pay attention to different spatial regions, is also proposed for better spatial disentanglement. Experimental results show that our method outperforms the state-of-the-art and well-explain the mechanism of how the improvement is achieved. The code is available at https://***/ctrasd/GA-ICDNet. © 2021 IEEE

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

MM-3DScene: 3D Scene Understanding by Customizing Masked Modeling with Informative-Preserved Reconstruction and Self-Distilled Consistency

MM-3DScene: 3D Scene Understanding by Customizing Masked Mod...

引用

Conference on computer vision and Pattern Recognition (CVPR)

作者： Mingye Xu Mutian Xu Tong He Wanli Ouyang Yali Wang Xiaoguang Han Yu Qiao The Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Chinese Academy of Sciences Shenzhen Institute of Advanced Technology Shenzhen China University of Chinese Academy of Sciences Shanghai Artificial Intelligence Laboratory SSE CUHKSZ FNii CUHKSZ

Masked Modeling (MM) has demonstrated widespread success in various vision challenges, by reconstructing masked visual patches. Yet, applying MM for large-scale 3D scenes remains an open problem due to the data sparsity and scene complexity. The conventional random masking paradigm used in 2D images often causes a high risk of ambiguity when recovering the masked region of 3D scenes. To this end, we propose a novel informative-preserved reconstruction, which explores local statistics to discover and preserve the representative structured points, effectively enhancing the pretext masking task for 3D scene understanding. Integrated with a progressive reconstruction manner, our method can concentrate on modeling regional geometry and enjoy less ambiguity for masked reconstruction. Besides, such scenes with progressive masking ratios can also serve to self-distill their intrinsic spatial consistency, requiring to learn the consistent representations from unmasked areas. By elegantly combining informative-preserved reconstruction on masked areas and consistency self-distillation from unmasked areas, a unified framework called MM-3DScene is yielded. We conduct comprehensive experiments on a host of downstream tasks. The consistent improvement (e.g., +6.1% mAP@0.5 on object detection and +2.2% mIoU on semantic segmentation) demonstrates the superiority of our approach.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Semantic Contrastive Bootstrapping for Single-positive Multi-label Recognition

arXiv

引用

arXiv 2023年

作者： Chen, Cheng Zhao, Yifan Li, Jia State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University China School of Computer Science Peking University China

Learning multi-label image recognition with incomplete annotation is gaining popularity due to its superior performance and significant labor savings when compared to training with fully labeled datasets. Existing literature mainly focuses on label completion and co-occurrence learning while facing difficulties with the most common single-positive label manner. To tackle this problem, we present a semantic contrastive bootstrapping (Scob) approach to gradually recover the cross-object relationships by introducing class activation as semantic guidance. With this learning guidance, we then propose a recurrent semantic masked transformer to extract iconic object-level representations and delve into the contrastive learning problems on multi-label classification tasks. We further propose a bootstrapping framework in an Expectation-Maximization fashion that iteratively optimizes the network parameters and refines semantic guidance to alleviate possible disturbance caused by wrong semantic guidance. Extensive experimental results demonstrate that the proposed joint learning framework surpasses the state-of-the-art models by a large margin on four public multi-label image recognition benchmarks. Codes can be found at https://***/iCVTEAM/Scob. Copyright © 2023, The Authors. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：