检索结果-内蒙古大学图书馆

SSRN 2024年

作者： Truong, Thanh-Dat Luu, Khoa Computer Vision and Image Understanding Lab University of Arkansas Fayetteville72701 United States

understanding action recognition in egocentric videos has emerged as a vital research topic with numerous practical applications. With the limitation in the scale of egocentric data collection, learning robust deep learning-based action recognition models remains difficult. Transferring knowledge learned from the large-scale exocentric data to the egocentric data is challenging due to the difference in videos across views. Our work introduces a novel cross-view learning approach to action recognition (CVAR) that effectively transfers knowledge from the exocentric to the selfish view. First, we present a novel geometric-based constraint into the self-attention mechanism in Transformer based on analyzing the camera positions between two views. Then, we propose a new cross-view self-attention loss learned on unpaired cross-view data to enforce the self-attention mechanism learning to transfer knowledge across views. Finally, to further improve the performance of our cross-view learning approach, we present the metrics to measure the correlations in videos and attention maps effectively. Experimental results on standard egocentric action recognition benchmarks, i.e., Charades-Ego, EPIC-Kitchens-55, and EPIC-Kitchens-100, have shown our approach's effectiveness and state-of-the-art performance. © 2024, The Authors. All rights reserved.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

Multi-view Action Recognition via Directed Gromov-Wasserstein Discrepancy

arXiv

引用

arXiv 2024年

作者： Nguyen, Hoang-Quan Truong, Thanh-Dat Luu, Khoa Computer Vision and Image Understanding Lab University of Arkansas FayettevilleAR72701 United States

Action recognition has become one of the popular research topics in computer vision. There are various methods based on Convolutional Networks and self-attention mechanisms as Transformers to solve both spatial and temporal dimensions problems of action recognition tasks that achieve competitive performances. However, these methods lack a guarantee of the correctness of the action subject that the models give attention to, i.e., how to ensure an action recognition model focuses on the proper action subject to make a reasonable action prediction. In this paper, we propose a multi-view attention consistency method that computes the similarity between two attentions from two different views of the action videos using Directed Gromov-Wasserstein Discrepancy. Furthermore, our approach applies the idea of Neural Radiance Field to implicitly render the features from novel views when training on single-view datasets. Therefore, the contributions in this work are three-fold. Firstly, we introduce the multi-view attention consistency to solve the problem of reasonable prediction in action recognition. Secondly, we define a new metric for multi-view consistent attention using Directed Gromov-Wasserstein Discrepancy. Thirdly, we built an action recognition model based on Video Transformers and Neural Radiance Fields. Compared to the recent action recognition methods, the proposed approach achieves state-of-the-art results on three large-scale datasets, i.e., Jester, Something-Something V2, and Kinetics-400. © 2024, CC BY.

关键词： Large datasets

来源：评论

学校读者我要写书评

暂无评论

Cross-view Action Recognition understanding From Exocentric to Egocentric Perspective

arXiv

引用

arXiv 2023年

作者： Truong, Thanh-Dat Luu, Khoa Computer Vision and Image Understanding Lab University of Arkansas Fayetteville72701 United States

understanding action recognition in egocentric videos has emerged as a vital research topic with numerous practical applications. With the limitation in the scale of egocentric data collection, learning robust deep learning-based action recognition models remains difficult. Transferring knowledge learned from the large-scale exocentric data to the egocentric data is challenging due to the difference in videos across views. Our work introduces a novel cross-view learning approach to action recognition (CVAR) that effectively transfers knowledge from the exocentric to the selfish view. First, we present a novel geometric-based constraint into the self-attention mechanism in Transformer based on analyzing the camera positions between two views. Then, we propose a new cross-view self-attention loss learned on unpaired cross-view data to enforce the self-attention mechanism learning to transfer knowledge across views. Finally, to further improve the performance of our cross-view learning approach, we present the metrics to measure the correlations in videos and attention maps effectively. Experimental results on standard egocentric action recognition benchmarks, i.e., Charades-Ego, EPIC-Kitchens-55, and EPIC-Kitchens-100, have shown our approach’s effectiveness and state-of-the-art performance. Copyright © 2023, The Authors. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

image saliency detection method based on multi-feature maps fusion 4

Image saliency detection method based on multi-feature maps ...

引用

4th International Conference on computer Graphics, image, and Virtualization, ICCGIV 2024

作者： Li, Xiaoli Liu, Yunpeng Zhao, Huaici Shenyang Institute of Automation Chinese Academy of Sciences Shenyang China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Shenyang China University of Chinese Academy of Sciences Beijing China Key Laboratory of Opto-Electronic Information Processing Shenyang China The Key Lab of Image Understanding and Computer Vision Shenyang China Shenyang Jianzhu University Shenyang China

ISBN: (纸本)9781510683242

In this research, we introduce an innovative saliency detection algorithm, comprising three essential steps. Firstly, leveraging fully convolutional networks with aggregation interaction modules, we generate an initial saliency map. Secondly, we extract hand-craft and deep features to express the image, then use manifold ranking method to construct saliency maps. Ultimately, by integrating the outcomes from preceding stages, we generate the final saliency map. Experimental findings demonstrate that our method surpasses twelve cutting-edge saliency detection techniques in terms of precision, recall, F-measure, and MAE value metrics." © 2024 SPIE.

关键词： Feature extraction

来源：评论

学校读者我要写书评

暂无评论

Uncertainty Quantification in Medical image Segmentation 6

Uncertainty Quantification in Medical Image Segmentation

引用

6th IEEE International Conference on computer and Communications, ICCC 2020

作者： Li, Haixing Luo, Haibo The Key Lab of Image Understanding and Computer Vision Shenyang City Liaoning Province China

ISBN: (纸本)9781728186351

In medical images, the observer's manual description of different structures is very different, and it spans a wide range of various structures and pathologies. This variability (which is a characteristic of biological issues, imaging modality and expert annotators) has not been fully considered in the design of computer algorithms for medical image quantification. So far, few people predict the uncertainty of medical image segmentation. In this paper, we designed a V-shaped network to quantify the uncertainty in prostate MRI image segmentation. We have embedded a feature pyramid attention module in the backbone network, which can extract high-level semantic context information at different scales and provide a pixel-level attention to the decoder. At the same time, the module will not bring a large computational burden. In our experiments, we tested the performance of the proposed method on 55 clinical subjects. © 2020 IEEE.

关键词： Magnetic resonance imaging

来源：评论

学校读者我要写书评

暂无评论

Fast Candidate Region Extraction for SAR Ship Target 37

Fast Candidate Region Extraction for SAR Ship Target

引用

37th Youth Academic Annual Conference of Chinese Association of Automation, YAC 2022

作者： Zhang, Panpan Luo, Haibo Xu, Zheng He, Miao Shenyang Institute of Automation Shenyang110016 China Institutes for Robotics and Intelligent Manufacturing Shenyang110016 China University of Chinese Academy of Sciences Beijing100049 China Key Laboratory of Opto-Electronic Information Processing Shenyang110016 China The Key Lab of Image Understanding and Computer Vision Shenyang110016 China

ISBN: (纸本)9781665465366

At present, deep learning technology is widely used in ship target detection in synthetic aperture radar (SAR) images. However, high-resolution remote sensing SAR images cover a larger area and have larger image sizes. To be able to use the deep learning model for training and testing, the image needs to be cropped to the appropriate size. In a high-resolution SAR ship image, the ship target usually takes only a small part of the whole image. As a result, only part of the cropped image contains the target, and most of the rest are background regions. This will cause a lot of computational redundancy in the model inference stage. To solve this problem, a fast candidate region extraction algorithm is proposed in this paper for ship target extraction. The algorithm consists of three parts: firstly, extract the saliency map of the SAR ship image, secondly, perform median filtering on the segmented image, and thirdly, extract candidate regions. The superiority of the algorithm was demonstrated by experiments on the AIR-SARShip-1.0 dataset. © 2022 IEEE.

关键词： Synthetic aperture radar

来源：评论

学校读者我要写书评

暂无评论

Vec2Face-v2: Unveil Human Faces from their Blackbox Features via Attention-based Network in Face Recognition

arXiv

引用

arXiv 2022年

作者： Truong, Thanh-Dat Duong, Chi Nhan Le, Ngan Savvides, Marios Luu, Khoa The Computer Vision and Image Understanding Lab University of Arkansas United States The Department of Computer Science and Software Engineering Concordia University Canada Carnegie Mellon University United States

In this work, we investigate the problem of face reconstruction given a facial feature representation extracted from a blackbox face recognition engine. Indeed, it is a very challenging problem in practice due to the limitations of abstracted information from the engine. We, therefore, introduce a new method named Attention-based Bijective Generative Adversarial Networks in a Distillation framework (DAB-GAN) to synthesize the faces of a subject given his/her extracted face recognition features. Given any unconstrained unseen facial features of a subject, the DAB-GAN can reconstruct his/her facial images in high definition. The DAB-GAN method includes a novel attention-based generative structure with the newly defined Bijective Metrics Learning approach. The framework starts by introducing a bijective metric so that the distance measurement and metric learning process can be directly adopted in the image domain for an image reconstruction task. The information from the blackbox face recognition engine will be optimally exploited using the global distillation process. Then an attention-based generator is presented for a highly robust generator to synthesize realistic faces with ID preservation. We have evaluated our method on the challenging face recognition databases, i.e., CelebA, LFW, CFP-FP, CP-LFW, AgeDB, CA-LFW, and consistently achieved state-of-the-art results. The advancement of DAB-GAN is also proven in both image realism and ID preservation properties. Copyright © 2022, The Authors. All rights reserved.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

Lens-to-Lens Bokeh Effect Transformation. NTIRE 2023 Challenge Report

Lens-to-Lens Bokeh Effect Transformation. NTIRE 2023 Challen...

引用

2023 IEEE/CVF Conference on computer vision and Pattern Recognition Workshops, CVPRW 2023

作者： Conde, Marcos V. Kolmet, Manuel Seizinger, Tim Bishop, Tom E. Timofte, Radu Kong, Xiangyu Zhang, Dafeng Wu, Jinlong Wang, Fan Peng, Juewen Pan, Zhiyu Liu, Chengxin Luo, Xianrui Sun, Huiqiang Shen, Liao Cao, Zhiguo Xian, Ke Liu, Chaowei Chen, Zigeng Yang, Xingyi Liu, Songhua Jing, Yongcheng Mi, Michael Bi Wang, Xinchao Yang, Zhihao Lian, Wenyi Lai, Siyuan Zhang, Haichuan Hoang, Trung Yazdani, Amirsaeed Monga, Vishal Luo, Ziwei Gustafsson, Fredrik K. Zhao, Zheng Sjölund, Jens Schön, Thomas B. Zhao, Yuxuan Chen, Baoliang Xu, Yiqing Niu, Jixiang Computer Vision Lab CAIDAS IFI University of Würzburg Germany Glass Imaging Inc. China Huazhong University of Science and Technology China Nanyang Technological University Singapore National University of Singapore Singapore University of Sydney Australia Huawei Uppsala University Sweden Department of Electrical Engineering Pennsylvania State University United States Department of Information Technology Uppsala University Sweden Key Laboratory of Intelligent Perception and Image Understanding of the Ministry of Education Xidian University Xi'an China North China University of Technology China

ISBN: (纸本)9798350302493

We present the new Bokeh Effect Transformation Dataset (BETD), and review the proposed solutions for this novel task at the NTIRE 2023 Bokeh Effect Transformation Challenge. Recent advancements of mobile photography aim to reach the visual quality of full-frame cameras. Now, a goal in computational photography is to optimize the Bokeh effect itself, which is the aesthetic quality of the blur in out-of-focus areas of an image. Photographers create this aesthetic effect by benefiting from the lens optical *** aim of this work is to design a neural network capable of converting the the Bokeh effect of one lens to the effect of another lens without harming the sharp foreground regions in the image. For a given input image, knowing the target lens type, we render or transform the Bokeh effect accordingly to the lens properties. We build the BETD using two full-frame Sony cameras, and diverse lens *** the best of our knowledge, we are the first attempt to solve this novel task, and we provide the first BETD dataset and benchmark for it. The challenge had 99 registered participants. The submitted methods gauge the state-of-the-art in Bokeh effect rendering and transformation. © 2023 IEEE.

关键词： Color photography

来源：评论

学校读者我要写书评

暂无评论

Fast Candidate Region Extraction for SAR Ship Target

Fast Candidate Region Extraction for SAR Ship Target

引用

Youth Academic Annual Conference of Chinese Association of Automation (YAC)

作者： Panpan Zhang Haibo Luo Zheng Xu Miao He Shenyang Institute of Automation Shenyang China Institutes for Robotics and Intelligent Manufacturing Shenyang China University of Chinese Academy of Sciences Beijing China Key Laboratory of Opto-Electronic Information Processing Shenyang China The Key Lab of Image Understanding and Computer Vision Shenyang China

ISBN: (纸本)9781665465373

关键词： Deep learning Training Redundancy Radar polarimetry Inference algorithms Indexes Marine vehicles

来源：评论

学校读者我要写书评

暂无评论

Terahertz compressive imaging: understanding and improvement by a better strategy for data selection

Terahertz compressive imaging: understanding and improvement...

引用

作者： Xing, Chungui Qi, Feng Liu, Zhaoyang Wang, Yelong Guo, Shuxu State Key Laboratory on Integrated Optoelectronics College of Electronic Science and Engineering Jilin University Changchun China Shenyang Institute of Automation Chinese Academy of Sciences Shenyang China Key Laboratory of Opto-Electronic Information Processing Chinese Academy of Sciences Shenyang China Key Lab of Image Understanding and Computer Vision Shenyang China

Compressive sensing (CS) is a novel sampling modality, which indicates the signals can be sampled at a rate much below the Nyquist sampling rate. CS has increasing interest recently due to high demand of rapid, efficient, and in-expensive signal processing applications in the μmWave and mmWave frequencies, such as communication and imaging. There have been a lot of theoretical studies on this topic, but there is a lack of systematic experimental analysis of the implementation method itself. In this paper, we have investigated the influencing factors of terahertz compressive sensing based on experimental results, including illumination and the size of the pixel. Besides, to differentiate from current approaches, which generally make full use of the data, we propose to sort the data first and select a part of them based on amplitude, which might deliver a better image by prompting the mathematical calculations compulsively. We believe that such considerations given above would help to make a better system design and improve the performance of compressive imaging, and these results will also be helpful in the application of terahertz communication. © 2021 John Wiley & Sons, Ltd

关键词： Compressed sensing

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：