检索结果-内蒙古大学图书馆

Static human behavior classification based on LLC features and GIST features 7

学校读者我要写书评

暂无评论

Static human behavior classification based on LLC features a...

7th IEEE Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems, CYBER 2017

作者： Ende, Wang Xukui, Hou Xuepeng, Li Shenyang Institute of Automation Chinese Academic of Sciences Key Lab of Image Understanding and Computer Vision Key Laboratory of Optical Electrical Image Processing Shenhe District Shenyang Liaoning China

ISBN: (纸本)9781538604892

This paper presents a method for recognizing human behavior in static images based on LLC and GIST features. The feature points in the image is densely located in sub-region of images and we extract SIFT feature from each sub-region. Then using the LLC method to encode the extracted dense SIFT features of each sub-region and each feature point descriptor is assigned to several nearest words, so that each descriptor can be expressed by the linear correlation coefficient of vocabulary. In order to increase the spatial information, we use the SPM model to divide the image into many blocks under different levels. We can get the pooled feature from each sub-region using the max pooling method. Then these pooled features from sub-region are concatenated and normalized as the final pooled features. In order to get GIST features, we divide the image into blocks and construct the Gabor filter group of 32 different scales and directions. Then each Gabor filter in the Gabor filter group does convolution operation with image blocks and we take the mean value of each blocks under each Gabor filter as the feature description. The features from each block under each Gabor filter are concatenated and normalized as the final GIST feature representation of the image. Then concatenating the final pooled features and the GIST features and take as the final feature representation. Finally, the intersection kernel function of SVM is used for classification. We performed experiments on several databases. By contrast, this algorithm has a good effect in accuracy and efficiency. © 2017 IEEE.

关键词： Gabor filters

End-to-end, single-stream temporal action detection in untrimmed videos 28

学校读者我要写书评

暂无评论

End-to-end, single-stream temporal action detection in untri...

28th British Machine vision Conference, BMVC 2017

作者： Buch, Shyamal Escorcia, Victor Ghanem, Bernard Fei-Fei, Li Niebles, Juan Carlos Stanford Vision and Learning Lab. Dept. of Computer Science Stanford University United States Image and Video Understanding Lab. Visual Computing Center KAUST Saudi Arabia

ISBN: (纸本)190172560X

In this work, we present a new intuitive, end-to-end approach for temporal action detection in untrimmed videos. We introduce our new architecture for Single-Stream Temporal Action Detection (SS-TAD), which effectively integrates joint action detection with its semantic sub-tasks in a single unifying end-to-end framework. We develop a method for training our deep recurrent architecture based on enforcing semantic constraints on intermediate modules that are gradually relaxed as learning progresses. We find that such a dynamic learning scheme enables SS-TAD to achieve higher overall detection performance, with fewer training epochs. By design, our single-pass network is very efficient and can operate at 701 frames per second, while simultaneously outperforming the state-of-the-art methods for temporal action detection on THUMOS’14. © 2017. The copyright of this document resides with its authors.

关键词： Semantics

Uncertainty Quantification in Medical image Segmentation

学校读者我要写书评

暂无评论

Uncertainty Quantification in Medical Image Segmentation

International Conference on computer and Communications (ICCC)

作者： Haixing Li Haibo Luo The Key Lab of Image Understanding and Computer Vision Shenyang City Liaoning Province China

ISBN: (数字)9781728186351

ISBN: (纸本)9781728186368

关键词： image segmentation Uncertainty Magnetic resonance imaging Semantics Feature extraction Prediction algorithms Biomedical imaging

Cross-view Action Recognition understanding From Exocentric to Egocentric Perspective

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Truong, Thanh-Dat Luu, Khoa Computer Vision and Image Understanding Lab University of Arkansas Fayetteville72701 United States

understanding action recognition in egocentric videos has emerged as a vital research topic with numerous practical applications. With the limitation in the scale of egocentric data collection, learning robust deep learning-based action recognition models remains difficult. Transferring knowledge learned from the large-scale exocentric data to the egocentric data is challenging due to the difference in videos across views. Our work introduces a novel cross-view learning approach to action recognition (CVAR) that effectively transfers knowledge from the exocentric to the selfish view. First, we present a novel geometric-based constraint into the self-attention mechanism in Transformer based on analyzing the camera positions between two views. Then, we propose a new cross-view self-attention loss learned on unpaired cross-view data to enforce the self-attention mechanism learning to transfer knowledge across views. Finally, to further improve the performance of our cross-view learning approach, we present the metrics to measure the correlations in videos and attention maps effectively. Experimental results on standard egocentric action recognition benchmarks, i.e., Charades-Ego, EPIC-Kitchens-55, and EPIC-Kitchens-100, have shown our approach’s effectiveness and state-of-the-art performance. Copyright © 2023, The Authors. All rights reserved.

关键词：

Cross-View Action Recognition understanding from Exocentric to Egocentric Perspective

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Truong, Thanh-Dat Luu, Khoa Computer Vision and Image Understanding Lab University of Arkansas Fayetteville72701 United States

understanding action recognition in egocentric videos has emerged as a vital research topic with numerous practical applications. With the limitation in the scale of egocentric data collection, learning robust deep learning-based action recognition models remains difficult. Transferring knowledge learned from the large-scale exocentric data to the egocentric data is challenging due to the difference in videos across views. Our work introduces a novel cross-view learning approach to action recognition (CVAR) that effectively transfers knowledge from the exocentric to the selfish view. First, we present a novel geometric-based constraint into the self-attention mechanism in Transformer based on analyzing the camera positions between two views. Then, we propose a new cross-view self-attention loss learned on unpaired cross-view data to enforce the self-attention mechanism learning to transfer knowledge across views. Finally, to further improve the performance of our cross-view learning approach, we present the metrics to measure the correlations in videos and attention maps effectively. Experimental results on standard egocentric action recognition benchmarks, i.e., Charades-Ego, EPIC-Kitchens-55, and EPIC-Kitchens-100, have shown our approach's effectiveness and state-of-the-art performance. © 2024, The Authors. All rights reserved.

关键词： Deep learning

Multi-view Action Recognition via Directed Gromov-Wasserstein Discrepancy

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Nguyen, Hoang-Quan Truong, Thanh-Dat Luu, Khoa Computer Vision and Image Understanding Lab University of Arkansas FayettevilleAR72701 United States

Action recognition has become one of the popular research topics in computer vision. There are various methods based on Convolutional Networks and self-attention mechanisms as Transformers to solve both spatial and temporal dimensions problems of action recognition tasks that achieve competitive performances. However, these methods lack a guarantee of the correctness of the action subject that the models give attention to, i.e., how to ensure an action recognition model focuses on the proper action subject to make a reasonable action prediction. In this paper, we propose a multi-view attention consistency method that computes the similarity between two attentions from two different views of the action videos using Directed Gromov-Wasserstein Discrepancy. Furthermore, our approach applies the idea of Neural Radiance Field to implicitly render the features from novel views when training on single-view datasets. Therefore, the contributions in this work are three-fold. Firstly, we introduce the multi-view attention consistency to solve the problem of reasonable prediction in action recognition. Secondly, we define a new metric for multi-view consistent attention using Directed Gromov-Wasserstein Discrepancy. Thirdly, we built an action recognition model based on Video Transformers and Neural Radiance Fields. Compared to the recent action recognition methods, the proposed approach achieves state-of-the-art results on three large-scale datasets, i.e., Jester, Something-Something V2, and Kinetics-400. © 2024, CC BY.

关键词： Large datasets

image processing in quantum computers

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Dendukuri, Aditya Luu, Khoa Computer Vision and Image Understanding Lab Computer Science and Computer Engineering Department University of Arkansas FayettevilleAR72701 United States

Quantum image Processing (QIP) is an exciting new field showing a lot of promise as a powerful addition to the arsenal of image Processing techniques. Representing image pixel by pixel using classical information requires enormous amount of computational resources. Hence, exploring methods to represent images in a different paradigm of information is important. In this work, we study the representation of images in Quantum Information. The main motivation for this pursuit is the ability of storing N bits of classical information in only log2N quantum bits (qubits). The promising first step was the exponentially efficient implementation of the Fourier transform in quantum computers as compared to Fast Fourier Transform in classical computers. In addition, images encoded in quantum information could obey unique quantum properties like superposition or entanglement. Copyright © 2018, The Authors. All rights reserved.

关键词： Qubits

Fast Candidate Region Extraction for SAR Ship Target 37

学校读者我要写书评

暂无评论

Fast Candidate Region Extraction for SAR Ship Target

37th Youth Academic Annual Conference of Chinese Association of Automation, YAC 2022

作者： Zhang, Panpan Luo, Haibo Xu, Zheng He, Miao Shenyang Institute of Automation Shenyang110016 China Institutes for Robotics and Intelligent Manufacturing Shenyang110016 China University of Chinese Academy of Sciences Beijing100049 China Key Laboratory of Opto-Electronic Information Processing Shenyang110016 China The Key Lab of Image Understanding and Computer Vision Shenyang110016 China

ISBN: (纸本)9781665465366

At present, deep learning technology is widely used in ship target detection in synthetic aperture radar (SAR) images. However, high-resolution remote sensing SAR images cover a larger area and have larger image sizes. To be able to use the deep learning model for training and testing, the image needs to be cropped to the appropriate size. In a high-resolution SAR ship image, the ship target usually takes only a small part of the whole image. As a result, only part of the cropped image contains the target, and most of the rest are background regions. This will cause a lot of computational redundancy in the model inference stage. To solve this problem, a fast candidate region extraction algorithm is proposed in this paper for ship target extraction. The algorithm consists of three parts: firstly, extract the saliency map of the SAR ship image, secondly, perform median filtering on the segmented image, and thirdly, extract candidate regions. The superiority of the algorithm was demonstrated by experiments on the AIR-SARShip-1.0 dataset. © 2022 IEEE.

关键词： Synthetic aperture radar

Vec2Face-v2: Unveil Human Faces from their Blackbox Features via Attention-based Network in Face Recognition

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Truong, Thanh-Dat Duong, Chi Nhan Le, Ngan Savvides, Marios Luu, Khoa The Computer Vision and Image Understanding Lab University of Arkansas United States The Department of Computer Science and Software Engineering Concordia University Canada Carnegie Mellon University United States

In this work, we investigate the problem of face reconstruction given a facial feature representation extracted from a blackbox face recognition engine. Indeed, it is a very challenging problem in practice due to the limitations of abstracted information from the engine. We, therefore, introduce a new method named Attention-based Bijective Generative Adversarial Networks in a Distillation framework (DAB-GAN) to synthesize the faces of a subject given his/her extracted face recognition features. Given any unconstrained unseen facial features of a subject, the DAB-GAN can reconstruct his/her facial images in high definition. The DAB-GAN method includes a novel attention-based generative structure with the newly defined Bijective Metrics Learning approach. The framework starts by introducing a bijective metric so that the distance measurement and metric learning process can be directly adopted in the image domain for an image reconstruction task. The information from the blackbox face recognition engine will be optimally exploited using the global distillation process. Then an attention-based generator is presented for a highly robust generator to synthesize realistic faces with ID preservation. We have evaluated our method on the challenging face recognition databases, i.e., CelebA, LFW, CFP-FP, CP-LFW, AgeDB, CA-LFW, and consistently achieved state-of-the-art results. The advancement of DAB-GAN is also proven in both image realism and ID preservation properties. Copyright © 2022, The Authors. All rights reserved.

关键词： Face recognition