检索结果-内蒙古大学图书馆

arXiv 2021年

作者： Zhou, Ling Mao, Qirong Huang, Xiaohua Zhang, Feifei Zhang, Zhihong School of Computer Science and Communication Engineering Jiangsu University ZhenjiangJiangsu212013 China School of Computer Engineering Nanjing Institute of Technology China National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing100190 China Xiamen University Xiamen China Center for Machine Vision and Signal Analysis University of Oulu Finland

Micro-Expression recognition has become challenging, as it is extremely difficult to extract the subtle facial changes of micro-expressions. Recently, several approaches proposed several expression-shared features algorithms for micro-expression recognition. However, they do not reveal the specific discriminative characteristics, which lead to sub-optimal performance. This paper proposes a novel Feature Refinement (FR) with expression-specific feature learning and fusion for micro-expression recognition. It aims to obtain salient and discriminative features for specific expressions and also predict expression by fusing the expression-specific features. FR consists of an expression proposal module with attention mechanism and a classification branch. First, an inception module is designed based on optical flow to obtain expression-shared features. Second, in order to extract salient and discriminative features for specific expression, expression-shared features are fed into an expression proposal module with attention factors and proposal loss. Last, in the classification branch, labels of categories are predicted by a fusion of the expression-specific features. Experiments on three publicly available databases validate the effectiveness of FR under different protocol. Results on public benchmarks demonstrate that our FR provides salient and discriminative information for micro-expression recognition. The results also show our FR achieves better or competitive performance with the existing state-of-the-art methods on micro-expression recognition. Copyright © 2021, The Authors. All rights reserved.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

PIPAL: A Large-Scale Image Quality Assessment Dataset for Perceptual Image Restoration 16th

PIPAL: A Large-Scale Image Quality Assessment Dataset for Pe...

引用

16th European Conference on computer vision, ECCV 2020

作者： Jinjin, Gu Haoming, Cai Haoyu, Chen Xiaoxing, Ye Ren, Jimmy S. Chao, Dong The School of Data Science The Chinese University of Hong Kong Shenzhen China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Shenzhen China SenseTime Research Science Park Hong Kong SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen China

ISBN: (纸本)9783030586201

Image quality assessment (IQA) is the key factor for the fast development of image restoration (IR) algorithms. The most recent IR methods based on Generative Adversarial Networks (GANs) have achieved significant improvement in visual performance, but also presented great challenges for quantitative evaluation. Notably, we observe an increasing inconsistency between perceptual quality and the evaluation results. Then we raise two questions: (1) Can existing IQA methods objectively evaluate recent IR algorithms? (2) When focus on beating current benchmarks, are we getting better IR algorithms? To answer these questions and promote the development of IQA methods, we contribute a large-scale IQA dataset, called Perceptual Image Processing Algorithms (PIPAL) dataset. Especially, this dataset includes the results of GAN-based methods, which are missing in previous datasets. We collect more than 1.13 million human judgments to assign subjective scores for PIPAL images using the more reliable "Elo system". Based on PIPAL, we present new benchmarks for both IQA and super-resolution methods. Our results indicate that existing IQA methods cannot fairly evaluate GAN-based IR algorithms. While using appropriate evaluation methods is important, IQA methods should also be updated along with the development of IR algorithms. At last, we improve the performance of IQA networks on GAN-based distortions by introducing anti-aliasing pooling. Experiments show the effectiveness of the proposed method. © 2020, Springer Nature Switzerland AG.

关键词： Generative adversarial networks

来源：评论

学校读者我要写书评

暂无评论

LEDNet: Deep Network for Single Image Haze Removal 2018

LEDNet: Deep Network for Single Image Haze Removal

引用

Proceedings of the 11th Indian Conference on computer vision, Graphics and Image Processing

作者： Akshay Dudhane Subrahmanyam Murala Abhinav Dhall Computer Vision and Pattern Recognition Lab Indian Institute of Technology Ropar India Learning Affect and Semantic Image Analysis Group Indian Institute of Technology Ropar India

ISBN: (纸本)9781450366151

Haze during the bad weather, degrades the visibility of the scene drastically. Degradation of scene visibility varies with respect to the transmission coefficient/map (Tc) of the scene. Estimation of accurate Tc is key step to reconstruct the haze free scene. Previously, local as well as global priors were proposed to estimate the Tc. We, on the other hand, propose integration of local and global approaches to learn both point level and object level Tc. The proposed local encoder decoder network (LEDNet) estimates the scene transmission map in two stages. During first stage, network estimates the point level Tc using parallel convolutional filters and spatial invariance filtering. The second stage comprises of a two level encoder-decoder architecture which anticipates the object level Tc. We also propose, local air-light estimation (LAE) algorithm, which is able to obtain the air-light component of the outdoor scene. Combination of LEDNet and LAE improves the accuracy of haze model to recover the scene radiance. Structural similarity index, mean square error and peak signal to noise ratio are used to evaluate the performance of the proposed approach for single image haze removal. Experiments on benchmark datasets show that LEDNet outperforms the existing state-of-the-art methods for single image haze removal.

关键词： Haze removal transmission map CNN

来源：评论

学校读者我要写书评

暂无评论

SynFacePAD 2023: Competition on Face Presentation Attack Detection Based on Privacy-aware Synthetic Training Data

SynFacePAD 2023: Competition on Face Presentation Attack Det...

引用

IEEE International Joint Conference on Biometrics (IJCB)

作者： Meiling Fang Marco Huber Julian Fierrez Raghavendra Ramachandra Naser Damer Alhasan Alkhaddour Maksim Kasantcev Vasiliy Pryadchenko Ziyuan Yang Huijie Huangfu Yingyu Chen Yi Zhang Yuchen Pan Junjun Jiang Xianming Liu Xianyun Sun Caiyong Wang Xingyu Liu Zhaohua Chang Guangzhe Zhao Juan Tapia Lazaro Gonzalez-Soler Carlos Aravena Daniel Schulz Fraunhofer Institute for Computer Graphics Research IGD Darmstadt Germany Department of Computer Science TU Darmstadt Darmstadt Germany Biometrics and Data Pattern Analytics Lab Universidad Autonoma de Madrid Spain Norwegian University of Science and Technology (NTNU) Norway ID R&D Inc New York US School of Cyber Science and Engineering Sichuan University Chengdu China School of Computer Science and Technology Harbin Institute of Technology Harbin China School of Electrical and Information Engineering Beijing University of Civil Engineering and Architecture China Biometrics and Security Research Group Hochschule Darmstadt Darmstadt Germany I+D Vision Center Santiago Chile

This paper presents a summary of the Competition on Face Presentation Attack Detection Based on Privacy-aware Synthetic Training Data (SynFacePAD 2023) held at the 2023 International Joint Conference on Biometrics (IJCB 2023). The competition attracted a total of 8 participating teams with valid submissions from academia and industry. The competition aimed to motivate and attract solutions that target detecting face presentation attacks while considering synthetic-based training data motivated by privacy, legal and ethical concerns associated with personal data. To achieve that, the training data used by the participants was limited to synthetic data provided by the organizers. The submitted solutions presented innovations and novel approaches that led to outperforming the considered baseline in the investigated benchmarks.

关键词：

来源：评论

学校读者我要写书评

暂无评论

68 landmarks are efficient for 3D face alignment: What about more? 3D face alignment method applied to face recognition

TechRxiv

引用

TechRxiv 2021年

作者： Jabberi, Marwa Wali, Ali Chaudhuri, Bidyut Baran Alimi, Adel M. University of Sousse ISITCom Sousse4011 Tunisia BP 1173 Sfax3038 Tunisia Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata700108 India Department of Electrical and Electronic Engineering Science Faculty of Engineering and the Built Environment University of Johannesburg South Africa

This paper proposes a 3D face alignment of 2D face images in the wild with noisy landmarks where the objective is to recognize individuals from their single profile image. We first proceed by extracting more than 68 landmarks using a bag of features. This allows us to obtain a bag of visible and invisible facial keypoints. Then, we reconstruct a 3D face model and get a triangular mesh by meshing the obtained keypoints. For each face, the number of keypoints is not the same which makes this step very challenging. Later, we process the 3D face using butterfly and BPA algorithms to make correlation and regularity between 3D face regions. Indeed, 2D-to-3D annotations give much higher quality to the 3D reconstructed face model without the need for any additional 3D Morphable models. Finally, alignment and pose correction steps are carried out to get frontal pose by fitting the rendered 3D reconstructed face to 2D face and performing pose normalization to achieve good rates in face recognition. The recognition step is based on deep learning and it is performed using DCNNs, which are very powerful and modern, for feature learning and face identification. To verify the proposed method, two popular benchmarks, YTF and LFW databases, are tested. Compared to the best recognition results reported on these two benchmarks, our proposed method achieves comparable or even better recognition performances. © 2021, CC BY.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

Self-slimmed vision Transformer

arXiv

引用

arXiv 2021年

作者： Zong, Zhuofan Li, Kunchang Song, Guanglu Wang, Yali Qiao, Yu Leng, Biao Liu, Yu School of Computer Science and Engineering Beihang University China SenseTime Research China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society China Shanghai AI Laboratory China

vision transformers (ViTs) have become the popular structures and outperformed convolutional neural networks (CNNs) on various vision tasks. However, such powerful transformers bring a huge computation burden, because of the exhausting token-to-token comparison. The previous works focus on dropping insignificant tokens to reduce the computational cost of ViTs. But when the dropping ratio increases, this hard manner will inevitably discard the vital tokens, which limits its efficiency. To solve the issue, we propose a generic self-slimmed learning approach for vanilla ViTs, namely SiT. Specifically, we first design a novel Token Slimming Module (TSM), which can boost the inference efficiency of ViTs by dynamic token aggregation. As a general method of token hard dropping, our TSM softly integrates redundant tokens into fewer informative ones. It can dynamically zoom visual attention without cutting off discriminative token relations in the images, even with a high slimming ratio. Furthermore, we introduce a concise Feature Recalibration Distillation (FRD) framework, wherein we design a reverse version of TSM (RTSM) to recalibrate the unstructured token in a flexible auto-encoder manner. Due to the similar structure between teacher and student, our FRD can effectively leverage structure knowledge for better convergence. Finally, we conduct extensive experiments to evaluate our SiT. It demonstrates that our method can speed up ViTs by 1.7× with negligible accuracy drop, and even speed up ViTs by 3.6× while maintaining 97% of their performance. Surprisingly, by simply arming LV-ViT with our SiT, we achieve new state-of-the-art performance on ImageNet. Code is available at https://***/Sense-X/SiT. © 2021, CC BY.

关键词： Distillation

来源：评论

学校读者我要写书评

暂无评论

Investigate indistinguishable points in semantic segmentation of 3D point cloud

arXiv

引用

arXiv 2021年

作者： Xu, Mingye Zhou, Zhipeng Zhang, Junhao Qiao, Yu ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences University of Chinese Academy of Sciences China Shanghai AI Lab Shanghai China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society

This paper investigates the indistinguishable points (difficult to predict label) in semantic segmentation for large-scale 3D point clouds. The indistinguishable points consist of those located in complex boundary, points with similar local textures but different categories, and points in isolate small hard areas, which largely harm the performance of 3D semantic segmentation. To address this challenge, we propose a novel Indistinguishable Area Focalization Network (IAF-Net), which selects indistinguishable points adaptively by utilizing the hierarchical semantic features and enhance fine-grained features for points especially those indistinguishable points. We also introduce multi-stage loss to improve the feature representation in a progressive way. Moreover, in order to analyze the segmentation performances of indistinguishable areas, we propose a new evaluation metric called Indistinguishable Points Based Metric (IPBM). Our IAF-Net achieves the comparable results with state-of-the-art performance on several popular 3D point cloud datasets e.g. S3DIS and ScanNet, and clearly outperforms other methods on IPBM. Our code will be available at https://***/MingyeXu/IAF-Net. Copyright © 2021, The Authors. All rights reserved.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Landmark-RxR: solving vision-and-language navigation with fine-grained alignment supervision 21

Landmark-RxR: solving vision-and-language navigation with fi...

引用

Proceedings of the 35th International Conference on Neural Information Processing Systems

作者： Keji He Yan Huang Qi Wu Jianhua Yang Dong An Shuanglin Sima Liang Wang Center for Research on Intelligent Perception and Computing National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences and School of Artificial Intelligence University of Chinese Academy of Sciences School of Computer Science University of Adelaide School of Artificial Intelligence Beijing University of Posts and Telecommunications Center for Research on Intelligent Perception and Computing National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences and School of Future Technology University of Chinese Academy of Sciences Center for Research on Intelligent Perception and Computing National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences and School of Artificial Intelligence University of Chinese Academy of Sciences and Center for Excellence in Brain Science and Intelligence Technology (CEBSIT) and Chinese Academy of Sciences Artificial Intelligence Research (CAS-AIR)

ISBN: (纸本)9781713845393

In vision-and-Language Navigation (VLN) task, an agent is asked to navigate inside 3D indoor environments following given instructions. Cross-modal alignment is one of the most critical challenges in VLN because the predicted trajectory needs to match the given instruction accurately. In this paper, we address the cross-modal alignment challenge from the perspective of fine-grain. Firstly, to alleviate weak cross-modal alignment supervision from coarse-grained data, we introduce a human-annotated fine-grained VLN dataset, namely Landmark-RxR. Secondly, to further enhance local cross-modal alignment under fine-grained supervision, we investigate the focal-oriented rewards with soft and hard forms, by focusing on the critical points sampled from fine-grained Landmark-RxR. Moreover, to fully evaluate the navigation process, we also propose a re-initialization mechanism that makes metrics insensitive to difficult points, which can cause the agent to deviate from the correct trajectories. Experimental results show that our agent has superior navigation performance on Landmark-RxR, en-RxR and R2R.

关键词：

来源：评论

学校读者我要写书评

暂无评论

MSRF-Net: A Multi-Scale Residual Fusion Network for Biomedical Image Segmentation

arXiv

引用

arXiv 2021年

作者： Srivastava, Abhishek Jha, Debesh Chanda, Sukalpa Pal, Umapada Johansen, Håvard D. Johansen, Dag Riegler, Michael A. Ali, Sharib Halvorsen, Pål Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata India SimulaMet Oslo Norway UiT The Arctic University of Norway Tromsø Norway Østfold University College Halden Norway Indian Statistical Institute Kolkata India The Department of Engineering Science University of Oxford Oxford NIHR Biomedical Research Centre Oxford United Kingdom Oslo Metropolitan University Oslo Norway

Methods based on convolutional neural networks have improved the performance of biomedical image segmentation However, most of these methods cannot efficiently segment objects of variable sizes and train on small and biased datasets, which are common for biomedical use cases While methods exist that incorporate multi-scale fusion approaches to address the challenges arising with variable sizes, they usually use complex models that are more suitable for general semantic segmentation problems In this paper, we propose a novel architecture called Multi-Scale Residual Fusion Network (MSRF-Net), which is specially designed for medical image segmentation The proposed MSRF-Net is able to exchange multi-scale features of varying receptive fields using a Dual-Scale Dense Fusion (DSDF) block Our DSDF block can exchange information rigorously across two different resolution scales, and our MSRF sub-network uses multiple DSDF blocks in sequence to perform multi-scale fusion This allows the preservation of resolution, improved information flow and propagation of both high-and low-level features to obtain accurate segmentation maps The proposed MSRF-Net allows to capture object variabilities and provides improved results on different biomedical datasets Extensive experiments on MSRF-Net demonstrate that the proposed method outperforms the cutting-edge medical image segmentation methods on four publicly available datasets We achieve the Dice Coefficient (DSC) of 0.9217, 0.9420, and 0.9224, 0.8824 on Kvasir-SEG, CVC-ClinicDB, 2018 Data Science Bowl dataset, and ISIC-2018 skin lesion segmentation challenge dataset respectively We further conducted generalizability tests and achieved DSC of 0.7921 and 0.7575 on CVC-ClinicDB and Kvasir-SEG, respectively. © 2021, CC BY.

关键词： Image enhancement

来源：评论

学校读者我要写书评

暂无评论

Structure Function Based Transform Features for Behavior-Oriented Social Media Image Classification 5th

Structure Function Based Transform Features for Behavior-Ori...

引用

5th Asian Conference on pattern recognition, ACPR 2019

作者： Krishnani, Divya Shivakumara, Palaiahnakote Lu, Tong Pal, Umapada Ramachandra, Raghavendra International Institute of Information Technology Naya Raipur Naya RaipurChhattisgarh India Faculty of Computer Science and Information Technology University of Malaya Kuala Lumpur Malaysia National Key Lab for Novel Software Technology Nanjing University Nanjing China Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata India Faculty of Information Technology and Electrical Engineering Norwegian University of Science and Technology Trondheim Norway

ISBN: (纸本)9783030414030

Social media has become an essential part of people to reflect their day to day activities including emotions, feelings, threatening and so on. This paper presents a new method for the automatic classification of behavior-oriented images like Bullying, Threatening, Neuroticism-Depression, Neuroticism-Sarcastic, Psychopath and Extraversion of a person from social media images. The proposed method first finds facial key points for extracting features based on a face detection algorithm. Then the proposed method labels face regions as foreground and other than face region as background to define context between foreground and background information. To extract context, the proposed method explores Structural Function based Transform (SFBT) features, which study variations on pixel values. To increase discriminating power of the context features, the proposed method performs clustering to integrate the strength of the features. The extracted features are then fed to Support Vector Machines (SVM) for classification. Experimental results on a dataset of six classes show that the proposed method outperforms the existing methods in terms of confusion matrix and classification rate. © Springer Nature Switzerland AG 2020.

关键词： Classification (of information)

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：