检索结果-内蒙古大学图书馆

CASIA-SURF: A Large-Scale Multi-Modal Benchmark for Face Anti-Spoofing

学校读者我要写书评

暂无评论

IEEE Transactions on Biometrics, Behavior, and Identity Scie...

IEEE Transactions on Biometrics, Behavior, and Identity Science 2020年第2期2卷 182-193页

作者： Zhang, Shifeng Liu, Ajian Wan, Jun Liang, Yanyan Guo, Guodong Escalera, Sergio Escalante, Hugo Jair Li, Stan Z. National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing100190 China Faculty of Information Technology Macau University of Science and Technology 999078 China Baidu Research and National Engineering Laboratory for Deep Learning Technology and Application Institute of Deep Learning Beijing100085 China Óptica y Electrónica Instituto Nacional de Astrofísica Puebla08007 Mexico Computer Science Department CINVESTAV-Zacatenco Mexico City07360 Mexico University of Chinese Academy of Sciences Beijing100049 China Westlake University Hangzhou310024 China

Face anti-spoofing is essential to prevent face recognition systems from a security breach. Much of the progresses have been made by the availability of face anti-spoofing benchmark datasets in recent years. However, existing face anti-spoofing benchmarks have limited number of subjects (≤170) and modalities (≤2), which hinder the further development of the academic community. To facilitate face anti-spoofing research, we introduce a large-scale multi-modal dataset, namely CASIA-SURF, which is the largest publicly available dataset for face anti-spoofing in terms of both subjects and modalities. Specifically, it consists of 1,000 subjects with 21,000 videos and each sample has 3 modalities (i.e., RGB, Depth and IR). We also provide comprehensive evaluation metrics, diverse evaluation protocols, training/validation/testing subsets and a measurement tool, developing a new benchmark for face anti-spoofing. Moreover, we present a novel multi-modal multi-scale fusion method as a strong baseline, which performs feature re-weighting to select the more informative channel features while suppressing the less useful ones for each modality across different scales. Extensive experiments have been conducted on the proposed dataset to verify its significance and generalization capability. The dataset is available at https://***/***/face-anti-spoofing/welcome/challengecvpr2019?authuser=0. © 2019 IEEE.

关键词： Face recognition

Feature Selective Transformer for Semantic Image Segmentation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Lin, Fangjian Wu, Tianyi Wu, Sitong Tian, Shengwei Guo, Guodong Institute of Deep Learning Baidu Research Beijing China National Engineering Laboratory for Deep Learning Technology and Application Beijing China

Recently, it has attracted more and more attentions to fuse multi-scale features for semantic image segmentation. Various works were proposed to employ progressive local or global fusion, but the feature fusions are not rich enough for modeling multi-scale context features. In this work, we focus on fusing multi-scale features from Transformer-based backbones for semantic segmentation, and propose a Feature Selective Transformer (FeSeFormer), which aggregates features from all scales (or levels) for each query feature. Specifically, we first propose a Scale-level Feature Selection (SFS) module, which can choose an informative subset from the whole multi-scale feature set for each scale, where those features that are important for the current scale (or level) are selected and the redundant are discarded. Furthermore, we propose a Full-scale Feature Fusion (FFF) module, which can adaptively fuse features of all scales for queries. Based on the proposed SFS and FFF modules, we develop a Feature Selective Transformer (FeSeFormer), and evaluate our FeSeFormer on four challenging semantic segmentation benchmarks, including PASCAL Context, ADE20K, COCO-Stuff 10K, and Cityscapes, outperforming the state-of-the-art. Copyright © 2022, The Authors. All rights reserved.

关键词： Semantic Segmentation

Multi-Task Neural learning Architecture for End-to-End Identification of Helpful Reviews

学校读者我要写书评

暂无评论

Multi-Task Neural Learning Architecture for End-to-End Ident...

International Conference on Advances in Social Network Analysis and Mining, ASONAM

作者： Miao Fan Yue Feng Mingming Sun Ping Li Haifeng Wang Jianmin Wang National Engineering Laboratory of Deep Learning Technology and Application China School of Software Engineering Tsinghua University

ISBN: (纸本)9781538660522

Helpful reviews play a pivotal role in recommending desirable goods and accelerating purchase decisions of customers in e-commercial services. Given a large proportion of product reviews with unknown helpfulness/unhelpfulness, the research on automatic identification of helpful reviews has drawn much attention in recent years. However, state-of-the-art approaches still rely heavily on extracting heuristic text features from reviews with domain-specific knowledge. In this paper, we first introduce a multi-task neural learning (MTNL) architecture for identifying helpful reviews. The end-to-end neural architecture can learn to reconstruct effective features upon the raw input of words and even characters, and the multi-task learning paradigm helps to make more accurate predictions of helpful reviews based on a secondary task which fits the star ratings of reviews. We also build two datasets containing helpful/unhelpful reviews from different product categories in Amazon, and compare the performance of MTNL with several mainstream methods on both datasets. Experimental results confirm that MTNL outperforms the state-of-the-art approaches by a significant margin.

关键词： Task analysis Feature extraction Encoding Semantics Training Computer architecture

AutoShape: Real-Time Shape-Aware Monocular 3D Object Detection

学校读者我要写书评

暂无评论

AutoShape: Real-Time Shape-Aware Monocular 3D Object Detecti...

International Conference on Computer Vision (ICCV)

作者： Zongdai Liu Dingfu Zhou Feixiang Lu Jin Fang Liangjun Zhang Robotics and Autonomous Driving Laboratory Baidu Research National Engineering Laboratory of Deep Learning Technology and Application China

ISBN: (纸本)9781665428132

Existing deep learning-based approaches for monocular 3D object detection in autonomous driving often model the object as a rotated 3D cuboid while the object’s geometric shape has been ignored. In this work, we propose an approach for incorporating the shape-aware 2D/3D constraints into the 3D detection framework. Specifically, we employ the deep neural network to learn distinguished 2D keypoints in the 2D image domain and regress their corresponding 3D coordinates in the local 3D object coordinate first. Then the 2D/3D geometric constraints are built by these correspondences for each object to boost the detection performance. For generating the ground truth of 2D/3D keypoints, an automatic model-fitting approach has been proposed by fitting the deformed 3D object model and the object mask in the 2D image. The proposed framework has been verified on the public KITTI dataset and the experimental results demonstrate that by using additional geometrical constraints the detection performance has been significantly improved as compared to the baseline method. More importantly, the proposed framework achieves state-of-the-art performance with real time. Data and code will be available at https://***/zongdai/AutoShape

关键词： Deformable models deep learning Solid modeling Three-dimensional displays Shape Neural networks Pipelines

POEM: 1-bit point-wise operations based on expectation-maximization for efficient point cloud processing

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Xu, Sheng Li, Yanjing Zhao, Junhe Zhang, Baochang Guo, Guodong Beihang University Beijing China National Engineering Laboratory for Deep Learning Technology and Application Institute of Deep Learning Baidu Research Beijing China

Real-time point cloud processing is fundamental for lots of computer vision tasks, while still challenged by the computational problem on resource-limited edge devices. To address this issue, we implement XNOR-Net-based binary neural networks (BNNs) for an efficient point cloud processing, but its performance is severely suffered due to two main drawbacks, Gaussian-distributed weights and non-learnable scale factor. In this paper, we introduce point-wise operations based on Expectation-Maximization (POEM) into BNNs for efficient point cloud processing. The EM algorithm can efficiently constrain weights for a robust bi-modal distribution. We lead a well-designed reconstruction loss to calculate learnable scale factors to enhance the representation capacity of 1-bit fully-connected (Bi-FC) layers. Extensive experiments demonstrate that our POEM surpasses existing the state-of-the-art binary point cloud networks by a significant margin, up to 6.7%. © 2021, CC BY.

关键词： Maximum principle

AutoShape: Real-time shape-aware monocular 3D object detection

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Liu, Zongdai Zhou, Dingfu Lu, Feixiang Fang, Jin Zhang, Liangjun Robotics and Autonomous Driving Laboratory Baidu Research National Engineering Laboratory of Deep Learning Technology and Application China

Existing deep learning-based approaches for monocular 3D object detection in autonomous driving often model the object as a rotated 3D cuboid while the object's geometric shape has been ignored. In this work, we propose an approach for incorporating the shape-aware 2D/3D constraints into the 3D detection framework. Specifically, we employ the deep neural network to learn distinguished 2D keypoints in the 2D image domain and regress their corresponding 3D coordinates in the local 3D object coordinate first. Then the 2D/3D geometric constraints are built by these correspondences for each object to boost the detection performance. For generating the ground truth of 2D/3D keypoints, an automatic model-fitting approach has been proposed by fitting the deformed 3D object model and the object mask in the 2D image. The proposed framework has been verified on the public KITTI dataset and the experimental results demonstrate that by using additional geometrical constraints the detection performance has been significantly improved as compared to the baseline method. More importantly, the proposed framework achieves state-of-the-art performance with real time. Data and code will be available at https://***/zongdai/AutoShape. Copyright © 2021, The Authors. All rights reserved.

关键词： Object recognition

CATrans: Context and Affinity Transformer for Few-Shot Segmentation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zhang, Shan Wu, Tianyi Wu, Sitong Guo, Guodong Australian National University Canberra Australia Institute of Deep Learning Baidu Research Beijing China National Engineering Laboratory for Deep Learning Technology and Application Beijing China

Few-shot segmentation (FSS) aims to segment novel categories given scarce annotated support images. The crux of FSS is how to aggregate dense correlations between support and query images for query segmentation while being robust to the large variations in appearance and context. To this end, previous Transformer-based methods explore global consensus either on context similarity or affinity map between support-query pairs. In this work, we effectively integrate the context and affinity information via the proposed novel Context and Affinity Transformer (CATrans) in a hierarchical architecture. Specifically, the Relation-guided Context Transformer (RCT) propagates context information from support to query images conditioned on more informative support features. Based on the observation that a huge feature distinction between support and query pairs brings barriers for context knowledge transfer, the Relation-guided Affinity Transformer (RAT) measures attention-aware affinity as auxiliary information for FSS, in which the self-affinity is responsible for more reliable cross-affinity. We conduct experiments to demonstrate the effectiveness of the proposed model, outperforming the state-of-the-art methods. © 2022, CC BY.

关键词： Image segmentation

Mapfusion: A general framework for 3D object detection with HDMaps

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Fang, Jin Zhou, Dingfu Song, Xibin Zhang, Liangjun Robotics and Autonomous Driving Laboratory Baidu Research China National Engineering Laboratory of Deep Learning Technology and Application China

3D object detection is a key perception component in autonomous driving. Most recent approaches are based on Lidar sensors only or fused with cameras. Maps (e.g., High Definition Maps), a basic infrastructure for intelligent vehicles, however, have not been well exploited for boosting object detection tasks. In this paper, we propose a simple but effective framework - MapFusion to integrate the map information into modern 3D object detector pipelines. In particular, we design a FeatureAgg module for HD Map feature extraction and fusion, and a MapSeg module as an auxiliary segmentation head for the detection backbone. Our proposed MapFusion is detector independent and can be easily integrated into different detectors. The experimental results of three different baselines on large public autonomous driving dataset demonstrate the superiority of the proposed framework. By fusing the map information, we can achieve 1.27 to 2.79 points improvements for mean Average Precision (mAP) on three strong 3d object detection baselines. © 2021, CC BY-NC-ND.

关键词： Object recognition

Large scale autonomous driving scenarios clustering with self-supervised feature extraction

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhao, Jinxin Fang, Jin Ye, Zhixian Zhang, Liangjun Baidu Research and National Engineering Laboratory of Deep Learning Technology and Application China Baidu Research United States

The clustering of autonomous driving scenario data can substantially benefit the autonomous driving validation and simulation systems by improving the simulation tests' completeness and fidelity. This article proposes a comprehensive data clustering framework for a large set of vehicle driving data. Existing algorithms utilize handcrafted features whose quality relies on the judgments of human experts. Additionally, the related feature compression methods are not scalable for a large data-set. Our approach thoroughly considers the traffic elements, including both in-traffic agent objects and map information. Meanwhile, we proposed a self-supervised deep learning approach for spatial and temporal feature extraction to avoid biased data representation. With the newly designed driving data clustering evaluation metrics based on data-augmentation, the accuracy assessment does not require a human-labeled dataset, which is subject to human bias. Via such unprejudiced evaluation metrics, we have shown our approach surpasses the existing methods that rely on handcrafted feature extractions. © 2021, CC BY-NC-SA.

关键词： Autonomous vehicles