检索结果-内蒙古大学图书馆

CASIA-SURF: A Large-scale Multi-modal Benchmark for Face Anti-spoofing

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Zhang, Shifeng Liu, Ajian Wan, Jun Liang, Yanyan Guo, Guogong Escalera, Sergio Escalante, Hugo Jair Li, Stan Z. National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences University of Chinese Academy of Sciences Beijing China Macau University of Science and Technology Macau China Institute of Deep Learning Baidu Research and National Engineering Laboratory for Deep Learning Technology and Application Universitat de Barcelona Computer Vision Center Barcelona Catalonia Instituto Nacional de Astrofsica Ptica y Electrnica Puebla72840 Mexico

Face anti-spoofing is essential to prevent face recognition systems from a security breach. Much of the progresses have been made by the availability of face anti-spoofing benchmark datasets in recent years. However, existing face antispoofing benchmarks have limited number of subjects (≤170) and modalities (≤2), which hinder the further development of the academic community. To facilitate face anti-spoofing research, we introduce a large-scale multi-modal dataset, namely CASIASURF, which is the largest publicly available dataset for face antispoofing in terms of both subjects and modalities. Specifically, it consists of 1;000 subjects with 21;000 videos and each sample has 3 modalities (i.e., RGB, Depth and IR). We also provide comprehensive evaluation metrics, diverse evaluation protocols, training/validation/testing subsets and a measurement tool, developing a new benchmark for face anti-spoofing. Moreover, we present a novel multi-modal multi-scale fusion method as a strong baseline, which performs feature re-weighting to select the more informative channel features while suppressing the less useful ones for each modality across different scales. Extensive experiments have been conducted on the proposed dataset to verify its significance and generalization capability. The dataset is available at http://***/***/chalearnfacespoofingattackdete/. Copyright © 2019, The Authors. All rights reserved.

关键词： Face recognition

Relaxed 2-D principal component analysis by Lpnorm for face recognition

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Chen, Xiao Jia, Zhi-Gang Cai, Yunfeng Zhao, Mei-Xiang School of Mathematics and Statistics Jiangsu Key Laboratory of Education Big Data Science and Engineering Jiangsu Normal University Xuzhou221116 China Baidu Research National Engineering Laboratory for Deep Learning Technology and Applications Beijing100193 China

A relaxed two dimensional principal component analysis (R2DPCA) approach is proposed for face recognition. Different to the 2DPCA, 2DPCA-L1 and G2DPCA, the R2DPCA utilizes the label information (if known) of training samples to calculate a relaxation vector and presents a weight to each subset of training data. A new relaxed scatter matrix is defined and the computed projection axes are able to increase the accuracy of face recognition. The optimal Lp-norms are selected in a reasonable range. Numerical experiments on practical face databased indicate that the R2DPCA has high generalization ability and can achieve a higher recognition rate than state-of-the-art methods. Copyright © 2019, The Authors. All rights reserved.

关键词： Face recognition

$\mathsf{NCF}$NCF: A Neural Context Fusion Approach to Raw Mobility Annotation

学校读者我要写书评

暂无评论

IEEE Transactions on Mobile Computing 2020年第1期21卷 226-238页

作者： Renjun Hu Jingbo Zhou Xinjiang Lu Hengshu Zhu Shuai Ma Hui Xiong SKLSDE Lab Beijing Advanced Innovation Center for Big Data and Brain Computing Beihang University Beijing China Business Intelligence Lab Baidu Research National Engineering Laboratory of Deep Learning Technology and Application Beijing China Talent Intelligence Center Baidu Inc. Beijing China Management Science and Information Systems Department Rutgers Business School Rutgers University Newark NJ USA

Understanding human mobility patterns at the point-of-interest (POI) scale plays an important role in enhancing business intelligence in mobile environments. While large efforts have been made in this direction, most studies simply utilize POI check-ins to mine the concerned mobility patterns, the effectiveness of which is usually hindered due to data sparsity. To obtain better POI-based human mobility for mining, in this paper, we strive to directly annotate the POIs associated with raw user-generated mobility records. We propose a neural context fusion approach which integrates various context factors in people's POI-visiting behaviors. Our approach evaluates the preference and transition factors via representation learning. Notably, we incorporate an attention mechanism to deal with the randomized transitions in raw mobility. The domain knowledge factors, i.e., distance, time and popularity, remain effective and our approach further includes them from a data-driven perspective. Factors are automatically fused with a feed-forward neural network. Furthermore, we exploit a multi-head architecture to enhance the model expressiveness. Using two real-life data sets, we conduct our experimental study and find that our approach consistently outperforms the state-of-the-art baselines by at least 32 percent in accuracy. Besides, we demonstrate the utility of the obtained POI-based human mobility with a POI recommendation example.

关键词： Annotations Trajectory Mobile computing Computer architecture Business intelligence Neural networks Semantics

View extrapolation of human body from a single image

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Zhu, Hao Su, Hao Wang, Peng Cao, Xun Yang, Ruigang Nanjing University Nanjing China University of Kentucky LexingtonKY United States University of California San DiegoCA United States Baidu Inc. Beijing China National Engineering Laboratory of Deep Learning and Technology and Application China

We study how to synthesize novel views of human body from a single image. Though recent deep learning based methods work well for rigid objects, they often fail on objects with large articulation, like human bodies. The core step of existing methods is to fit a map from the observable views to novel views by CNNs;however, the rich articulation modes of human body make it rather challenging for CNNs to memorize and interpolate the data well. To address the problem, we propose a novel deep learning based pipeline that explicitly estimates and leverages the geometry of the underlying human body. Our new pipeline is a composition of a shape estimation network and an image generation network, and at the interface a perspective transformation is applied to generate a forward flow for pixel value transportation. Our design is able to factor out the space of data variation and makes learning at each step much easier. Empirically, we show that the performance for pose-varying objects can be improved dramatically. Our method can also be applied on real data captured by 3D sensors, and the flow generated by our methods can be used for generating high quality results in higher resolution. Copyright © 2018, The Authors. All rights reserved.

关键词： Pipelines

deeply supervised depth map super-resolution as novel view synthesis

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Song, Xibin Dai, Yuchao Qin, Xueying School of Computer Science and Technology Shandong University China Baidu Research Beijing China National Engineering Laboratory of Deep Learning Technology and Application China Shaanxi Key Lab of Information Acquisition and Processing School of Electronics and Information Northwestern Polytechnical University School of Software Shandong University China

deep convolutional neural network (DCNN) has been successfully applied to depth map super-resolution and outperforms existing methods by a wide margin. However, there still exist two major issues with these DCNN based depth map super-resolution methods that hinder the performance: i) The low-resolution depth maps either need to be up-sampled before feeding into the network or substantial deconvolution has to be used;and ii) The supervision (high-resolution depth maps) is only applied at the end of the network, thus it is difficult to handle large up-sampling factors, such as ×8;×16. In this paper, we propose a new framework to tackle the above problems. First, we propose to represent the task of depth map super-resolution as a series of novel view synthesis sub-tasks. The novel view synthesis sub-task aims at generating (synthesizing) a depth map from different camera pose, which could be learned in parallel. Second, to handle large up-sampling factors, we present a deeply supervised network structure to enforce strong supervision in each stage of the network. Third, a multi-scale fusion strategy is proposed to effectively exploit the feature maps at different scales and handle the blocking effect. In this way, our proposed framework could deal with challenging depth map super-resolution efficiently under large up-sampling factors (e.g.×8;×16). Our method only uses the low-resolution depth map as input, and the support of color image is not needed, which greatly reduces the restriction of our method. Extensive experiments on various benchmarking datasets demonstrate the superiority of our method over current state-of-the-art depth map super-resolution methods. Copyright © 2018, The Authors. All rights reserved.

关键词： Optical resolving power

A unified object motion and affinity model for online Multi-Object Tracking

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Yin, Junbo Wang, Wenguan Meng, Qinghao Yang, Ruigang Shen, Jianbing Beijing Lab of Intelligent Information Technology School of Computer Science Beijing Institute of Technology China ETH Zurich Switzerland Baidu Research China National Engineering Laboratory of Deep Learning Technology and Application China Inception Institute of Artificial Intelligence United Arab Emirates University of Kentucky Kentucky United States

Current popular online multi-object tracking (MOT) solutions apply single object trackers (SOTs) to capture object motions, while often requiring an extra affinity network to associate objects, especially for the occluded ones. This brings extra computational overhead due to repetitive feature extraction for SOT and affinity computation. Meanwhile, the model size of the sophisticated affinity network is usually non-trivial. In this paper, we propose a novel MOT framework that unifies object motion and affinity model into a single network, named UMA, in order to learn a compact feature that is discriminative for both object motion and affinity measure. In particular, UMA integrates single object tracking and metric learning into a unified triplet network by means of multi-task learning. Such design brings advantages of improved computation efficiency, low memory requirement and simplified training procedure. In addition, we equip our model with a task-specific attention module, which is used to boost task-aware feature learning. The proposed UMA can be easily trained end-to-end, and is elegant – requiring only one training stage. Experimental results show that it achieves promising performance on several MOT Challenge benchmarks. Copyright © 2020, The Authors. All rights reserved.

关键词： Benchmarking

Robust 3D Face Alignment with Multi-Path Neural Architecture Search

学校读者我要写书评

暂无评论

Robust 3D Face Alignment with Multi-Path Neural Architecture...

IEEE International Conference on Multimedia and Expo (ICME)

作者： Zhichao Jiang Hongsong Wang Xi Teng Baopu Li Institute of Deep Learning (IDL) Baidu Beijing China Department of Computer Science and Engineering Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications Southeast University Nanjing China Computer Vision Technology Institution Baidu Beijing China Baidu Research Baidu Sunnyvale USA

ISBN: (数字)9798350390155

ISBN: (纸本)9798350390162

3D face alignment is a very challenging and fundamental problem in computer vision. Existing deep learning-based methods manually design different networks to regress either parameters of a 3D face model or 3D positions of face vertices. However, designing such networks relies on expert knowledge, and these methods often struggle to produce consistent results across various face poses. To address this limitation, we employ Neural Architecture Search (NAS) to automatically discover the optimal architecture for 3D face alignment. We propose a novel Multi-path One-shot Neural Architecture Search (MONAS) framework that leverages multi-scale features and contextual information to enhance face alignment across various poses. The MONAS comprises two key algorithms: Multi-path Networks Unbiased Sampling Based Training and Simulated Annealing based Multi-path One-shot Search. Experimental results on three popular benchmarks demonstrate the superior performance of the MONAS for both sparse alignment and dense alignment.

关键词： Training learning systems Solid modeling Computer vision Three-dimensional displays Neural networks Simulated annealing Network architecture Search problems Faces

Q-ViT: accurate and fully quantized low-bit vision transformer 22

学校读者我要写书评

暂无评论

Q-ViT: accurate and fully quantized low-bit vision transform...

Proceedings of the 36th International Conference on Neural Information Processing Systems

作者： Yanjing Li Sheng Xu Baochang Zhang Xianbin Cao Peng Gao Guodong Guo Beihang University Beijing P.R.China Beihang University Beijing P.R.China and Zhongguancun Laboratory Beijing P.R.China Shanghai Artificial Intelligence Laboratory Shanghai P.R.China Institute of Deep Learning Baidu Research Beijing P.R.China and National Engineering Laboratory for Deep Learning Technology and Application Beijing P.R.China

ISBN: (纸本)9781713871088

The large pre-trained vision transformers (ViTs) have demonstrated remarkable performance on various visual tasks, but suffer from expensive computational and memory cost problems when deployed on resource-constrained devices. Among the powerful compression approaches, quantization extremely reduces the computation and memory consumption by low-bit parameters and bit-wise operations. However, low-bit ViTs remain largely unexplored and usually suffer from a significant performance drop compared with the real-valued counterparts. In this work, through extensive empirical analysis, we first identify the bottleneck for severe performance drop comes from the information distortion of the low-bit quantized self-attention map. We then develop an information rectification module (IRM) and a distribution guided distillation (DGD) scheme for fully quantized vision transformers (Q-ViT) to effectively eliminate such distortion, leading to a fully quantized ViTs. We evaluate our methods on popular DeiT and Swin backbones. Extensive experimental results show that our method achieves a much better performance than the prior arts. For example, our Q-ViT can theoretically accelerates the ViT-S by 6.14 × and achieves about 80.9% Top-1 accuracy, even surpassing the full-precision counterpart by 1.0% on ImageNet dataset.

关键词：

Intelligent exploration for user interface modules of mobile app with collective learning

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Zhou, Jingbo Tang, Zhenwei Zhao, Min Ge, Xiang Zhuang, Fuzhen Zhou, Meng Zou, Liming Yang, Chenglei Xiong, Hui Business Intelligence Lab Baidu Research Baidu TPG User Experience Department China National Engineering Laboratory of Deep Learning Technology and Application China Institute of Computing Technology CAS Beijing China University of Chinese Academy of Sciences Beijing China Beijing University of Posts and Telecommunications China Peking University China Shandong University China Rutgers University United States

A mobile app interface usually consists of a set of user interface modules. How to properly design these user interface modules is vital to achieving user satisfaction for a mobile app. However, there are few methods to determine design variables for user interface modules except for relying on the judgment of designers. Usually, a laborious post-processing step is necessary to verify the key change of each design variable. Therefore, there is a only very limited amount of design solutions that can be tested. It is time-consuming and almost impossible to figure out the best design solutions as there are many modules. To this end, we introduce FEELER, a framework to fast and intelligently explore design solutions of user interface modules with a collective machine learning approach. FEELER can help designers quantitatively measure the preference score of different design solutions, aiming to facilitate the designers to conveniently and quickly adjust user interface module. We conducted extensive experimental evaluations on two real-life datasets to demonstrate its applicability in real-life cases of user interface module design in the baidu App, which is one of the most popular mobile apps in China. Copyright © 2020, The Authors. All rights reserved.

关键词： User interfaces