检索结果-内蒙古大学图书馆

GBCNs: Genetic Binary Convolutional Networks for enhancing the performance of 1-bit DCNNs

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Liu, Chunlei W., Ding Y., Hu B., Zhang J., Liu G., Guo School of Electronic and Information Engineering Beihang University Unmanned System Research Institute Beihang University School of Automation Science and Electrical Engineering Beihang University Shenzhen Institutes of Advanced Technology University of Chinese Academy of Sciences Institute of Deep Learning Baidu Research National Engineering Laboratory for Deep Learning Technology and Application

Training 1-bit deep convolutional neural networks (DCNNs) is one of the most challenging problems in computer vision, because it is much easier to get trapped into local minima than conventional DCNNs. The reason lies in that the binarized kernels and activations of 1-bit DCNNs cause a significant accuracy loss and training inefficiency. To address this problem, we propose Genetic Binary Convolutional Networks (GBCNs) to optimize 1-bit DCNNs, by introducing a new balanced Genetic Algorithm (BGA) to improve the representational ability in an end-to-end framework. The BGA method is proposed to modify the binary process of GBCNs to alleviate the local minima problem, which can significantly improve the performance of 1-bit DCNNs. We develop a new BGA module that is generic and flexible, and can be easily incorporated into existing DCNNs, such as WideResNets and ResNets. Extensive experiments on the object classification tasks (CIFAR, ImageNet) validate the effectiveness of the proposed method. To highlight, our method shows strong generalization on the object recognition task, i.e., face recognition, facial and person re-identification. Copyright © 2019, The Authors. All rights reserved.

关键词： deep neural networks

FM-ViT: Flexible Modal Vision Transformers for Face Anti-Spoofing

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Liu, Ajian Tan, Zichang Yu, Zitong Zhao, Chenxu Wan, Jun Liang, Yanyan Lei, Zhen Zhang, Du Li, Stan Z. Guo, Guodong Beijing China The Institute of Deep Learning Baidu Research National Engineering Laboratory for Deep Learning Technology and Application China The Great Bay University Dongguan523000 China The Mininglamp Academy of Sciences Mininglamp Technology China The Macau University of Science and Technology China The Westlake University China

The availability of handy multi-modal (i.e., RGB-D) sensors has brought about a surge of face anti-spoofing research. However, the current multi-modal face presentation attack detection (PAD) has two defects: (1) The framework based on multi-modal fusion requires providing modalities consistent with the training input, which seriously limits the deployment scenario. (2) The performance of ConvNet-based model on high fidelity datasets is increasingly limited. In this work, we present a pure transformer-based framework, dubbed the Flexible Modal Vision Transformer (FM-ViT), for face anti-spoofing to flexibly target any single-modal (i.e., RGB) attack scenarios with the help of available multi-modal data. Specifically, FM-ViT retains a specific branch for each modality to capture different modal information and introduces the Cross-Modal Transformer Block (CMTB), which consists of two cascaded attentions named Multi-headed Mutual-Attention (MMA) and Fusion-Attention (MFA) to guide each modal branch to mine potential features from informative patch tokens, and to learn modality-agnostic liveness features by enriching the modal information of own CLS token, respectively. Experiments demonstrate that the single model trained based on FM-ViT can not only flexibly evaluate different modal samples, but also outperforms existing single-modal frameworks by a large margin, and approaches the multi-modal frameworks introduced with smaller FLOPs and model parameters. Copyright © 2023, The Authors. All rights reserved.

关键词： Modal analysis

Vision Transformer with Attentive Pooling for Robust Facial Expression Recognition

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Xue, Fanglei Wang, Qiangchang Tan, Zichang Ma, Zhongsong Guo, Guodong University of Chinese Academy of Sciences The Key Laboratory of Space Utilization Technology and Engineering Center for Space Utilization Chinese Academy of Sciences Beijing China West Virginia University Morgantown United States Institute of Deep Learning Baidu Research National Engineering Laboratory for Deep Learning Technology and Application Beijing China

Facial Expression Recognition (FER) in the wild is an extremely challenging task. Recently, some Vision Transformers (ViT) have been explored for FER, but most of them perform inferiorly compared to Convolutional Neural Networks (CNN). This is mainly because the new proposed modules are difficult to converge well from scratch due to lacking inductive bias and easy to focus on the occlusion and noisy areas. TransFER, a representative transformer-based method for FER, alleviates this with multi-branch attention dropping but brings excessive computations. On the contrary, we present two attentive pooling (AP) modules to pool noisy features directly. The AP modules include Attentive Patch Pooling (APP) and Attentive Token Pooling (ATP). They aim to guide the model to emphasize the most discriminative features while reducing the impacts of less relevant features. The proposed APP is employed to select the most informative patches on CNN features, and ATP discards unimportant tokens in ViT. Being simple to implement and without learnable parameters, the APP and ATP intuitively reduce the computational cost while boosting the performance by ONLY pursuing the most discriminative features. Qualitative results demonstrate the motivations and effectiveness of our attentive poolings. Besides, quantitative results on six in-the-wild datasets outperform other state-of-the-art methods. © 2022, CC BY.

关键词： Convolutional neural networks

IoU loss for 2D/3D object detection

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Zhou, Dingfu Fang, Jin Song, Xibin Guan, Chenye Yin, Junbo Dai, Yuchao Yang, Ruigang Baidu Research National Engineering Laboratory of Deep Learning Technology and Application China Beijing Lab of Intelligent Information Technology School of Computer Science Beijing Institute of Technology China Northwestern Polytechnical University Xi'an China

In 2D/3D object detection task, Intersection-over-Union (IoU) has been widely employed as an evaluation metric to evaluate the performance of different detectors in the testing stage. However, during the training stage, the common distance loss (e.g., L1 or L2) is often adopted as the loss function to minimize the discrepency between the predicted and ground truth Bounding Box (Bbox). To eliminate the performance gap between training and testing, the IoU loss has been introduced for 2D object detection in [1] and [2]. Unfortunately, all these approaches only work for axis-aligned 2D Bboxes, which cannot be applied for more general object detection task with rotated Bboxes. To resolve this issue, we investigate the IoU computation for two rotated Bboxes first and then implement a unified framework, IoU loss layer for both 2D and 3D object detection tasks. By integrating the implemented IoU loss into several state-of-the-art 3D object detectors, consistent improvements have been achieved for both bird-eye-view 2D detection and point cloud 3D detection on the public KITTI [3] benchmark. Copyright © 2019, The Authors. All rights reserved.

关键词： Object recognition

RBCN: Rectified Binary convolutional networks for enhancing the Performance of 1-bit DCNNs

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Liu, Chunlei Ding, Wenrui Xia, Xin Hu, Yuan Zhang, Baochang Liu, Jianzhuang Zhuang, Bohan Guo, Guodong School of Electronic and Information Engineering Beihang University Unmanned System Research Institute Beihang University School of Automation Science and Electrical Engineering Beihang University Huawei Noah's Ark Lab University of Adelaide Institute of Deep Learning Baidu Research National Engineering Laboratory for Deep Learning Technology and Application

Binarized convolutional neural networks (BCNNs) are widely used to improve memory and computation efficiency of deep convolutional neural networks (DCNNs) for mobile and AI chips based applications. However, current BCNNs are not able to fully explore their corresponding full-precision models, causing a significant performance gap between them. In this paper, we propose rectified binary convolutional networks (RBCNs), towards optimized BCNNs, by combining full-precision kernels and feature maps to rectify the binarization process in a unified framework. In particular, we use a GAN to train the 1-bit binary network with the guidance of its corresponding full-precision model, which significantly improves the performance of BCNNs. The rectified convolutional layers are generic and flexible, and can be easily incorporated into existing DCNNs such as WideResNets and ResNets. Extensive experiments demonstrate the superior performance of the proposed RBCNs over state-of-the-art BCNNs. In particular, our method shows strong generalization on the object tracking task. Copyright © 2019, The Authors. All rights reserved.

关键词： deep neural networks

iffDetector: Inference-aware feature filtering for object detection

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Mao, Mingyuan Tian, Yuxin Zhang, Baochang Ye, Qixiang Liu, Wanquan Guo, Guodong Doermann, David Beihang University Beijing China University of Chinese Academy of Sciences Beijing China Curtin University Perth Australia Institute of Deep Learning Baidu Research Beijing China National Engineering Laboratory for Deep Learning Technology and Application University at Buffalo Buffalo United States

Modern CNN-based object detectors focus on feature configuration during training but often ignore feature optimization during inference. In this paper, we propose a new feature optimization approach to enhance features and suppress background noise in both the training and inference stages. We introduce a generic Inference-aware Feature Filtering (IFF) module that can easily be combined with modern detectors, resulting in our iffDetector. Unlike conventional open-loop feature calculation approaches without feedback, the IFF module performs closed-loop optimization by leveraging high-level semantics to enhance the convolutional features. By applying Fourier transform analysis, we demonstrate that the IFF module acts as a negative feedback that theoretically guarantees the stability of feature learning. IFF can be fused with CNN-based object detectors in a plug-and-play manner with negligible computational cost overhead. Experiments on the PASCAL VOC and MS COCO datasets demonstrate that our iffDetector consistently outperforms state-of-the-art methods by significant margins1. Copyright © 2020, The Authors. All rights reserved.

关键词： Object detection

FaceScape: A large-scale high quality 3D face dataset and detailed riggable 3D face prediction

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Yang, Haotian Zhu, Hao Wang, Yanru Huang, Mingkai Shen, Qiu Yang, Ruigang Cao, Xun Nanjing University China Baidu Research University of Kentucky United States Inceptio Inc National Engineering Laboratory for Deep Learning Technology and Applications China

In this paper, we present a large-scale detailed 3D face dataset, FaceScape, and propose a novel algorithm that is able to predict elaborate riggable 3D face models from a single image input. FaceScape dataset provides 18,760 textured 3D faces, captured from 938 subjects and each with 20 specific expressions. The 3D models contain the pore-level facial geometry that is also processed to be topologically uniformed. These fine 3D facial models can be represented as a 3D morphable model for rough shapes and displacement maps for detailed geometry. Taking advantage of the large-scale and high-accuracy dataset, a novel algorithm is further proposed to learn the expression-specific dynamic details using a deep neural network. The learned relationship serves as the foundation of our 3D face prediction system from a single image input. Different than the previous methods, our predicted 3D models are riggable with highly detailed geometry under different expressions. The unprecedented dataset and code will be released to public for research purpose†. Copyright © 2020, The Authors. All rights reserved.

关键词： Geometry

Out-of-town recommendation with travel intention modeling

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Xin, Haoran Lu, Xinjiang Xu, Tong Liu, Hao Gu, Jingjing Dou, Dejing Xiong, Hui University of Science and Technology of China China Business Intelligence Lab Baidu Research China National Engineering Laboratory of Deep Learning Technology and Application China Nanjing University of Aeronautics and Astronautics China Rutgers University United States

Out-of-town recommendation is designed for those users who leave their home-town areas and visit the areas they have never been to before. It is challenging to recommend Point-of-Interests (POIs) for out-of-town users since the out-of-town check-in behavior is determined by not only the user’s home-town preference but also the user’s travel intention. Besides, the user’s travel intentions are complex and dynamic, which leads to big difficulties in understanding such intentions precisely. In this paper, we propose a TRAvel-INtention-aware Out-of-town Recommendation framework, named TRAINOR. The proposed TRAINOR framework distinguishes itself from existing out-of-town recommenders in three aspects. First, graph neural networks are explored to represent users’ home-town check-in preference and geographical constraints in out-of-town check-in behaviors. Second, a user-specific travel intention is formulated as an aggregation combining home-town preference and generic travel intention together, where the generic travel intention is regarded as a mixture of inherent intentions that can be learned by Neural Topic Model (NTM). Third, a non-linear mapping function, as well as a matrix factorization method, are employed to transfer users’ home-town preference and estimate out-of-town POI’s representation, respectively. Extensive experiments on real-world data sets validate the effectiveness of the TRAINOR framework. Moreover, the learned travel intention can deliver meaningful explanations for understanding a user’s travel purposes. © 2021, CC BY-NC-SA.

关键词： Graph neural networks

Spatial object recommendation with hints: When spatial granularity matters

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Luo, Hui Zhou, Jingbo Bao, Zhifeng Li, Shuangli Culpepper, J. Shane Ying, Haochao Liu, Hao Xiong, Hui RMIT University Australia Business Intelligence Lab Baidu Research National Engineering Laboratory of Deep Learning Technology and Application China University of Science and Technology of China China Zhejiang University China Rutgers University United States

Existing spatial object recommendation algorithms generally treat objects identically when ranking them. However, spatial objects often cover different levels of spatial granularity and thereby are heterogeneous. For example, one user may prefer to be recommended a region (say Manhattan), while another user might prefer a venue (say a restaurant). Even for the same user, preferences can change at different stages of data exploration. In this paper, we study how to support top-k spatial object recommendations at varying levels of spatial granularity, enabling spatial objects at varying granularity, such as a city, suburb, or building, as a Point of Interest (POI). To solve this problem, we propose the use of a POI tree, which captures spatial containment relationships between POIs. We design a novel multi-task learning model called MPR (short for Multi-level POI Recommendation), where each task aims to return the top-k POIs at a certain spatial granularity level. Each task consists of two subtasks: (i) attribute-based representation learning;(ii) interaction-based representation learning. The first subtask learns the feature representations for both users and POIs, capturing attributes directly from their profiles. The second subtask incorporates user-POI interactions into the model. Additionally, MPR can provide insights into why certain recommendations are being made to a user based on three types of hints: user-aspect, POI-aspect, and interaction-aspect. We empirically validate our approach using two real-life datasets, and show promising performance improvements over several state-of-the-art methods. Copyright © 2021, The Authors. All rights reserved.

关键词： Forestry