检索结果-内蒙古大学图书馆

Fast Texture Synthesis via Pseudo Optimizer

学校读者我要写书评

暂无评论

Fast Texture Synthesis via Pseudo Optimizer

Conference on computer vision and Pattern Recognition (CVPR)

作者： Wu Shi Yu Qiao ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society

ISBN: (数字)9781728171685

ISBN: (纸本)9781728171692

Texture synthesis using deep neural networks can generate high quality and diversified textures. However, it usually requires a heavy optimization process. The following works accelerate the process by using feed-forward networks, but at the cost of scalability. diversity or quality. We propose a new efficient method that aims to simulate the optimization process while retains most of the properties. Our method takes a noise image and the gradients from a descriptor network as inputs, and synthesize a refined image with respect to the target image. The proposed method can synthesize images with better quality and diversity than the other fast synthesis methods do. Moreover, our method trained on a large scale dataset can generalize to synthesize unseen textures.

关键词： Neural networks Training Transforms Scalability Optimization methods Convolution

Learning Attentive Pairwise Interaction for Fine-Grained Classification

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Zhuang, Peiqin Wang, Yali Qiao, Yu ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society

Fine-grained classification is a challenging problem, due to subtle differences among highly-confused categories. Most approaches address this difficulty by learning discriminative representation of individual input image. On the other hand, humans can effectively identify contrastive clues by comparing image pairs. Inspired by this fact, this paper proposes a simple but effective Attentive Pairwise Interaction Network (API-Net), which can progressively recognize a pair of fine-grained images by interaction. Specifically, API-Net first learns a mutual feature vector to capture semantic differences in the input pair. It then compares this mutual vector with individual vectors to generate gates for each input image. These distinct gate vectors inherit mutual context on semantic differences, which allow API-Net to attentively capture contrastive clues by pairwise interaction between two images. Additionally, we train API-Net in an end-to-end manner with a score ranking regularization, which can further generalize API-Net by taking feature priorities into account. We conduct extensive experiments on five popular benchmarks in fine-grained classification. API-Net outperforms the recent SOTA methods, i.e., CUB-200-2011 (90.0%), Aircraft (93.9%), Stanford Cars (95.3%), Stanford Dogs (90.3%), and NABirds (88.1%). Copyright © 2020, The Authors. All rights reserved.

关键词： Vectors

Multi-Scale Dynamic and Hierarchical Relationship Modeling for Facial Action Units Recognition

学校读者我要写书评

暂无评论

Multi-Scale Dynamic and Hierarchical Relationship Modeling f...

Conference on computer vision and Pattern Recognition (CVPR)

作者： Zihan Wang Siyang Song Cheng Luo Songhe Deng Weicheng Xie Linlin Shen Computer Vision Institute School of Computer Science & Software Engineering Shenzhen University Shenzhen Institute of Artificial Intelligence and Robotics for Society National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Universiry of Leicester Monash University

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

Human facial action units (AUs) are mutually related in a hierarchical manner, as not only they are associated with each other in both spatial and temporal domains but also AUs located in the same/close facial regions show stronger relationships than those of different facial regions. While none of existing approach thoroughly model such hi-erarchical inter-dependencies among AUs, this paper proposes to comprehensively model multi-scale AU-related dynamic and hierarchical spatiotemporal relationship among AUs for their occurrences recognition. Specifically, we first propose a novel multi-scale temporal differencing network with an adaptive weighting block to explicitly capture facial dynamics across frames at different spatial scales, which specifically considers the heterogeneity of range and mag-nitude in different AUs' activation. Then, a two-stage strategy is introduced to hierarchically model the relationship among AUs based on their spatial distribution (i.e., local and cross-region AU relationship modelling). Experimental results achieved on BP4D and DISFA show that our approach is the new state-of-the-art in the field of AU occurrence recognition. Our code is publicly available at https://***/CVI-SZU/MDHR.

关键词： Gold Adaptation models computer vision Graphical models Codes Adaptive systems Computational modeling

Multi-scale Contrastive Learning for Gastroenteroscopy Classification

学校读者我要写书评

暂无评论

Multi-scale Contrastive Learning for Gastroenteroscopy Class...

Annual IEEE Symposium on computer-Based Medical Systems

作者： Dan Li Xuechen Li Zhibin Peng Wenting Chen Linlin Shen Guangyao Wu Computer Vision Institute School of Computer Science & Software Engineering Shenzhen University National Engineering Laboratory for Big Data System Computing Technology ShenZhen University Shenzhen China City University of Hong Kong Hong Kong SAR China Shenzhen Institute of Artificial Intelligence & Robotics for Society Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University General Hospital

In gastroenteroscopy image analysis, numerous CADs demonstrate that deep learning aids doctors' diagnosis. The shapes and sizes of the lesions are varied. And in the clinic, the dataset appears to be data imbalanced. However, existing methods directly classify by texture and ignore lesions with various shapes and sizes. To address the issue above, we propose a deep neural network, which consists of multi-scale feature extraction, contrastive feature learning and a multi-scale feature fusion module. We train the contrastive feature learning module and multi-scale feature fusion module simultaneously to alleviate the issue of data distribution differences. Thus, the proposed network can better identify various categories. Extensive experiments on the Hyper Kvasir dataset show that the proposed Hybrid-M2CL outperforms the benchmark proposed by the dataset with 5.0% Macro Precision, 3.3% Macro Recall, 3.4% Macro F1-score, 3.3% Micro Precision, 3.6% MCC. In addition, it outperforms the SOTA by 1.1% Macro F1-score, 2.6% MCC, and 2.0% B-ACC.

关键词：

G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks

学校读者我要写书评

暂无评论

G-MAP: General Memory-Augmented Pre-trained Language Model f...

2022 Conference on Empirical Methods in Natural Language Processing, EMNLP 2022

作者： Wan, Zhongwei Yin, Yichun Zhang, Wei Shi, Jiaxin Shang, Lifeng Chen, Guangyong Jiang, Xin Liu, Qun Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen Institute of Advanced Technology Chinese Academy of Science China University of Chinese Academy of Sciences China Huawei Noah's Ark Lab Huawei Cloud Computing Zhejiang Lab China

Recently, domain-specific PLMs have been proposed to boost the task performance of specific domains (e.g., biomedical and computer science) by continuing to pre-train general PLMs with domain-specific corpora. However, this Domain-Adaptive Pre-Training (DAPT;Gururangan et al. (2020)) tends to forget the previous general knowledge acquired by general PLMs, which leads to a catastrophic forgetting phenomenon and sub-optimal performance. To alleviate this problem, we propose a new framework of General Memory-Augmented Pre-trained Language Model (G-MAP), which augments the domain-specific PLM by a memory representation built from the frozen general PLM without losing any general knowledge. Specifically, we propose a new memory-augmented layer, and based on it, different augmented strategies are explored to build the memory representation and then adaptively fuse it into the domain-specific PLM. We demonstrate the effectiveness of G-MAP on various domains (biomedical and computer science publications, news, and reviews) and different kinds (text classification, QA, NER) of tasks, and the extensive results show that the proposed G-MAP can achieve SOTA results on all tasks. © 2022 Association for Computational Linguistics.

关键词： Computational linguistics

Multi-Modal Perception Attention Network with Self-Supervised Learning for Audio-Visual Speaker Tracking

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Li, Yidi Liu, Hong Tang, Hao Key Laboratory of Machine Perception Peking University Shenzhen Graduate School China Computer Vision Lab ETH Zurich Switzerland

Multi-modal fusion is proven to be an effective method to improve the accuracy and robustness of speaker tracking, especially in complex scenarios. However, how to combine the heterogeneous information and exploit the complementarity of multi-modal signals remains a challenging issue. In this paper, we propose a novel Multi-modal Perception Tracker (MPT) for speaker tracking using both audio and visual modalities. Specifically, a novel acoustic map based on spatial-temporal Global Coherence Field (stGCF) is first constructed for heterogeneous signal fusion, which employs a camera model to map audio cues to the localization space consistent with the visual cues. Then a multi-modal perception attention network is introduced to derive the perception weights that measure the reliability and effectiveness of intermittent audio and video streams disturbed by noise. Moreover, a unique cross-modal self-supervised learning method is presented to model the confidence of audio and visual observations by leveraging the complementarity and consistency between different modalities. Experimental results show that the proposed MPT achieves 98.6% and 78.3% tracking accuracy on the standard and occluded datasets, respectively, which demonstrates its robustness under adverse conditions and outperforms the current state-of-the-art methods. Copyright © 2021, The Authors. All rights reserved.

关键词： Audio acoustics

Identity-Sensitive Knowledge Propagation for Cloth-Changing Person Re-identification

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wu, Jianbing Liu, Hong Shi, Wei Tang, Hao Guo, Jingwen Key Laboratory of Machine Perception Shenzhen Graduate School Peking University China Computer Vision Lab ETH Zurich Switzerland

Cloth-changing person re-identification (CC-ReID), which aims to match person identities under clothing changes, is a new rising research topic in recent years. However, typical biometrics-based CC-ReID methods often require cumbersome pose or body part estimators to learn cloth-irrelevant features from human biometric traits, which comes with high computational costs. Besides, the performance is significantly limited due to the resolution degradation of surveillance images. To address the above limitations, we propose an effective Identity-Sensitive Knowledge Propagation framework (DeSKPro) for CC-ReID. Specifically, a Cloth-irrelevant Spatial Attention module is introduced to eliminate the distraction of clothing appearance by acquiring knowledge from the human parsing module. To mitigate the resolution degradation issue and mine identity-sensitive cues from human faces, we propose to restore the missing facial details using prior facial knowledge, which is then propagated to a smaller network. After training, the extra computations for human parsing or face restoration are no longer required. Extensive experiments show that our framework outperforms state-of-the-art methods by a large margin. Our code is available at https://***/KimbingNg/DeskPro. Copyright © 2022, The Authors. All rights reserved.

关键词： Restoration

Cooperative Multi-source Data Trading

学校读者我要写书评

暂无评论

Cooperative Multi-source Data Trading

2024 IEEE Global Communications Conference, GLOBECOM 2024

作者： Cheng, Jin Ding, Ningning Lui, John C. S. Huang, Jianwei The Chinese University of Hong Kong School of Science and Engineering Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen China Hong Kong University of Science and Technology Data Science and Analytics Thrust Information Hub Guangzhou China The Chinese University of Hong Kong Department of Computer Science and Engineering Hong Kong The Chinese University of Hong Kong School of Science and Engineering Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen Key Laboratory of Crowd Intelligence Empowered Low-Carbon Energy Network Csijri Joint Research Centre on Smart Energy Storage Shenzhen China

ISBN: (纸本)9798350351255

In the era of big data, data trading significantly enhances data-driven technologies by facilitating data sharing. Despite the clear advantages often experienced by data users when incorporating multiple sources, the topic of multi-source data trading remains largely unexplored. This paper designs a novel data trading framework, which enables multi-source data trading through multi-source cooperation. The proposed framework aims to improve data usage efficiency and increase seller revenue. In particular, we model data sellers' cooperative decisions through the Nash bargaining framework and systematically outline the interactions between sellers and buyers as a two-stage Stackelberg game. A key contribution of this work is the consideration of coupling among diverse data products, which is essential but often overlooked in prior studies. We properly classify data's utility into endogenous and relational categories to disentangle the coupling. Despite the inherent non-convex nature of the optimization problem, we methodically derive the closed-form optimal solutions by decomposing the problem into several subproblems. Interestingly, we reveal that, under our proposed framework, sellers' revenue initially remains steady with the increase of product coupling level, but begins to rise once the level exceeds a certain threshold due to the substitute effect. Finally, experimental results show that our proposed framework can improve the seller's profit by up to 46.32% compared to traditional data trading methods in the current data market. © 2024 IEEE.

关键词： Marketplaces

A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhao, Qitao Zheng, Ce Liu, Mengyuan Chen, Chen Robotics Institute Carnegie Mellon University United States Center for Research in Computer Vision University of Central Florida United States Key Laboratory of Machine Perception Peking University Shenzhen Graduate School China

The dominant paradigm in 3D human pose estimation that lifts a 2D pose sequence to 3D heavily relies on long-term temporal clues (i.e., using a daunting number of video frames) for improved accuracy, which incurs performance saturation, intractable computation and the non-causal problem. This can be attributed to their inherent inability to perceive spatial context as plain 2D joint coordinates carry no visual cues. To address this issue, we propose a straightforward yet powerful solution: leveraging the readily available intermediate visual representations produced by off-the-shelf (pre-trained) 2D pose detectors - no finetuning on the 3D task is even needed. The key observation is that, while the pose detector learns to localize 2D joints, such representations (e.g., feature maps) implicitly encode the joint-centric spatial context thanks to the regional operations in backbone networks. We design a simple baseline named Context-Aware PoseFormer to showcase its effectiveness. Without access to any temporal information, the proposed method significantly outperforms its context-agnostic counterpart, PoseFormer [77], and other state-of-the-art methods using up to hundreds of video frames regarding both speed and precision. Project page: ***/ContextAware-PoseFormer. Copyright © 2023, The Authors. All rights reserved.

关键词： Machine learning