检索结果-内蒙古大学图书馆

LMR: A Large-Scale Multi-Reference Dataset for Reference-based Super-Resolution

学校读者我要写书评

暂无评论

LMR: A Large-Scale Multi-Reference Dataset for Reference-bas...

International Conference on computer vision (ICCV)

作者： Lin Zhang Xin Li Dongliang He Fu Li Errui Ding Zhaoxiang Zhang University of Chinese Academy of Sciences Institute of Automation Chinese Academy of Sciences State Key Laboratory of Multimodal Artificial Intelligence Systems School of Future Technology UCAS Department of Computer Vision Technology (VIS) Baidu Inc. Center for Artificial Intelligence and Robotics HKISI_CAS

It is widely agreed that reference-based super-resolution (RefSR) achieves superior results by referring to similar high quality images, compared to single image super-resolution (SISR). Intuitively, the more references, the better performance. However, previous RefSR methods have all focused on single-reference image training, while multiple reference images are often available in testing or practical applications. The root cause of such training-testing mismatch is the absence of publicly available multi-reference SR training datasets, which greatly hinders research efforts on multi-reference super-resolution. To this end, we construct a large-scale, multi-reference super-resolution dataset, named LMR. It contains 112, 142 groups of 300×300 training images, which is 10× of the existing largest RefSR dataset. The image size is also some times larger. More importantly, each group is equipped with 5 reference images with different similarity levels. Furthermore, we propose a new baseline method for multi-reference super-resolution: MRefSR, including a Multi-Reference Attention Module (MAM) for feature fusion of an arbitrary number of reference images, and a Spatial Aware Filtering Module (SAFM) for the fused feature selection. The proposed MRefSR achieves significant improvements over state-of-the-art approaches on both quantitative and qualitative evaluations. Our code and data are available at: https://***/wdmwhh/MRefSR.

关键词：

Scene Consistency Representation Learning for Video Scene Segmentation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wu, Haoqian Chen, Keyu Luo, Yanan Qiao, Ruizhi Ren, Bo Liu, Haozhe Xie, Weicheng Shen, Linlin Computer Vision Institute Shenzhen University China Tencent YouTu Lab Shenzhen Institute of Artificial Intelligence and Robotics for Society China Guangdong Key Laboratory of Intelligent Information Processing China KAUST Saudi Arabia

A long-term video, such as a movie or TV show, is composed of various scenes, each of which represents a series of shots sharing the same semantic story. Spotting the correct scene boundary from the long-term video is a challenging task, since a model must understand the storyline of the video to figure out where a scene starts and ends. To this end, we propose an effective Self-Supervised Learning (SSL) framework to learn better shot representations from unlabeled long-term videos. More specifically, we present an SSL scheme to achieve scene consistency, while exploring considerable data augmentation and shuffling methods to boost the model generalizability. Instead of explicitly learning the scene boundary features as in the previous methods, we introduce a vanilla temporal model with less inductive bias to verify the quality of the shot features. Our method achieves the state-of-the-art performance on the task of Video Scene Segmentation. Additionally, we suggest a more fair and reasonable benchmark to evaluate the performance of Video Scene Segmentation methods. The code is made available. © 2022, CC BY.

关键词： Semantics

A Toolkit to Generate Social Navigation Datasets 21st

学校读者我要写书评

暂无评论

A Toolkit to Generate Social Navigation Datasets

21st International Workshop of Physical Agents, WAF 2020

作者： Baghel, Rishabh Kapoor, Aditya Bachiller, Pilar Jorvekar, Ronit R. Rodriguez-Criado, Daniel Manso, Luis J. Department of Computer Science and Engineering Indian Institute of Information Technology Guwahati Guwahati India Department of Computer Science and Information Systems Birla Institute of Technology and Science Goa Pilani India Robotics and Artificial Vision Laboratory University of Extremadura Badajoz Spain Department of Computer Engineering Pune Institute of Computer Technology Pune India Department of Computer Science College of Engineering and Physical Sciences Aston University Birmingham United Kingdom

ISBN: (纸本)9783030625788

Social navigation datasets are necessary to assess social navigation algorithms and train machine learning algorithms. Most of the currently available datasets target pedestrians’ movements as a pattern to be replicated by robots. It can be argued that one of the main reasons for this to happen is that compiling datasets where real robots are manually controlled, as they would be expected to behave when moving, is a very resource-intensive task. Another aspect that is often missing in datasets is symbolic information that could be relevant, such as human activities, relationships or interactions. Unfortunately, the available datasets targeting robots and supporting symbolic information are restricted to static scenes. This paper argues that simulation can be used to gather social navigation data in an effective and cost-efficient way and presents a toolkit for this purpose. A use case studying the application of graph neural networks to create learned control policies using supervised learning is presented as an example of how it can be used. © 2021, The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Navigation

GNN-Assisted BiG-AMP: Joint Channel Estimation and Data Detection for Massive MIMO Receiver

学校读者我要写书评

暂无评论

IEEE Transactions on Wireless Communications 2025年

作者： Liu, Zishen Wu, Nan He, Dongxuan Yuan, Weijie Li, Yonghui Quek, Tony Q. S. School of Information and Electronics Beijing Institute of Technology Beijing100081 China School of System Design and Intelligent Manufacturing Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen518055 China School of Electrical and Information Engineering The University of Sydney SydneyNSW2008 Australia Singapore University of Technology and Design 487372 Singapore Department of Electronic Engineering Kyung Hee University Yongin17104 Korea Republic of

In this paper, we develop a graph neural network (GNN)-assisted bilinear inference approach to enhance the receiver performance of the MIMO system through message passing-based joint channel estimation and data detection (JCD). Specifically, based on the bilinear generalized approximate message passing (BiG-AMP) framework and conditional correlation of signal, we propose a GNN-assisted BiG-AMP (GNN-BiGAMP) approach, which integrates a GNN module into the data-detection-loop to compensate the inaccurate marginal likelihood approximation. By leveraging the coupling between the channel and received symbols, a bilinear GNN-assisted BiG-AMP (BiGNN-BiGAMP) JCD receiver is further proposed. This method incorporates two GNNs with similar graph representation into the bilinear posterior estimation loops, which not only compensates for approximation errors but also alleviates performance loss due to premature variance convergence, thereby enhancing the receiver performance significantly. To fully exploit the supervised information from channel estimation and data detection, we propose a multitask learning based training scheme, which coordinates GNNs with different tasks in two loops. Simulation results show that our proposed GNN-assisted JCD receivers significantly outperform other JCD counterparts in terms of both channel estimation and data detection. © 2025 IEEE. All rights reserved.

关键词： Graph neural networks

MFCLIP: Multi-modal Fine-grained CLIP for Generalizable Diffusion Face Forgery Detection

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Yaning Wang, Tianyi Yu, Zitong Gao, Zan Shen, Linlin Chen, Shengyong Jinan250353 China Nanyang Technological University 50 Nanyang Ave Block N 4 639798 Singapore School of Computing and Information Technology Great Bay University Dongguan523000 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen518060 China Jinan250014 China The Key Laboratory of Computer Vision and System Ministry of Education Tianjin University of Technology Tianjin300384 China Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518129 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518060 China

The rapid development of photo-realistic face generation methods has raised significant concerns in society and academia, highlighting the urgent need for robust and generalizable face forgery detection (FFD) techniques. Although existing approaches mainly capture face forgery patterns using image modality, other modalities like fine-grained noises and texts are not fully explored, which limits the generalization capability of the model. In addition, most FFD methods tend to identify facial images generated by GAN, but struggle to detect unseen diffusion-synthesized ones. To address the limitations, we aim to leverage the cutting-edge foundation model, contrastive language-image pre-training (CLIP), to achieve generalizable diffusion face forgery detection (DFFD). In this paper, we propose a novel multi-modal fine-grained CLIP (MFCLIP) model, which mines comprehensive and fine-grained forgery traces across image-noise modalities via language-guided face forgery representation learning, to facilitate the advancement of DFFD. Specifically, we devise a fine-grained language encoder (FLE) that extracts fine global language features from hierarchical text prompts. We design a multi-modal vision encoder (MVE) to capture global image forgery embeddings as well as fine-grained noise forgery patterns extracted from the richest patch, and integrate them to mine general visual forgery traces. Moreover, we build an innovative plug-and-play sample pair attention (SPA) method to emphasize relevant negative pairs and suppress irrelevant ones, allowing cross-modality sample pairs to conduct more flexible alignment. Extensive experiments and visualizations show that our model outperforms the state of the arts on different settings like cross-generator, cross-forgery, and cross-dataset evaluations. Copyright © 2024, The Authors. All rights reserved.

关键词： Alignment

Joint Design of Radar Receive Filter and Unimodular ISAC Waveform with Sidelobe Level Control

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Kecheng Liu, Ya-Feng Wang, Zhongbin Yuan, Weijie Keskin, Musa Furkan Wymeersch, Henk Xia, Shuqiang School of System Design and Intelligent Manufacturing The Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen518055 China State Key Laboratory of Scientific and Engineering Computing Institute of Computational Mathematics and Scientific/Engineering Computing Academy of Mathematics and Systems Science Chinese Academy of Sciences Beijing100190 China Department of Electrical Engineering Chalmers University of Technology Gothenburg41296 Sweden ZTE Corporation The State Key Laboratory of Mobile Network and Mobile Multimedia Technology Shenzhen518055 China

Integrated sensing and communication (ISAC) has been considered a key feature of next-generation wireless networks. This paper investigates the joint design of the radar receive filter and dual-functional transmit waveform for the multiple-input multiple-output (MIMO) ISAC system. While optimizing the mean square error (MSE) of the radar receive spatial response and maximizing the achievable rate at the communication receiver, besides the constraints of full-power radar receiving filter and unimodular transmit sequence, we control the maximum range sidelobe level, which is often overlooked in existing ISAC waveform design literature, for better radar imaging performance. To solve the formulated optimization problem with convex and nonconvex constraints, we propose an inexact augmented Lagrangian method (ALM) algorithm. For each subproblem in the proposed inexact ALM algorithm, we custom-design a block successive upper-bound minimization (BSUM) scheme with closed-form solutions for all blocks of variable to enhance the computational efficiency. Convergence analysis shows that the proposed algorithm is guaranteed to provide a stationary and feasible solution. Extensive simulations are performed to investigate the impact of different system parameters on communication and radar imaging performance. Comparison with the existing works shows the superiority of the proposed algorithm. © 2025, CC BY-NC-SA.

关键词： Mean square error

Activation Template Matching Loss for Explainable Face Recognition

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Lin, Huawei Liu, Haozhe Li, Qiufu Shen, Linlin Computer Vision Institute Shenzhen University Shenzhen 518060 China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen 518060 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen 518060 China

Can we construct an explainable face recognition network able to learn a facial part-based feature like eyes, nose, mouth and so forth, without any manual annotation or additionalsion datasets? In this paper, we propose a generic Explainable Channel Loss (ECLoss) to construct an explainable face recognition network. The explainable network trained with ECLoss can easily learn the facial part-based representation on the target convolutional layer, where an individual channel can detect a certain face part. Our experiments on dozens of datasets show that ECLoss achieves superior explainability metrics, and at the same time improves the performance of face verification without face alignment. In addition, our visualization results also illustrate the effectiveness of the proposed ECLoss. © 2022, CC BY.

关键词： Face recognition

Distilled Transformers with Locally Enhanced Global Representations for Face Forgery Detection

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Yaning Li, Qiufu Yu, Zitong Shen, Linlin Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Guangdong Shenzhen518060 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Guangdong Shenzhen518060 China Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Shenzhen518129 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Guangdong Shenzhen518060 China School of Computing and Information Technology Great Bay University Guangdong Dongguan523000 China

Face forgery detection (FFD) is devoted to detecting the authenticity of face images. Although current CNN-based works achieve outstanding performance in FFD, they are susceptible to capturing local forgery patterns generated by various manipulation methods. Though transformer-based detectors exhibit improvements in modeling global dependencies, they are not good at exploring local forgery artifacts. Hybrid transformer-based networks are designed to capture local and global manipulated traces, but they tend to suffer from the attention collapse issue as the transformer block goes deeper. Besides, soft labels are rarely available. In this paper, we propose a distilled transformer network (DTN) to capture both rich local and global forgery traces and learn general and common representations for different forgery faces. Specifically, we design a mixture of expert (MoE) module to mine various robust forgery embeddings. Moreover, a locally-enhanced vision transformer (LEVT) module is proposed to learn locally-enhanced global representations. We design a lightweight multi-attention scaling (MAS) module to avoid attention collapse, which can be plugged and played in any transformer-based models with only a slight increase in computational costs. In addition, we propose a deepfake self-distillation (DSD) scheme to provide the model with abundant soft label information. Extensive experiments show that the proposed method surpasses the state of the arts on five deepfake datasets. Copyright © 2024, The Authors. All rights reserved.

关键词： Face recognition

A New Dynamic Routing Network for Monocular Depth Estimation 12

学校读者我要写书评

暂无评论

A New Dynamic Routing Network for Monocular Depth Estimation

12th International Conference on CYBER Technology in Automation, Control, and Intelligent Systems, CYBER 2022

作者： Luo, Zhehao Luo, Sijin Liang, Guoyuan Wu, Xinyu Guangdong Provincial Key Lab of Robotics and Intelligent System Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Province Shenzhen China University of Chinese Academy of Sciences Beijing China Guangdong-Hong Kong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems Chinese Academy of Sciences Guangdong Province Shenzhen China Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Province Shenzhen China

ISBN: (数字)9781665472678

ISBN: (纸本)9781665472678

Depth estimation is an essential task for understanding the geometry of 3D scenes. Compared with multi-view-based methods, monocular depth estimation is more challenging for the requirement of integrating not only global information but also local cues from various parts. Recently, numerous Convolutional Neural Networks (CNNs) based approaches relying on pre-defined static architectures have been reported. Although many of them have achieved remarkable improvements in accuracy, there remains problem with the generality of the static model when it comes to diverse scenes. In this paper, a novel deep network with dynamic routing architecture is proposed with a dynamically adjustable structure with respect to different inputs, therefore leading to not only improvements on both accuracy and generality but also decrease of the model parameters. Extensive experiments of monocular depth estimation have been conducted on two well-known challenging datasets (i.e., NYUD-v2 and Make3D) as well as the mixed dataset, and have verified the effectiveness of the proposed dynamic framework. © 2022 IEEE.

关键词： Deep neural networks