检索结果-内蒙古大学图书馆

IEEE International Conference on Image Processing

作者： Ruhao Zhao Xian Zhong Liang Liao Wenxuan Liu Wenxin Huang Zheng Wang School of Computer Science and Artificial Intelligence Hubei Key Laboratory of Transportation Internet of Things Wuhan University of Technology School of Electrical and Electronic Engineering Rapid-Rich Object Search Lab Nanyang Technological University College of Computing and Data Science Nanyang Technological University School of Computer Science and Information Engineering Hubei University School of Computer Science National Engineering Research Center for Multimedia Software Wuhan University

ISBN: (数字)9798350349399

ISBN: (纸本)9798350349405

The localization of image splicing involves identifying pixels in an image that have been spliced from other images, necessitating the discernment of splicing features. Despite significant advancements driven by the rise of social media and deep learning, existing methods exhibit limitations, often neglecting the integration of coarse and precise features and lacking the ability to understand objects. This leads to erroneous predictions in identifying spliced regions. This paper proposes Segment Anything Model with Integrated Compression and Edge artifacts (SAM-ICE) for the localization of image splicing, addressing these limitations by fusing forged edge features and compression artifact features. Leveraging SAM’s object understanding ability, our method identifies spliced regions using the fused features as guidance. Specifically, we employ Edge Artifact Extractor (EAE) to extract fine high-frequency edge splicing features and Compression Artifact Extractor (CAE) to extract coarse compression artifact features. By combining these features, our method utilizes coarse-fine features to accurately pinpoint the spliced portions of the image. Experimental results demonstrate the superior accuracy, robustness, and generalizability of our method compared to the state-of-the-arts.

关键词： Location awareness Image segmentation Image coding Social networking (online) Image edge detection Splicing Feature extraction

来源：评论

学校读者我要写书评

暂无评论

ER-NeRF++: Efficient region-aware Neural Radiance Fields for high-fidelity talking portrait synthesis

引用

Information Fusion 2024年 110卷

作者： Li, Jiahe Zhang, Jiawei Bai, Xiao Zheng, Jin Zhou, Jun Gu, Lin School of Computer Science and Engineering State Key Laboratory of Complex & Critical Software Environment Jiangxi Research Institute Beihang University Beijing China School of Information and Communication Technology Griffith University Brisbane Australia RIKEN AIP Tokyo Japan The University of Tokyo Tokyo Japan

Despite conditional Neural Radiance Fields (NeRF) achieving great success in modeling audio-driven talking portraits, the generation quality is increasingly hampered by the lack of efficient use of space information. This paper presents ER-NeRF, a novel conditional NeRF-based architecture for talking portrait synthesis, and its variant version ER-NeRF++ to concurrently achieve fast convergence, real-time rendering, and state-of-the-art performance with small model size. Inspired by the unequal contribution of spatial regions, we propose two modules in ER-NeRF to guide the talking portrait modeling: (1) A compact and expressive Tri-Plane Hash Representation to improve the accuracy of dynamic head reconstruction by pruning empty spatial regions with three planar hash encoders. (2) A Region Attention Module for the audio–visual feature fusion, including a novel cross-modal attention mechanism to connect audio features with different spatial regions explicitly for local motion priors. Additionally, to tackle the difficulty in learning large facial motions, we propose a deformable variant ER-NeRF++ by including a Deformation Grid Transformer to enable the reuse of cross-regional spatial features for large motion representation. Compared to ER-NeRF, our ER-NeRF++ framework achieves a significant improvement in facial motion quality while maintaining the ability of fast training and real-time rendering. For the torso part, a directAdaptive Pose Encoding is introduced to simplify the pose information for a better head-torso connection. Extensive experiments demonstrate that both of our proposed frameworks can efficiently render lifelike talking portrait videos with rich realistic details, performing better in image quality and audio-lip synchronization compared to previous methods. © 2024 Elsevier B.V.

关键词： Signal encoding

来源：评论

学校读者我要写书评

暂无评论

Can We Improve Meta-Learning Model in Few-Shot Learning by Aligning Data Distributions?

SSRN

引用

SSRN 2023年

作者： Tian, Pinzhuo Li, Wenbin Qi, Lei Yu, Hang Gao, Yang Xie, Shaorong School of Computer Engineering and Science Shanghai University Shanghai200444 China The State Key Laboratory for Novel Software Technology Nanjing University Jiangsu Nanjing210023 China School of Computer Science and Engineering Southeast University Jiangsu Nanjing211189 China

Meta-learning becomes a promising way to solve the few-shot learning problem in recent research. This paradigm mainly relies on hierarchical architecture and episodic training to achieve good generalization on the new learning task. However, as we know, support and query sets in each training task in episodic training only contain a few data points. Too limited training data can lead to data discrepancy between the training and test data which further hurts the performance of learning models in classical supervised and semisupervised learning. Hence, there is an interesting question: Can we also improve the meta-learning model in few-shot learning by aligning the data distributions of support and query sets? In this work, we try to answer this question. Firstly, we give a theoretical analysis of the generalization ability of meta-learning to show that eliminating the data-distribution discrepancy between the support and query sets in each training task can improve the meta-learning model in few-shot learning. Next, we design an experiment to further verify our analysis. The experimental results show that aligning the Preprint submitted to Pattern Recognition December 27, 2022 data distributions is crucial and even can help the learning model trained by the classical batch-based training achieve better performance on unseen few-shot learning tasks. Furthermore, we also propose two simple metabatch normalization methods following our result which can be integrated into recent meta-learning methods to improve their performance in few-shot © 2023, The Authors. All rights reserved.

关键词： Learning systems

来源：评论

学校读者我要写书评

暂无评论

Benchmarking Graph Representations and Graph Neural Networks for Multivariate Time Series Classification

arXiv

引用

arXiv 2025年

作者： Yang, Wennuo Wu, Shiling Zhou, Yuzhi Luo, Cheng He, Xilin Xie, Weicheng Shen, Linlin Song, Siyang Computer Vision Institute School of Computer Science & Software Engineering Shenzhen University China Shenzhen Institute of Artificial Intelligence and Robotics for Society China Guangdong Provincial Key Laboratory of Intelligent Information Processing China HBUG Lab University of Exeter United Kingdom

Multivariate Time Series Classification (MTSC) enables the analysis if complex temporal data, and thus serves as a cornerstone in various real-world applications, ranging from healthcare to finance. Since the relationship among variables in MTS usually contain crucial cues, a large number of graph-based MTSC approaches have been proposed, as the graph topology and edges can explicitly represent relationships among variables (channels), where not only various MTS graph representation learning strategies but also different Graph Neural Networks (GNNs) have been explored. Despite such progresses, there is no comprehensive study that fairly benchmarks and investigates the performances of existing widely-used graph representation learning strategies/GNN classifiers in the application of different MTSC tasks. In this paper, we present the first benchmark which systematically investigates the effectiveness of the widely-used three node feature definition strategies, four edge feature learning strategies and five GNN architecture, resulting in 60 different variants for graph-based MTSC. These variants are developed and evaluated with a standardized data pipeline and training/validation/testing strategy on 26 widely-used suspensor MTSC datasets. Our experiments highlight that node features significantly influence MTSC performance, while the visualization of edge features illustrates why adaptive edge learning outperforms other edge feature learning methods. The code of the proposed benchmark is publicly available at https://***/CVI-yangwn/*** Codes 68T10 © 2025, CC BY.

关键词： Graph neural networks

来源：评论

学校读者我要写书评

暂无评论

AdaAugment: A Tuning-Free and Adaptive Approach to Enhance Data Augmentation

arXiv

引用

arXiv 2024年

作者： Yang, Suorong Li, Peijia Xiong, Xi Shen, Furao Zhao, Jian State Key Laboratory for Novel Software Technology Nanjing University China Department of Computer Science and Technology Nanjing University China School of Artificial Intelligence Nanjing University China School of Electronic Science and Engineering Nanjing University China

Data augmentation (DA) is widely employed to improve the generalization performance of deep models. However, most existing DA methods use augmentation operations with random magnitudes throughout training. While this fosters diversity, it can also inevitably introduce uncontrolled variability in augmented data, which may cause misalignment with the evolving training status of the target models. Both theoretical and empirical findings suggest that this misalignment increases the risks of underfitting and overfitting. To address these limitations, we propose AdaAugment, an innovative and tuning-free Adaptive Augmentation method that utilizes reinforcement learning to dynamically adjust augmentation magnitudes for individual training samples based on real-time feedback from the target network. Specifically, AdaAugment features a dual-model architecture consisting of a policy network and a target network, which are jointly optimized to effectively adapt augmentation magnitudes. The policy network optimizes the variability within the augmented data, while the target network utilizes the adaptively augmented samples for training. Extensive experiments across benchmark datasets and deep architectures demonstrate that AdaAugment consistently outperforms other state-of-the-art DA methods in effectiveness while maintaining remarkable efficiency. Copyright © 2024, The Authors. All rights reserved.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Nerftap: Enhancing Transferability of Adversarial Patches on Face Recognition Using Neural Radiance Fields

SSRN

引用

SSRN 2024年

作者： Liu, Xiaoliang Shen, Fu-Rao Han, Feng Zhao, Jian Nie, Changhai State Key Laboratory for Novel Software Technology Nanjing University China Department of Computer Science and Technology Nanjing University China School of Artificial Intelligence Nanjing University China School of Electronic Science and Engineering Nanjing University China

Face recognition (FR) technology plays a crucial role in various applications, but its vulnerability to adversarial attacks poses significant security concerns. Existing research primarily focuses on transferability to different FR models, overlooking the direct transferability to victim's face images, which is a practical threat in real-world scenarios. In this study, we propose a novel adversarial attack method that considers both the transferability to the FR model and the victim's face image, called NerfTAP. Leveraging Neural Radiance Fields (NeRF)-based 3D Generative Adversarial Network (GAN), we generate new view face images for the source and target subjects to enhance transferability of adversarial patches. We introduce a style consistency loss to ensure the visual similarity between the adversarial UV map and the target UV map under a 0-1 mask, enhancing the effectiveness and naturalness of the generated adversarial face images. Extensive experiments and evaluations on various FR models demonstrate the superiority of our approach over existing attack techniques. Our work provides valuable insights for enhancing the robustness of FR systems in practical adversarial settings. © 2024, The Authors. All rights reserved.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

SPCR: Course resource service platform for computer supported teaching and online learning 16

SPCR: Course resource service platform for computer supporte...

引用

16th IEEE International Conference on computer Science and Education, ICCSE 2021

作者： Zhang, Yujie Meng, Xiangwu Beijing University of Posts and Telecommunications School of Computer Science National Pilot Software Engineering School Beijing China Beijing Key Lab of Intelligent Telecommunications Software and Multimedia Beijing University of Posts and Telecommunications Beijing China

ISBN: (纸本)9781665414685

The emergence of e-learning as well as development of learning management systems (LMSs) provides teachers and students more interactive and convenient environment for courses. However, there are still gaps between the institutional reality and the design requirements of LMSs, which hinders adoption of them on existing courses. This paper proposes our course resource service platform SPCR for supporting interactive and flexible instructional process in courses and presents its modular design of system and applications in courses of the author. Based on the relationships between courses and students from teachers' perspective, SPCR provides extensive functionalities such as courseware and learning material delivery, exchange and sharing mechanism for videos, quiz organization and homework management. Student performance analysis have demonstrated the feasibility and effectiveness of the SPCR platform, while feedback of students also expresses their willingness and engagement in using SPCR. © 2021 IEEE.

关键词： Students

来源：评论

学校读者我要写书评

暂无评论

FuseFPS: Accelerating Farthest Point Sampling with Fusing KD-tree Construction for Point Clouds

arXiv

引用

arXiv 2023年

作者： Han, Meng Wang, Liang Xiao, Limin Zhang, Hao Zhang, Chenhao Xie, Xilong Zheng, Shuai Dong, Jin State Key Laboratory of Software Development Environment School of Computer Science and Engineering Beihang University Beijing100191 China Beijing Academy of Blockchain and Edge Computing China

Point cloud analytics has become a critical workload for embedded and mobile platforms across various applications. Farthest point sampling (FPS) is a fundamental and widely used kernel in point cloud processing. However, the heavy external memory access makes FPS a performance bottleneck for real-time point cloud processing. Although bucket-based farthest point sampling can significantly reduce unnecessary memory accesses during the point sampling stage, the KD-tree construction stage becomes the predominant contributor to execution time. In this paper, we present FuseFPS, an architecture and algorithm co-design for bucket-based farthest point sampling. We first propose a hardware-friendly sampling-driven KD-tree construction algorithm. The algorithm fuses the KD-tree construction stage into the point sampling stage, further reducing memory accesses. Then, we design an efficient accelerator for bucket-based point sampling. The accelerator can offload the entire bucket-based FPS kernel at a low hardware cost. Finally, we evaluate our approach on various point cloud datasets. The detailed experiments show that compared to the state-of-the-art accelerator QuickFPS, FuseFPS achieves about 4.3× and about 6.1× improvements on speed and power efficiency, respectively. Copyright © 2023, The Authors. All rights reserved.

关键词： Trees (mathematics)

来源：评论

学校读者我要写书评

暂无评论

EntAugment: Entropy-Driven Adaptive Data Augmentation Framework for Image Classification

arXiv

引用

arXiv 2024年

作者： Yang, Suorong Shen, Furao Zhao, Jian State Key Laboratory for Novel Software Technology Nanjing University China Department of Computer Science and Technology Nanjing University China School of Artificial Intelligence Nanjing University China School of Electronic Science and Engineering Nanjing University China

Data augmentation (DA) has been widely used to improve the generalization of deep neural networks. While existing DA methods have proven effective, they often rely on augmentation operations with random magnitudes to each sample. However, this approach can inadvertently introduce noise, induce distribution shifts, and increase the risk of overfitting. In this paper, we propose EntAugment, a tuning-free and adaptive DA framework. Unlike previous work, EntAugment dynamically assesses and adjusts the augmentation magnitudes for each sample during training, leveraging insights into both the inherent complexities of training samples and the evolving status of deep models. Specifically, in EntAugment, the magnitudes are determined by the information entropy derived from the probability distribution obtained by applying the softmax function to the model’s output. In addition, to further enhance the efficacy of EntAugment, we introduce a novel entropy regularization term, EntLoss, which complements the EntAugment approach. Theoretical analysis further demonstrates that EntLoss, compared to traditional cross-entropy loss, achieves closer alignment between the model distributions and underlying dataset distributions. Moreover, EntAugment and EntLoss can be utilized separately or jointly. We conduct extensive experiments across multiple image classification tasks and network architectures with thorough comparisons of existing DA methods. Importantly, the proposed methods outperform others without introducing any auxiliary models or noticeable extra computational costs, highlighting both effectiveness and efficiency. Code is available at https://***/Jackbrocp/EntAugment. Copyright © 2024, The Authors. All rights reserved.

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

UncTrack: Reliable Visual Object Tracking with Uncertainty-Aware Prototype Memory Network

arXiv

引用

arXiv 2025年

作者： Yao, Siyuan Guo, Yang Yan, Yanyang Ren, Wenqi Cao, Xiaochun School of Computer Science National Pilot Software Engineering School Beijing University of Posts and Telecommunications Beijing100876 China State Key Lab of Processors Institute of Computing Technology Chinese Academy of Sciences Beijing100190 China School of Cyber Science and Technology Sun Yat-sen University Shenzhen Campus Shenzhen518107 China

Transformer-based trackers have achieved promising success and become the dominant tracking paradigm due to their accuracy and efficiency. Despite the substantial progress, most of the existing approaches tackle object tracking as a deterministic coordinate regression problem, while the target localization uncertainty has been greatly overlooked, which hampers trackers’ ability to maintain reliable target state prediction in challenging scenarios. To address this issue, we propose UncTrack, a novel uncertainty-aware transformer tracker that predicts the target localization uncertainty and incorporates this uncertainty information for accurate target state inference. Specifically, UncTrack utilizes a transformer encoder to perform feature interaction between template and search images. The output features are passed into an uncertainty-aware localization decoder (ULD) to coarsely predict the corner-based localization and the corresponding localization uncertainty. Then the localization uncertainty is sent into a prototype memory network (PMN) to excavate valuable historical information to identify whether the target state prediction is reliable or not. To enhance the template representation, the samples with high confidence are fed back into the prototype memory bank for memory updating, making the tracker more robust to challenging appearance variations. Extensive experiments demonstrate that our method outperforms other state-of-the-art methods. Our code is available at https://***/ManOfStory/UncTrack. Copyright © 2025, The Authors. All rights reserved.

关键词： Object tracking

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：