检索结果-内蒙古大学图书馆

Taming Consistency Distillation for Accelerated Human image Animation

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wang, Xiang Zhang, Shiwei Yuan, Hangjie Wei, Yujie Zhang, Yingya Gao, Changxin Wang, Yuehuan Sang, Nong Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Alibaba Group China Fudan University China

Recent advancements in human image animation have been propelled by video diffusion models, yet their reliance on numerous iterative denoising steps results in high inference costs and slow speeds. An intuitive solution involves adopting consistency models, which serve as an effective acceleration paradigm through consistency distillation. However, simply employing this strategy in human image animation often leads to quality decline, including visual blurring, motion degradation, and facial distortion, particularly in dynamic regions. In this paper, we propose the DanceLCM approach complemented by several enhancements to improve visual quality and motion continuity at low-step regime: (1) segmented consistency distillation with an auxiliary light-weight head to incorporate supervision from real video latents, mitigating cumulative errors resulting from single full-trajectory generation;(2) a motion-focused loss to centre on motion regions, and explicit injection of facial fidelity features to improve face authenticity. Extensive qualitative and quantitative experiments demonstrate that DanceLCM achieves results comparable to state-of-the-art video diffusion models with a mere 2-4 inference steps, significantly reducing the inference burden without compromising video quality. The code and models will be made publicly available. Copyright © 2025, The Authors. All rights reserved.

关键词：

A Game Theory-Reinforcement Learning Approach to Cooperation for UAVs

学校读者我要写书评

暂无评论

IEEE Transactions on Vehicular Technology 2025年

作者： Tang, Changbing Pan, Linchao Chen, Jie Liu, Yang Lai, Jingang The College of Physics and Electronic Information Engineering Zhejiang Normal University Jinhua321004 China The School of Mathematical Sciences Zhejiang Normal University Jinhua321004 China The Hangzhou School of Automation Zhejiang Normal University Hangzhou311231 China The College of Electronic Engineering National University of Defense Technology Hefei230037 China The School of Artificial Intelligence and Automation the Key Laboratory of Image Processing and Intelligent Control Education Ministry of China China Huazhong University of Science and Technology Wuhan430074 China

To execute a variety of collaborative tasks, the cooperation for unmanned aerial vehicles (UAVs) with complicated interactions under dynamic environments is a challenging and critical issue. This paper studies the cooperation issue for UAVs under dynamic environments through an approach of game theory-reinforcement learning (GT-RL) approach, which combines the advantages of both game theory and reinforcement learning. First, to cope with the complicated interactions of UAVs, the cluster of UAVs is modeled as a public goods game with asymmetrical environmental feedback. Then, reinforcement learning is adopted to optimize decision-making of UAVs under unknown and dynamic environments through comparing the dynamic behaviors of UAVs, where a novel dynamics system offers a more comprehensive understanding on cooperative behavior among UAVs. Finally, the simulation results show that the GT-RL approach can effectively promote cooperation among UAVs in completing the collaborative tasks. © 1967-2012 IEEE.

关键词： Adversarial machine learning

Channel Reflection: Knowledge-Driven Data Augmentation for Eeg-Based Bcis

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Wang, Ziwei Li, Siyang Luo, Jingwei Liu, Jiajing Wu, Dongrui Key Laboratory of the Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Shenzhen Huazhong University of Science and Technology Research Institute Shenzhen518063 China China Electronic System Technology Co. Ltd. Beijing100089 China School of Civil and Hydraulic Engineering Huazhong University of Science and Technology Wuhan430074 China

A brain-computer interface (BCI) enables direct communication between the human brain and external devices. Electroencephalography (EEG) based BCIs are currently the most popular for able-bodied users. To increase user-friendliness, usually a small amount of user-specific EEG data are used for calibration, which may not be enough to develop a pure data-driven decoding model. To cope with this typical calibration data shortage challenge in EEG-based BCIs, this paper proposes a parameter-free channel reflection (CR) data augmentation approach that incorporates prior knowledge on the channel distributions of different BCI paradigms in data augmentation. Experiments on eight public EEG datasets across four different BCI paradigms (motor imagery, steady-state visual evoked potential, P300, and seizure classifications) using different decoding algorithms demonstrated that: 1) CR is effective, i.e., it can noticeably improve the classification accuracy;2) CR is robust, i.e., it consistently outperforms other data augmentation approaches in the literature;and, 3) CR is flexible, i.e., it can be combined with other data augmentation approaches to further increase the performance. We suggest that data augmentation approaches like CR should be an essential step in EEG-based BCIs. Our code is available online. © 2024, The Authors. All rights reserved.

关键词： Electroencephalography

Named Entity Recognition Based on Anchor Span for Manufacturing Text Knowledge Extraction

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Li, Yahui Sun, Qi Zhou, Chunjie Liu, Lu Tian, Yu-Chu School of Artificial Intelligence and Automation Huazhong University of Science and Technology Hubei Wuhan430074 China Key Laboratory of Image Processing and Intelligent Control Ministry of Education Huazhong University of Science and Technology Hubei Wuhan430074 China School of Cyber Science and Engineering Huazhong University of Science and Technology Hubei Wuhan430074 China School of Computer Science Queensland University of Technology BrisbaneQLD4001 Australia

Intelligent industrial manufacturing heavily relies on structured knowledge. Named Entity Recognition (NER), an essential technique for extracting structured knowledge from text, has garnered significant research interest. However, current NER approaches face difficulties in handling multiple levels of entity nesting in knowledge extraction, especially within the manufacturing context. To address this issue, we present an Anchor Span-based NER (ASNER) approach for accurately and efficiently extracting manufacturing text knowledge. This method combines token and span classification. Initially, the head and tail features of the entity are extracted, with the corresponding anchor span of potential entities generated based on a boundary match neural network to localize the entities. Subsequently, token spatial contextual features are extracted using biaffine attention and convolutional neural networks, and classification categories are assigned to the anchor span-filtered entity features. Experimental studies demonstrate the effectiveness of the proposed ASNER approach. © 2024, The Authors. All rights reserved.

关键词： Character recognition

Continuous Cross-resolution Remote Sensing image Change Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Chen, Hao Zhang, Haotian Chen, keyan Zhou, Chenyao Chen, Song Zou, Zhengxia Shi, Zhenwei The Image Processing Center School of Astronautics Beihang University Beijing100191 China The Beijing Key Laboratory of Digital Media Beihang University Beijing100191 China The State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing100191 China The Shanghai Artificial Intelligence Laboratory Shanghai200232 China The Department of Journalism and Communications Jeonuk National University Jeonju-Si54896 Korea Republic of The Department of Guidance Navigation and Control School of Astronautics Beihang University Beijing100191 China

Most contemporary supervised Remote Sensing (RS) image Change Detection (CD) approaches are customized for equal-resolution bitemporal images. Real-world applications raise the need for cross-resolution change detection, aka, CD based on bitemporal images with different spatial resolutions. Given training samples of a fixed bitemporal resolution difference (ratio) between the high-resolution (HR) image and the low-resolution (LR) one, current cross-resolution methods may fit a certain ratio but lack adaptation to other resolution differences. Toward continuous cross-resolution CD, we propose scale-invariant learning to enforce the model consistently predicting HR results given synthesized samples of varying resolution differences. Concretely, we synthesize blurred versions of the HR image by random downsampled reconstructions to reduce the gap between HR and LR images. We introduce coordinate-based representations to decode per-pixel predictions by feeding the coordinate query and corresponding multi-level embedding features into an MLP that implicitly learns the shape of land cover changes, therefore benefiting recognizing blurred objects in the LR image. Moreover, considering that spatial resolution mainly affects the local textures, we apply local-window self-attention to align bitemporal features during the early stages of the encoder. Extensive experiments on two synthesized and one real-world different-resolution CD datasets verify the effectiveness of the proposed method. Our method significantly outperforms several vanilla CD methods and two cross-resolution CD methods on the three datasets both in in-distribution and out-of-distribution settings. The empirical results suggest that our method could yield relatively consistent HR change predictions regardless of varying bitemporal resolution ratios. Our code is available at https://***/justchenhao/SILI_CD. Copyright © 2023, The Authors. All rights reserved.

关键词： Change detection

Infectious Probability Analysis on COVID-19 Spreading with Wireless Edge Networks

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Xuran Guo, Shuaishuai Dai, Hong-Ning Li, Dengwang Shandong Key Laboratory of Medical Physics and Image Processing School of Physics and Electronics Shandong Normal University Jinan250061 China School of Control Science and Engineering Shandong University Jinan250061 China Shandong Provincial Key Laboratory of Wireless Communication Technologies Jinan China The Department of Computer Science Hong Kong Baptist University Hong Kong

The emergence of infectious disease COVID-19 has challenged and changed the world in an unprecedented manner. The integration of wireless networks with edge computing (namely wireless edge networks) brings opportunities to address this crisis. In this paper, we aim to investigate the prediction of the infectious probability and propose precautionary measures against COVID-19 with the assistance of wireless edge networks. Due to the availability of the recorded detention time and the density of individuals within a wireless edge network, we propose a stochastic geometry-based method to analyze the infectious probability of individuals. The proposed method can well keep the privacy of individuals in the system since it does not require to know the location or trajectory of each individual. Moreover, we also consider three types of mobility models and the static model of individuals. Numerical results show that analytical results well match with simulation results, thereby validating the accuracy of the proposed model. Moreover, numerical results also offer many insightful implications. Thereafter, we also offer a number of countermeasures against the spread of COVID-19 based on wireless edge networks. This study lays the foundation toward predicting the infectious risk in realistic environment and points out directions in mitigating the spread of infectious diseases with the aid of wireless edge networks. Copyright © 2022, The Authors. All rights reserved.

关键词： Stochastic systems

Improved black-box attack based on query and perturbation distribution

学校读者我要写书评

暂无评论

Improved black-box attack based on query and perturbation di...

International Workshop on Advanced Computational Intelligence (IWACI)

作者： Weiwei Zhao Zhigang Zeng School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Wuhan China

Adversarial examples cause the deep neural network prediction error, which is a great threat to the deep neural network. How to generate more natural adversarial examples and improve the robustness of deep neural networks has received attention. In this paper, we propose an improved blackbox attack (IBBA) algorithm based on query and perturbation distribution. This algorithm only needs the top-l label of the attacked model to generate the adversarial examples. Based on the existing black-box attacks, we optimize the performance of the algorithm from two aspects: query distribution and perturbation distribution. In the aspect of query distribution, we adopt different strategies for nontargeted attack and targeted attack; in the aspect of perturbation distribution, we choose different low-frequency noise according to the difference between the targeted attack and nontargeted attack. The experimental results on imageNet show that the proposed algorithm is better than the existing algorithms in low query number, and the targeted attack is better in each specified query number.

关键词： Perturbation methods Neural networks Prediction algorithms Robustness Low-frequency noise Discrete cosine transforms Computational intelligence

Modality-aware triplet hard mining for zero-shot sketch-based image retrieval

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Huang, Zongheng Sun, Yifan Han, Chuchu Gao, Changxin Sang, Nong Key Laboratory of Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Baidu Research United States

This paper tackles the Zero-Shot Sketch-Based image Retrieval (ZS-SBIR) problem from the viewpoint of cross-modality metric learning. This task has two characteristics: 1) the zero-shot setting requires a metric space with good within-class compactness and the between-class discrepancy for recognizing the novel classes and 2) the sketch query and the photo gallery are in different modalities. The metric learning viewpoint benefits ZS-SBIR from two aspects. First, it facilitates improvement through recent good practices in deep metric learning (DML). By combining two fundamental learning approaches in DML, e.g., classification training and pairwise training, we set up a strong baseline for ZS-SBIR. Without bells and whistles, this baseline achieves competitive retrieval accuracy. Second, it provides an insight that properly suppressing the modality gap is critical. To this end, we design a novel method named Modality-Aware Triplet Hard Mining (MATHM). MATHM enhances the baseline with three types of pairwise learning, e.g., a cross-modality sample pair, a within-modality sample pair, and their combination. We also design an adaptive weighting method to balance these three components during training dynamically. Experimental results confirm that MATHM brings another round of significant improvement based on the strong baseline and sets up new state-of-the-art performance. For example, on the TU-Berlin dataset, we achieve 47.88+2.94% mAP@all and 58.28+2.34% Prec@100. Code will be publicly available. Copyright © 2021, The Authors. All rights reserved.

关键词： Deep learning

UniAnimate-DiT: Human image Animation with Large-Scale Video Diffusion Transformer

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wang, Xiang Zhang, Shiwei Tang, Longxiang Zhang, Yingya Gao, Changxin Wang, Yuehuan Sang, Nong Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology United States Alibaba Group China Tsinghua University China

This report presents UniAnimate-DiT, an advanced project that leverages the cutting-edge and powerful capabilities of the open-source Wan2.1 model for consistent human image animation. Specifically, to preserve the robust generative capabilities of the original Wan2.1 model, we implement Low-Rank Adaptation (LoRA) technique to fine-tune a minimal set of parameters, significantly reducing training memory overhead. A lightweight pose encoder consisting of multiple stacked 3D convolutional layers is designed to encode motion information of driving poses. Furthermore, we adopt a simple concatenation operation to integrate the reference appearance into the model and incorporate the pose information of the reference image for enhanced pose alignment. Experimental results show that our approach achieves visually appearing and temporally consistent high-fidelity animations. Trained on 480p (832x480) videos, UniAnimate-DiT demonstrates strong generalization capabilities to seamlessly upscale to 720P (1280x720) during inference. The training and inference code is publicly available at https://github. com/ali-vilab/UniAnimate-DiT. Copyright © 2025, The Authors. All rights reserved.

关键词：