检索结果-内蒙古大学图书馆

Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysis

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Chenyang Chen, keyan Zhang, Haotian Qi, Zipeng Zou, Zhengxia Shi, Zhenwei The Image Processing Center School of Astronautics Beihang University Beijing100191 China The Beijing Key Laboratory of Digital Media Beihang University Beijing100191 China The State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing100191 China The Shanghai Artificial Intelligence Laboratory Shanghai200232 China Shen Yuan Honors College of Beihang University Beijing100191 China The Department of Guidance Navigation and Control School of Astronautics Beihang University Beijing100191 China Shanghai Artificial Intelligence Laboratory Shanghai200232 China

Monitoring changes in the Earth’s surface is crucial for understanding natural processes and human impacts, necessitating precise and comprehensive interpretation methodologies. Remote sensing satellite imagery offers a unique perspective for monitoring these changes, leading to the emergence of remote sensing image change interpretation (RSICI) as a significant research focus. Current RSICI technology encompasses change detection and change captioning, each with its limitations in providing comprehensive interpretation. To address this, we propose an interactive Change-Agent, which can follow user instructions to achieve comprehensive change interpretation and insightful analysis, such as change detection and change captioning, change object counting, change cause analysis, etc. The Change-Agent integrates a multi-level change interpretation (MCI) model as the eyes and a large language model (LLM) as the brain. The MCI model contains two branches of pixel-level change detection and semantic-level change captioning, in which the BI-temporal Iterative Interaction (BI3) layer is proposed to enhance the model’s discriminative feature representation capabilities. To support the training of the MCI model, we build the LEVIR-MCI dataset with a large number of change masks and captions of changes. Experiments demonstrate the SOTA performance of the MCI model in achieving both change detection and change description simultaneously, and highlight the promising application value of our Change-Agent in facilitating comprehensive interpretation of surface changes, which opens up a new avenue for intelligent remote sensing applications. © 2024, CC BY.

关键词： Change detection

Global Consensus for Heterogeneous Saturated Multi-Agent Systems via Sampled-Data control

学校读者我要写书评

暂无评论

Global Consensus for Heterogeneous Saturated Multi-Agent Sys...

IEEE Conference on Decision and control

作者： Juan Qian Xiaoling Wang Daniele Astolfi Housheng Su Guo-Ping Jiang College of Automation and the College of Artificial Intelligence Nanjing University of Posts and Telecommunications Nanjing China Jiangsu Engineering Center for IOT Intelligent Robots(IOTRobot) Nanjing China CNRS LAGEPP UMR 5007 43 boulevard du 11 novembre 1918 Université Claude Bernard Lyon 1 Villeurbanne France Key Laboratory of Smart Manufacturing in Energy Chemical Process Ministry of Education East China University of Science and Technology Shanghai China School of Artificial Intelligence and Automation Image Processing and Intelligent Control Key Laboratory of Education Ministry of China Huazhong University of Science and Technology Luoyu Road 1037 Wuhan China

ISBN: (数字)9798350316339

ISBN: (纸本)9798350316346

This paper addresses the global consensus problem for multi-input multi-output saturated systems within a sampled-data framework, aiming to advance global consensus, manage heterogeneous actuator saturation across components, and preserve distributed characteristics by using sampled-data feedback. We propose a distributed control algorithm that incorporates a redesigned saturation function, represented as decentralized dynamic saturation levels. These levels for each agent’s dimensions are autonomously updated through an adaptive strategy, which mitigates heterogeneous saturation by carefully selecting constant and time-varying saturation parameters in it. Lyapunov analysis proves that global consensus can be achieved under the proposed control law, provided the sampling periods of all agents remain below a calculated threshold. An example is given to demonstrate the effectiveness of this approach.

关键词： Actuators Upper bound Heuristic algorithms Decentralized control Multi-agent systems

Improved black-box attack based on query and perturbation distribution

学校读者我要写书评

暂无评论

Improved black-box attack based on query and perturbation di...

International Workshop on Advanced Computational Intelligence (IWACI)

作者： Weiwei Zhao Zhigang Zeng School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Wuhan China

Adversarial examples cause the deep neural network prediction error, which is a great threat to the deep neural network. How to generate more natural adversarial examples and improve the robustness of deep neural networks has received attention. In this paper, we propose an improved blackbox attack (IBBA) algorithm based on query and perturbation distribution. This algorithm only needs the top-l label of the attacked model to generate the adversarial examples. Based on the existing black-box attacks, we optimize the performance of the algorithm from two aspects: query distribution and perturbation distribution. In the aspect of query distribution, we adopt different strategies for nontargeted attack and targeted attack; in the aspect of perturbation distribution, we choose different low-frequency noise according to the difference between the targeted attack and nontargeted attack. The experimental results on imageNet show that the proposed algorithm is better than the existing algorithms in low query number, and the targeted attack is better in each specified query number.

关键词： Perturbation methods Neural networks Prediction algorithms Robustness Low-frequency noise Discrete cosine transforms Computational intelligence

Modality-aware triplet hard mining for zero-shot sketch-based image retrieval

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Huang, Zongheng Sun, Yifan Han, Chuchu Gao, Changxin Sang, Nong Key Laboratory of Ministry of Education for Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology China Baidu Research United States

This paper tackles the Zero-Shot Sketch-Based image Retrieval (ZS-SBIR) problem from the viewpoint of cross-modality metric learning. This task has two characteristics: 1) the zero-shot setting requires a metric space with good within-class compactness and the between-class discrepancy for recognizing the novel classes and 2) the sketch query and the photo gallery are in different modalities. The metric learning viewpoint benefits ZS-SBIR from two aspects. First, it facilitates improvement through recent good practices in deep metric learning (DML). By combining two fundamental learning approaches in DML, e.g., classification training and pairwise training, we set up a strong baseline for ZS-SBIR. Without bells and whistles, this baseline achieves competitive retrieval accuracy. Second, it provides an insight that properly suppressing the modality gap is critical. To this end, we design a novel method named Modality-Aware Triplet Hard Mining (MATHM). MATHM enhances the baseline with three types of pairwise learning, e.g., a cross-modality sample pair, a within-modality sample pair, and their combination. We also design an adaptive weighting method to balance these three components during training dynamically. Experimental results confirm that MATHM brings another round of significant improvement based on the strong baseline and sets up new state-of-the-art performance. For example, on the TU-Berlin dataset, we achieve 47.88+2.94% mAP@all and 58.28+2.34% Prec@100. Code will be publicly available. Copyright © 2021, The Authors. All rights reserved.

关键词： Deep learning

Dual-Camera All-in-Focus Neural Radiance Fields

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Luo, Xianrui Wu, Zijin Peng, Juewen Sun, Huiqiang Cao, Zhiguo Lin, Guosheng Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Singapore639798 Singapore

We present the first framework capable of synthesizing the all-in-focus neural radiance field (NeRF) from inputs without manual refocusing. Without refocusing, the camera will automatically focus on the fixed object for all views, and current NeRF methods typically using one camera fail due to the consistent defocus blur and a lack of sharp reference. To restore the all-in-focus NeRF, we introduce the dual-camera from smartphones, where the ultra-wide camera has a wider depth-of-field (DoF) and the main camera possesses a higher resolution. The dual camera pair saves the high-fidelity details from the main camera and uses the ultra-wide camera’s deep DoF as reference for all-in-focus restoration. To this end, we first implement spatial warping and color matching to align the dual camera, followed by a defocus-aware fusion module with learnable defocus parameters to predict a defocus map and fuse the aligned camera pair. We also build a multi-view dataset that includes image pairs of the main and ultra-wide cameras in a smartphone. Extensive experiments on this dataset verify that our solution, termed DC-NeRF, can produce high-quality all-in-focus novel views and compares favorably against strong baselines quantitatively and qualitatively. We further show DoF applications of DC-NeRF with adjustable blur intensity and focal plane, including refocusing and split diopter. Copyright © 2025, The Authors. All rights reserved.

关键词：

UniAnimate-DiT: Human image Animation with Large-Scale Video Diffusion Transformer

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wang, Xiang Zhang, Shiwei Tang, Longxiang Zhang, Yingya Gao, Changxin Wang, Yuehuan Sang, Nong Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology United States Alibaba Group China Tsinghua University China

This report presents UniAnimate-DiT, an advanced project that leverages the cutting-edge and powerful capabilities of the open-source Wan2.1 model for consistent human image animation. Specifically, to preserve the robust generative capabilities of the original Wan2.1 model, we implement Low-Rank Adaptation (LoRA) technique to fine-tune a minimal set of parameters, significantly reducing training memory overhead. A lightweight pose encoder consisting of multiple stacked 3D convolutional layers is designed to encode motion information of driving poses. Furthermore, we adopt a simple concatenation operation to integrate the reference appearance into the model and incorporate the pose information of the reference image for enhanced pose alignment. Experimental results show that our approach achieves visually appearing and temporally consistent high-fidelity animations. Trained on 480p (832x480) videos, UniAnimate-DiT demonstrates strong generalization capabilities to seamlessly upscale to 720P (1280x720) during inference. The training and inference code is publicly available at https://github. com/ali-vilab/UniAnimate-DiT. Copyright © 2025, The Authors. All rights reserved.

关键词：

Prognostic Prediction for Non-small-Cell Lung Cancer Based on Deep Neural Network and Multimodal Data 17th

学校读者我要写书评

暂无评论

Prognostic Prediction for Non-small-Cell Lung Cancer Based o...

17th International Conference on intelligent Computing, ICIC 2021

作者： Zhang, Zhong-Si Xu, Fei Jiang, Han-Jing Chen, Zhan-Heng Key Laboratory of Image Information Processing and Intelligent Control of Education Ministry of China Institute of Artificial Intelligence School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Institute of Machine Learning and Systems Biology School of Electronics and Information Engineering Tongji University No. 4800 Caoan Road Shanghai201804 China

ISBN: (纸本)9783030845315

Non-small-cell lung cancer (NSCLC) is the most common lung cancer with poor prognosis. Prognostic prediction is significant in improving the prognosis of NSCLC patients. Clinical information and multi-omics data including gene expression, miRNA, copy number variations, and DNA methylation are closely related to NSCLC prognosis. In this study, we propose a deep neural network to conduct prognostic prediction for NSCLC patients based on all five types of data. Given the high dimensional features of the omics data, past works reduce the feature dimension by regression analysis or correlation sorting algorithms. A shortcoming of these methods is that only a small number of features are considered. To overcome it, we propose a convolution neural network-based feature transformation method, which considers all features and extracts the abstract representations of the omics data. Based on the representations, we predict the five-year survival status of NSCLC patients. The results show that our method achieves a more precise prediction than previous work, with the areas under the curve improved from 0.8163 to 0.8508 and the accuracy improved from 0.7544 to 0.8096. © 2021, Springer Nature Switzerland AG.

关键词： Forecasting

Prediction of Drug-Disease Associations Based on Long Short-Term Memory Network and Gaussian Interaction Profile Kernel 15th

学校读者我要写书评

暂无评论

Prediction of Drug-Disease Associations Based on Long Short-...

15th International Conference on Bio-Inspired Computing: Theories and Applications, BIC-TA 2020

作者： Jiang, Han-Jing Wang, Yan-Bin Huang, Yabing Key Laboratory of Image Information Processing and Intelligent Control of Education Ministry of China Institute of Artificial Intelligence School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China College of Computer Science and Technology Zhejiang University Hangzhou315000 China Department of Pathology Renmin Hospital of Wuhan University Wuhan430060 China

ISBN: (纸本)9789811613531

Drug-disease association depicts the accessibility landscape of the association at the molecular level, thereby revealing the intermolecular reaction in the process of drug reposition. However, the scarcity of drug-disease association data often complicates the drug reposition. In this work, we present a method for predicting drug-disease association, which is called drug-disease association prediction via Gaussian interaction profile kernel and long short-term memory network (G-LSTM). G-LSTM combines a recurrent network framework with a Gaussian interaction profile kernel to learn underlying features that accurately characterize drug-disease-association data. We have verified G-LSTM models on the two benchmark datasets Fdataset and Cdataset, respectively. The experimental results show that the predictive performance was significantly improved, with AUC of 0.9527 and 0.9705, respectively. © 2021, Springer Nature Singapore Pte Ltd.

关键词： Long short-term memory

Source-free Unsupervised Domain Adaptation for Privacy-Preserving intelligent Fault Diagnosis

学校读者我要写书评

暂无评论

Source-free Unsupervised Domain Adaptation for Privacy-Prese...

Sensing, Measurement & Data Analytics in the era of Artificial Intelligence (ICSMD), International Conference on

作者： Mengliang Zhu Xiangyu Zeng Jie Liu Kaibo Zhou MOE Key Laboratory of Image Information Processing and Intelligent Control School of Artificial Huazhong University of Science and Technology Wuhan P. R. China School of Civil and Hydraulic Engineering Huazhong University of Science and Technology Wuhan P. R. China

Rolling bearing is of vital significance in industrial applications and intelligent fault diagnosis (IFD) have been widely exploited in this field. However, cross-machine variations hinder the model performance across different machines in varying working conditions. To solve this issue, many unsupervised domain adaptation (UDA) approaches have been proposed recently, requiring direct access to the fully labeled source domain. However, privacy concerns are raised in traditional UDA scenario, since raw signals contain various private information. To address this issue, the source-free unsupervised domain adaptation (SFUDA) scenario is considered, where only the pre-trained source model is required, instead of the fully labeled source domain. In this paper, a SFUDA approach for intelligent fault diagnosis (IFD) is proposed. It consists of two steps: 1) source model generalization, where virtual adversarial training, R-Drop and label smoothing techniques are adopted to improve the generalization ability of the source model; and 2) target model adaptation, where information maximization is used for cluster assumption and mean teacher training paradigm is utilized to alleviate the catastrophic forgetting phenomenon. The proposed approach is verified on the Case Western Reserve University (CWRU) dataset. Experimental results on the show that the proposed SFUDA approach outperforms several typical UDA approaches, and its effectiveness is verified.

关键词： Fault diagnosis Training Employee welfare Adaptation models Privacy Smoothing methods Data analysis