检索结果-内蒙古大学图书馆

Continuous Cross-resolution Remote Sensing image Change Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Chen, Hao Zhang, Haotian Chen, keyan Zhou, Chenyao Chen, Song Zou, Zhengxia Shi, Zhenwei The Image Processing Center School of Astronautics Beihang University Beijing100191 China The Beijing Key Laboratory of Digital Media Beihang University Beijing100191 China The State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing100191 China The Shanghai Artificial Intelligence Laboratory Shanghai200232 China The Department of Journalism and Communications Jeonuk National University Jeonju-Si54896 Korea Republic of The Department of Guidance Navigation and Control School of Astronautics Beihang University Beijing100191 China

Most contemporary supervised Remote Sensing (RS) image Change Detection (CD) approaches are customized for equal-resolution bitemporal images. Real-world applications raise the need for cross-resolution change detection, aka, CD based on bitemporal images with different spatial resolutions. Given training samples of a fixed bitemporal resolution difference (ratio) between the high-resolution (HR) image and the low-resolution (LR) one, current cross-resolution methods may fit a certain ratio but lack adaptation to other resolution differences. Toward continuous cross-resolution CD, we propose scale-invariant learning to enforce the model consistently predicting HR results given synthesized samples of varying resolution differences. Concretely, we synthesize blurred versions of the HR image by random downsampled reconstructions to reduce the gap between HR and LR images. We introduce coordinate-based representations to decode per-pixel predictions by feeding the coordinate query and corresponding multi-level embedding features into an MLP that implicitly learns the shape of land cover changes, therefore benefiting recognizing blurred objects in the LR image. Moreover, considering that spatial resolution mainly affects the local textures, we apply local-window self-attention to align bitemporal features during the early stages of the encoder. Extensive experiments on two synthesized and one real-world different-resolution CD datasets verify the effectiveness of the proposed method. Our method significantly outperforms several vanilla CD methods and two cross-resolution CD methods on the three datasets both in in-distribution and out-of-distribution settings. The empirical results suggest that our method could yield relatively consistent HR change predictions regardless of varying bitemporal resolution ratios. Our code is available at https://***/justchenhao/SILI_CD. Copyright © 2023, The Authors. All rights reserved.

关键词： Change detection

CancerUniT: Towards a Single Unified Model for Effective Detection, Segmentation, and Diagnosis of Eight Major Cancers Using a Large Collection of CT Scans

学校读者我要写书评

暂无评论

CancerUniT: Towards a Single Unified Model for Effective Det...

International Conference on Computer Vision (ICCV)

作者： Jieneng Chen Yingda Xia Jiawen Yao Ke Yan Jianpeng Zhang Le Lu Fakai Wang Bo Zhou Mingyan Qiu Qihang Yu Mingze Yuan Wei Fang Yuxing Tang Minfeng Xu Jian Zhou Yuqian Zhao Qifeng Wang Xianghua Ye Xiaoli Yin Yu Shi Xin Chen Jingren Zhou Alan Yuille Zaiyi Liu Ling Zhang DAMO Academy Alibaba Group Johns Hopkins University Hupan Lab Hangzhou China Sun Yat-Sen University Cancer Center Sichuan Cancer Hospital The First Affiliated Hospital of Zhejiang University Shengjing Hospital of China Medical University Guangdong Provincial People’s Hospital Guangdong Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application

Human readers or radiologists routinely perform full-body multi-organ multi-disease detection and diagnosis in clinical practice, while most medical AI systems are built to focus on single organs with a narrow list of a few diseases. This might severely limit AI’s clinical adoption. A certain number of AI models need to be assembled nontrivially to match the diagnostic process of a human reading a CT scan. In this paper, we construct a Unified Tumor Transformer (CancerUniT) model to jointly detect tumor existence & location and diagnose tumor characteristics for eight major cancers in CT scans. CancerUniT is a query-based Mask Transformer model with the output of multi-tumor prediction. We decouple the object queries into organ queries, tumor detection queries and tumor diagnosis queries, and further establish hierarchical relationships among the three groups. This clinically-inspired architecture effectively assists inter- and intra-organ representation learning of tumors and facilitates the resolution of these complex, anatomically related multi-organ cancer image reading tasks. CancerUniT is trained end-to-end using a curated large-scale CT images of 10,042 patients including eight major types of cancers and occurring non-cancer tumors (all are pathology-confirmed with 3D tumor masks annotated by radiologists). On the test set of 631 patients, CancerUniT has demonstrated strong performance under a set of clinically relevant evaluation metrics, substantially outperforming both multi-disease methods and an assembly of eight single-organ expert models in tumor detection, segmentation, and diagnosis. This moves one step closer towards a universal high performance cancer screening tool.

关键词：

Treatment Outcome Prediction for Intracerebral Hemorrhage via Generative Prognostic Model with Imaging and Tabular Data

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Ma, Wenao Chen, Cheng Abrigo, Jill Mak, Calvin Hoi-Kwan Gong, Yuqi Chan, Nga Yan Han, Chu Liu, Zaiyi Dou, Qi Department of Computer Science and Engineering The Chinese University of Hong Kong Hong Kong Center for Advanced Medical Computing and Analysis Harvard Medical School Boston United States Department of Imaging and Interventional Radiology The Chinese University of Hong Kong Hong Kong Department of Neurosurgery Queen Elizabeth Hospital Hong Kong Southern Medical University Guangzhou China Guangdong Provincial Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application Guangzhou China

Intracerebral hemorrhage (ICH) is the second most common and deadliest form of stroke. Despite medical advances, predicting treatment outcomes for ICH remains a challenge. This paper proposes a novel prognostic model that utilizes both imaging and tabular data to predict treatment outcome for ICH. Our model is trained on observational data collected from non-randomized controlled trials, providing reliable predictions of treatment success. Specifically, we propose to employ a variational autoencoder model to generate a low-dimensional prognostic score, which can effectively address the selection bias resulting from the non-randomized controlled trials. Importantly, we develop a variational distributions combination module that combines the information from imaging data, non-imaging clinical data, and treatment assignment to accurately generate the prognostic score. We conducted extensive experiments on a real-world clinical dataset of intracerebral hemorrhage. Our proposed method demonstrates a substantial improvement in treatment outcome prediction compared to existing state-of-the-art approaches. Code is available at https://***/med-air/TOP-GPM. Copyright © 2023, The Authors. All rights reserved.

关键词： Forecasting

UniAnimate-DiT: Human image Animation with Large-Scale Video Diffusion Transformer

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wang, Xiang Zhang, Shiwei Tang, Longxiang Zhang, Yingya Gao, Changxin Wang, Yuehuan Sang, Nong Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology United States Alibaba Group China Tsinghua University China

This report presents UniAnimate-DiT, an advanced project that leverages the cutting-edge and powerful capabilities of the open-source Wan2.1 model for consistent human image animation. Specifically, to preserve the robust generative capabilities of the original Wan2.1 model, we implement Low-Rank Adaptation (LoRA) technique to fine-tune a minimal set of parameters, significantly reducing training memory overhead. A lightweight pose encoder consisting of multiple stacked 3D convolutional layers is designed to encode motion information of driving poses. Furthermore, we adopt a simple concatenation operation to integrate the reference appearance into the model and incorporate the pose information of the reference image for enhanced pose alignment. Experimental results show that our approach achieves visually appearing and temporally consistent high-fidelity animations. Trained on 480p (832x480) videos, UniAnimate-DiT demonstrates strong generalization capabilities to seamlessly upscale to 720P (1280x720) during inference. The training and inference code is publicly available at https://github. com/ali-vilab/UniAnimate-DiT. Copyright © 2025, The Authors. All rights reserved.

关键词：

Sample Weighted Gradient Regularization for Source-Free Domain Adaptation

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Long, Yunchong Xu, Bingrong Zhang, Qingyong Yin, Jianhua Zeng, Zhigang School of Automation Wuhan University of Technology Wuhan430070 China Intelligent Transportation Systems Research Center Wuhan University of Technology Wuhan430063 China The Engineering Research Center of Transportation Information and Safety Ministry of Education Wuhan430063 China School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China The Key Laboratory of Image Processing and Intelligent Control Education Ministry of China Wuhan430074 China

Conventional Domain Adaptation(DA) algorithms typically rely on access to the source data,which may not always be practical due to privacy concerns or limited storage *** address these challenges,Source-Free Domain Adaptation(SFDA) has emerged as an alternative that relies solely on a pre-trained source model rather than the actual source *** SFDA,pseudo-label supervised learning is commonly employed and initially plays a significant role in enhancing model performance during the early stages of target domain ***,as adaptation progresses,the performance can stagnate or even deteriorate due to the noise inherent in pseudo-labels,a phenomenon known as Confirmation *** noise present in target domain pseudo-labels introduces additional uncertainty and overfitting risks to the *** this study,a novel framework named Sample Weighted Gradient Regularization (SWGR) was introduced to tackle this *** first propose the Label Uncertainty Estimation Metric (LUEM),a reweighting strategy that assesses the reliability of *** metric evaluates label uncertainty from both the source domain pre-trained model and spatial distribution of target domain samples,allowing the model to achieve improved cross-domain transfer performance with high-confidence samples in the target domain. Additionally,we impose a constraint on the gradient descent process of the total loss function in the form of an inequality to prevent entropy from *** Gradient Regularization eliminates overfitting while also guiding the model in lowering prediction uncertainty *** approach reduces the uncertainty in the target domain and enhances the model's generalization *** results demonstrate that our method surpasses competing SFDA approaches and even outperforms many traditional DA methods which require extensive amounts of source domain data. © 2024, The Authors. All rights reserved.

关键词： Self-supervised learning

Deep Learning-Based Diffusion MRI Tractography: Integrating Spatial and Anatomical Information

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Yang, Yiqiong Yuan, Yitian Ren, Baoxing Wu, Ye Feng, Yanqiu Zhang, Xinyuan School of Biomedical Engineering Southern Medical University Guangzhou510515 China Guangdong Provincial Key Laboratory of Medical Image Processing Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology Southern Medical University Guangzhou510515 China School of Computer Science and Technology Nanjing University of Science and Technology Nanjing China Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence & Key Laboratory of Mental Health The Ministry of Education Southern Medical University Guangzhou China Department of Radiology Shunde Hospital Southern Medical University The First People's Hospital of Shunde Foshan Foshan China

Diffusion MRI tractography technique enables non-invasive visualization of the white matter pathways in the brain. It plays a crucial role in neuroscience and clinical fields by facilitating the study of brain connectivity and neurological disorders. However, the accuracy of reconstructed tractograms has been a longstanding challenge. Recently, deep learning methods have been applied to improve tractograms for better white matter coverage, but often comes at the expense of generating excessive false-positive connections. This is largely due to their reliance on local information to predict long-range streamlines. To improve the accuracy of streamline propagation predictions, we introduce a novel deep learning framework that integrates image-domain spatial information and anatomical information along tracts, with the former extracted through convolutional layers and the later modeled via a Transformer-decoder. Additionally, we employ a weighted loss function to address fiber class imbalance encountered during training. We evaluate the proposed method on the simulated ISMRM 2015 Tractography Challenge dataset, achieving a valid streamline rate of 66.2%, white matter coverage of 63.8%, and successfully reconstructing 24 out of 25 bundles. Furthermore, on the multi-site Tractoinferno dataset, the proposed method demonstrates its ability to handle various diffusion MRI acquisition schemes, achieving a 5.7% increase in white matter coverage and a 4.1% decrease in overreach compared to RNN-based methods. Copyright © 2025, The Authors. All rights reserved.

关键词： image enhancement

Neural Multi-Objective Combinatorial Optimization with Diversity Enhancement

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Chen, Jinbiao Zhang, Zizhen Cao, Zhiguang Wu, Yaoxin Ma, Yining Ye, Te Wang, Jiahai School of Computer Science and Engineering Sun Yat-sen University China School of Computing and Information Systems Singapore Management University Singapore Department of Industrial Engineering & Innovation Sciences Eindhoven University of Technology Netherlands Department of Industrial Systems Engineering & Management National University of Singapore Singapore Key Laboratory of Machine Intelligence and Advanced Computing Ministry of Education Sun Yat-sen University China Guangdong Key Laboratory of Big Data Analysis and Processing Guangzhou China

Most of existing neural methods for multi-objective combinatorial optimization (MOCO) problems solely rely on decomposition, which often leads to repetitive solutions for the respective subproblems, thus a limited Pareto set. Beyond decomposition, we propose a novel neural heuristic with diversity enhancement (NHDE) to produce more Pareto solutions from two perspectives. On the one hand, to hinder duplicated solutions for different subproblems, we propose an indicator-enhanced deep reinforcement learning method to guide the model, and design a heterogeneous graph attention mechanism to capture the relations between the instance graph and the Pareto front graph. On the other hand, to excavate more solutions in the neighborhood of each subproblem, we present a multiple Pareto optima strategy to sample and preserve desirable solutions. Experimental results on classic MOCO problems show that our NHDE is able to generate a Pareto front with higher diversity, thereby achieving superior overall performance. Moreover, our NHDE is generic and can be applied to different neural methods for MOCO. Copyright © 2023, The Authors. All rights reserved.

关键词： Deep learning

Exploiting Distilled Learning for Deep Siamese Tracking

学校读者我要写书评

暂无评论

Exploiting Distilled Learning for Deep Siamese Tracking

International Conference on Pattern Recognition

作者： Chengxin Liu Zhiguo Cao Wei Li Yang Xiao Shuaiyuan Du Angfan Zhu Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Queen Mary University of London

Existing deep siamese trackers are typically built on off-the-shelf CNN models for feature learning, with the demand for huge power consumption and memory storage. This limits current deep siamese trackers to be carried on resource-constrained devices like mobile phones, given factor that such a deployment normally requires cost-effective considerations. In this work, we address this issue by presenting a novel Distilled Learning Framework(DLF) for siamese tracking, which aims at learning tracking model with efficiency and high accuracy. Specifically, we propose two simple yet effective knowledge distillation strategies, denote as point-wise distillation and pairwise distillation, which are designed for transferring knowledge from a more discriminative teacher tracker into a compact student tracker. In this way, cost-effective and high performance tracking could be achieved. Extensive experiments on several tracking benchmarks demonstrate the effectiveness of our proposed method.

关键词： Power demand Pipelines Memory management Benchmark testing Mobile handsets Pattern recognition

A Stronger Baseline for Ego-Centric Action Detection

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Qing, Zhiwu Huang, Ziyuan Wang, Xiang Feng, Yutong Zhang, Shiwei Jiang, Jianwen Tang, Mingqian Gao, Changxin Ang, Marcelo H. Sang, Nong Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology ARC National University of Singapore Tsinghua University Alibaba Group

This technical report analyzes an egocentric video action detection method we used in the 2021 EPIC-KITCHENS-100 competition hosted in CVPR2021 Workshop. The goal of our task is to locate the start time and the end time of the action in the long untrimmed video, and predict action category. We adopt sliding window strategy to generate proposals, which can better adapt to short-duration actions. In addition, we show that classification and proposals are conflict in the same network. The separation of the two tasks boost the detection performance with high efficiency. By simply employing these strategy, we achieved 16.10% performance on the test set of EPIC-KITCHENS-100 Action Detection challenge using a single model, surpassing the baseline method by 11.7% in terms of average mAP. Copyright © 2021, The Authors. All rights reserved.

关键词： Machine learning