检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Liu, Shaonan Chen, Wenting Liu, Jie Luo, Xiaoling Shen, Linlin Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University China Department of Electrical Engineering City University of Hong Kong Hong Kong AI Research Center for Medical Image Analysis and Diagnosis Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

Gaze estimation is pivotal in human scene comprehension tasks, particularly in medical diagnostic analysis. Eye-tracking technology facilitates the recording of physicians’ ocular movements during image interpretation, thereby elucidating their visual attention patterns and information-processing strategies. In this paper, we initially define the context-aware gaze estimation problem in medical radiology report settings. To understand the attention allocation and cognitive behavior of radiologists during the medical image interpretation process, we propose a context-aware Gaze EstiMation (GEM) network that utilizes eye gaze data collected from radiologists to simulate their visual search behavior patterns throughout the image interpretation process. It consists of a context-awareness module, visual behavior graph construction, and visual behavior matching. Within the context-awareness module, we achieve intricate multimodal registration by establishing connections between medical reports and images. Subsequently, for a more accurate simulation of genuine visual search behavior patterns, we introduce a visual behavior graph structure, capturing such behavior through high-order relationships (edges) between gaze points (nodes). To maintain the authenticity of visual behavior, we devise a visual behavior-matching approach, adjusting the high-order relationships between them by matching the graph constructed from real and estimated gaze points. Extensive experiments on four publicly available datasets demonstrate the superiority of GEM over existing methods and its strong generalizability, which also provides a new direction for the effective utilization of diverse modalities in medical image interpretation and enhances the interpretability of models in the field of medical imaging. https://***/Tiger-SN/GEM. Copyright © 2024, The Authors. All rights reserved.

关键词： Eye movements

来源：评论

学校读者我要写书评

暂无评论

Dermoscopic image Classification Using Attention Mechanism and Ensemble Learning Approaches

Dermoscopic Image Classification Using Attention Mechanism a...

引用

2023 IEEE International Conference on Big Data, BigData 2023

作者： Huang, Shanchuan Lei, Hongwei Jin, Liuhan Yang, Jinzhu Jiang, Tao Yao, Yudong Grzegorzek, Marcin Li, Chen Northeastern University Microscopic Image and Medical Image Analysis Group College of Medicine and Biological Information Engineering China Northeastern University Key Laboratory of Intelligent Computing in Medical Image Ministry of Education Liaoning Shenyang China Chengdu University of Traditional Chinese Medicine School of Intelligent Medicine Chengdu China Stevens Institute of Technology Department of Electrical and Computer Engineering United States Institute of Medical Informatics University of Luebeck Luebeck Germany

ISBN: (纸本)9798350324457

Background and purpose: Skin tumours have become one of the most common diseases worldwide. While benign ones are not usually a threat to human health, malignant ones can develop into skin cancer and become life-threatening if left untreated. Early detection of the disease is important for the treatment of patients with skin tumours and dermoscopy is the most effective means of diagnosing skin tumours. However, the complexity of skin tumour cells makes the diagnosis somewhat erroneous for doctors. Therefore, a dermoscopic classification network based on deep learning and computer-aided diagnostic techniques is needed to obtain a high diagnostic accuracy rate for skin tumours. Methods: In this paper, Deep-skin, a model for dermoscopic image classification is proposed, which is based on both attention mechanism and ensemble learning. Considering the characteristics of dermoscopic images, embedding different attention mechanisms on top of Inception-V3 has been suggested to obtain more potential features. We then improve the classification performance by late fusion of the different models. To demonstrate the effectiveness of Deep-skin, experiments and evaluations are performed on the publicly available dataset Skin Cancer: Malignant vs. Benign and compare the performance of Deep-skin with other classification models. Results: The experimental results indicate that Deep-skin performs well on the dataset in comparison to other models, achieving a maximum accuracy of 87.8%.Conclusion: In this paper, the Deep-skin model is proposed for the classification of dermoscopic images and has shown better performance. In the future, we intend to investigate better classification models for automatic diagnosis of skin tumours. Such models can potentially assist physicians and patients in clinical settings. © 2023 IEEE.

关键词： Attention mechanism Ensemble learning image classification Late fusion Skin Cancer

来源：评论

学校读者我要写书评

暂无评论

Scale‐wise interaction fusion and knowledge distillation network for aerial scene recognition

引用

CAAI Transactions on Intelligence Technology 2023年第4期8卷 1178-1190页

作者： Hailong Ning Tao Lei Mengyuan An Hao Sun Zhanxuan Hu Asoke K.Nandi School of Computer Science and Technology Xi'an University of Posts and TelecommunicationsShaanxi Key Laboratory of Network Data Analysis and Intelligent ProcessingXi'anChina Xi'an Key Laboratory of Big Data and Intelligent Computing Xi'anChina School of Electronic Information and Artificial Intelligence Shaanxi University of Science and TechnologyXi'anChina School of Computer Central China Normal UniversityWuhanChina Department of Electronic and Electrical Engineering Brunel University LondonLondonUK Xi'an Jiaotong University Xi'anChina

Aerial scene recognition(ASR)has attracted great attention due to its increasingly essential *** of the ASR methods adopt the multi‐scale architecture because both global and local features play great roles in ***,the existing multi‐scale methods neglect the effective interactions among different scales and various spatial locations when fusing global and local features,leading to a limited ability to deal with challenges of large‐scale variation and complex background in aerial scene *** addition,existing methods may suffer from poor generalisations due to millions of to‐belearnt parameters and inconsistent predictions between global and local *** tackle these problems,this study proposes a scale‐wise interaction fusion and knowledge distillation(SIF‐KD)network for learning robust and discriminative features with scaleinvariance and background‐independent *** main highlights of this study include two *** the one hand,a global‐local features collaborative learning scheme is devised for extracting scale‐invariance features so as to tackle the large‐scale variation problem in aerial scene ***,a plug‐and‐play multi‐scale context attention fusion module is proposed for collaboratively fusing the context information between global and local *** the other hand,a scale‐wise knowledge distillation scheme is proposed to produce more consistent predictions by distilling the predictive distribution between different scales during *** experimental results show the proposed SIF‐KD network achieves the best overall accuracy with 99.68%,98.74%and 95.47%on the UCM,AID and NWPU‐RESISC45 datasets,respectively,compared with state of the arts.

关键词： deep learning image analysis image classification information fusion

来源：评论

学校读者我要写书评

暂无评论

MULTI-SCALE FUSION FOR OBJECT REPRESENTATION

arXiv

引用

arXiv 2024年

作者： Zhao, Rongzhen Wang, Vivienne Kannala, Juho Pajarinen, Joni Department of Electrical Engineering and Automation Aalto University Finland Department of Computer Science Aalto University Finland Center for Machine Vision and Signal Analysis University of Oulu Finland

Representing images or videos as object-level feature vectors, rather than pixel-level feature maps, facilitates advanced visual tasks. Object-Centric Learning (OCL) primarily achieves this by reconstructing the input under the guidance of Variational Autoencoder (VAE) intermediate representation to drive so-called slots to aggregate as much object information as possible. However, existing VAE guidance does not explicitly address that objects can vary in pixel sizes while models typically excel at specific pattern scales. We propose Multi-Scale Fusion (MSF) to enhance VAE guidance for OCL training. To ensure objects of all sizes fall within VAE’s comfort zone, we adopt the image pyramid, which produces intermediate representations at multiple scales;To foster scale-invariance/variance in object super-pixels, we devise inter/intra-scale fusion, which augments low-quality object super-pixels of one scale with corresponding high-quality super-pixels from another scale. On standard OCL benchmarks, our technique improves mainstream methods, including state-of-the-art diffusion-based ones. The source code is available on https://***/Genera1Z/MultiScaleFusion. © 2024, CC BY.

关键词： Pixels

来源：评论

学校读者我要写书评

暂无评论

Pansharpening Methods Based on a Redundant Contourlet Transform

Pansharpening Methods Based on a Redundant Contourlet Transf...

引用

2023 International Conference on Earth Observation and Geo-Spatial Information, ICEOGI 2023

作者： Ourabia, Soumeya Baaziz, Nadia Smara, Youcef University Center of Tipaza -Morsli Abdelah-Institut of Sciences Laboratory of Image Processing and Radiation -USTHB Departement of Electronics Tipaza Algeria University of Quebec in Outaouais - Uqo Research Laboratory in Multimedia Information Department of Computer Science and Engineering GatineauQC Canada University of Sciences and Technology Houari Boumediene -USTHB Laboratory of Image Processing and Radiation Faculty of Electrical Engineering Algiers Algeria

ISBN: (纸本)9798350396720

The pansharpening of high-resolution panchromatic (Pan) image and low-resolution multispectral (MS) images represents an important task in the remote sensing field. It allows the joint exploitation of the information derived from both types of images. However, this may cause a distortion of spectral information or a lack in details and structures. The multiresolution analysis using wavelet transforms has proved its efficiency in the pansharpening domain, due to the representation of the image content over different resolution levels. In image fusion applications, we always need more detail information to be incorporated in the pansharpening procedure in order to produce enhanced results. However, the limitation of the wavelet transform to three types of oriented detail coefficients prevents this need from being met. To overcome this limitation, we propose to use the redundant contourlet transform (RCT) which extracts a richer multiscale directional information from the image. For this purpose, two RCT-based pansharpening methods are introduced and suitable data fusion procedures are described. We conducted several experiments on two different datasets acquired respectively by ALSAT-2A and IKONOS satellites. The visual results as well as quantitative results from evaluation metrics demonstrate the performance of the proposed methods. © 2023 IEEE.

关键词： image enhancement

来源：评论

学校读者我要写书评

暂无评论

Unsupervised learning of spatially varying regularization for diffeomorphic image registration

arXiv

引用

arXiv 2024年

作者： Chen, Junyu Wei, Shuwen Liu, Yihao Bian, Zhangxing He, Yufan Carass, Aaron Bai, Harrison Du, Yong Department of Radiology and Radiological Science Johns Hopkins School of Medicine MD United States Image Analysis and Communications Laboratory Department of Electrical and Computer Engineering Johns Hopkins University MD United States Department of Electrical and Computer Engineering Vanderbilt University TN United States NVIDIA Corporation BethesdaMD United States

Spatially varying regularization accommodates the deformation variations that may be necessary for different anatomical regions during deformable image registration. Historically, optimization-based registration models have harnessed spatially varying regularization to address anatomical subtleties. However, most modern deep learning-based models tend to gravitate towards spatially invariant regularization, wherein a homogenous regularization strength is applied across the entire image, potentially disregarding localized variations. In this paper, we propose a hierarchical probabilistic model that integrates a prior distribution on the deformation regularization strength, enabling the end-to-end learning of a spatially varying deformation regularizer directly from the data. The proposed method is straightforward to implement and easily integrates with various registration network architectures. Additionally, automatic tuning of hyperparameters is achieved through Bayesian optimization, allowing efficient identification of optimal hyperparameters for any given registration task. Comprehensive evaluations on publicly available datasets demonstrate that the proposed method significantly improves registration performance and enhances the interpretability of deep learning-based registration, all while maintaining smooth deformations. Copyright © 2024, The Authors. All rights reserved.

关键词： image registration

来源：评论

学校读者我要写书评

暂无评论

Human Orientation Estimation Under Partial Observation

Human Orientation Estimation Under Partial Observation

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Jieting Zhao Hanjing Ye Yu Zhan Hao Luan Hong Zhang Department of Electronic and Electrical Engineering SUSTech Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology (SUSTech) Department of Computer Science School of Computing National University of Singapore

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Reliable Human Orientation Estimation (HOE) from a monocular image is critical for autonomous agents to understand human intention. Significant progress has been made in HOE under full observation. However, the existing methods easily make a wrong prediction under partial observation and give it an unexpectedly high confidence. To solve the above problems, this study first develops a method called Part-HOE that estimates orientation from the visible joints of a target person so that it is able to handle partial observation. Subsequently, we introduce a confidence-aware orientation estimation method, enabling more accurate orientation estimation and reasonable confidence estimation under partial observation. The effectiveness of our method is validated on both public and custom-built datasets, and it shows great accuracy and reliability improvement in partial observation scenarios. In particular, we show in real experiments that our method can benefit the robustness and consistency of the Robot Person Following (RPF) task.

关键词： Accuracy Filtering Estimation Robustness Autonomous agents Intelligent robots

来源：评论

学校读者我要写书评

暂无评论

Feature Correlation Aggregation: on the Path to Better Graph Neural Networks

Feature Correlation Aggregation: on the Path to Better Graph...

引用

Proceedings of the Digital image Computing: Technqiues and Applications (DICTA)

作者： Jieming Zhou Tong Zhang Pengfei Fang Lars Petersson Mehrtash Harandi College of Engineering and Computer Science Australian National University Canberra Australia Image and Visual Representation Laboratory EPFL Lausanne Switzerland Imaging and Computer Vision Group CSIRO Canberra Australia Department of Electrical and Computer Systems Engineering Monash University Melbourne Australia

Prior to the introduction of Graph Neural Networks (GNNs), modelling and analyzing irregular data, particularly graphs, was thought to be the Achilles’ heel of deep learning. The core concept of GNNs is to find a representation by recursively aggregating the representations of a central node and those of its neighbor, and many GNNs’ designs have demonstrated its success. However, most only focus on using the first-order information between a node and its neighbors. In this paper, we introduce a central node permutation variant function through a frustratingly simple and innocent-looking modification to the core operation of a GNN, namely the Feature cOrrelation aGgregation (FOG) module, which learns the second-order information from feature correlation between a node and its neighbors in the pipeline. By adding FOG into existing variants of GNNs, we empirically verify this second-order information complements the features generated by original GNNs across a broad set of benchmarks. A tangible boost in the model’s performance is observed where the model surpasses previous state-of-the-art results by a significant margin while employing fewer parameters. e.g., 26.202% improvement on a real-world molecular dataset using graph convolutional networks.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Beyond MR image Harmonization: Resolution Matters Too

arXiv

引用

arXiv 2024年

作者： Hays, Savannah P. Remedios, Samuel W. Zuo, Lianrui Mowry, Ellen M. Newsome, Scott D. Calabresi, Peter A. Carass, Aaron Dewey, Blake E. Prince, Jerry L. Image Analysis and Communications Laboratory Department of Electrical and Computer Engineering Johns Hopkins University BaltimoreMD21218 United States Department of Computer Science Johns Hopkins University BaltimoreMD21218 United States Department of Electrical and Computer Engineering Vanderbilt University NashvilleTN37235 United States Department of Neurology Johns Hopkins School of Medicine BaltimoreMD21287 United States

Magnetic resonance (MR) imaging is commonly used in the clinical setting to non-invasively monitor the body. There exists a large variability in MR imaging due to differences in scanner hardware, software, and protocol design. Ideally, a processing algorithm should perform robustly to this variability, but that is not always the case in reality. This introduces a need for image harmonization to overcome issues of domain shift when performing downstream analysis such as segmentation. Most image harmonization models focus on acquisition parameters such as inversion time or repetition time, but they ignore an important aspect in MR imaging—resolution. In this paper, we evaluate the impact of image resolution on harmonization using a pretrained harmonization algorithm. We simulate 2D acquisitions of various slice thicknesses and gaps from 3D acquired, 1mm3 isotropic MR images and demonstrate how the performance of a state-of-the-art image harmonization algorithm varies as resolution changes. We discuss the most ideal scenarios for image resolution including acquisition orientation when 3D imaging is not available, which is common for many clinical scanners. Our results show that harmonization on low-resolution images does not account for acquisition resolution and orientation variations. Super-resolution can be used to alleviate resolution variations but it is not always used. Our methodology can generalize to help evaluate the impact of image acquisition resolution for multiple tasks. Determining the limits of a pretrained algorithm is important when considering preprocessing steps and trust in the results. Copyright © 2024, The Authors. All rights reserved.

关键词： Magnetic resonance imaging

来源：评论

学校读者我要写书评

暂无评论

Automated Segmentation and Connectivity analysis for Normal Pressure Hydrocephalus

引用

Biomedical engineering Frontiers 2022年第1期3卷 1-13页

作者： Angela Zhang Amil Khan Saisidharth Majeti Judy Pham Christopher Nguyen Peter Tran Vikram Iyer Ashutosh Shelat Jefferson Chen B.S.Manjunath Vision Research Laboratory Electrical and Computer EngineeringUniversity of CaliforniaSanta BarbaraSanta BarbaraCAUSA Chen Lab Department of NeurosurgeryUniversity of CaliforniaIrvine Medical CenterOrangeCAUSA Santa Barbara Cottage Hospital Santa BarbaraCAUSA

Objective and Impact *** propose an automated method of predicting Normal Pressure Hydrocephalus(NPH)from CT scans.A deep convolutional network segments regions of interest from the *** regions are then combined with MRI information to predict *** our knowledge,this is the first method which automatically predicts NPH from CT scans and incorporates diffusion tractography information for *** to their low cost and high versatility,CT scans are often used in NPH *** well-defined and effective protocol currently exists for analysis of CT scans for ***’index,an approximation of the ventricle to brain volume using one 2D image slice,has been proposed but is not *** proposed approach is an effective way to quantify regions of interest and offers a computational method for predicting *** propose a novel method to predict NPH by combining regions of interest segmented from CT scans with connectome data to compute features which capture the impact of enlarged ventricles by excluding fiber tracts passing through these *** segmentation and network features are used to train a model for NPH *** method outperforms the current state-of-the-art by 9 precision points and 29 recall *** segmentation model outperforms the current state-of-the-art in segmenting the ventricle,gray-white matter,and subarachnoid space in CT *** experimental results demonstrate that fast and accurate volumetric segmentation of CT brain scans can help improve the NPH diagnosis process,and network properties can increase NPH prediction accuracy.

关键词： diagnosis network Connectivity

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：