检索结果-内蒙古大学图书馆

$\text{MR}^{2}$-Net: Retinal OCTA Image Stitching via Multi-Scale Representation Learning and Dynamic Location Guidance

引用

IEEE Journal of biomedical and Health Informatics 2024年第1期29卷 482-494页

作者： Haiting Mao Yuhui Ma Dan Zhang Yanda Meng Shaodong Ma Yuchuan Qiao Huazhu Fu Caifeng Shan Da Chen Yitian Zhao Jiong Zhang Laboratory of Advanced Theranostic Materials and Technology Ningbo Institute of Materials Technology and Engineering Chinese Academy of Sciences Ningbo China School of Cyber Science and Engineering Ningbo University of Technology Ningbo China Department of Computer Science University of Exeter Exeter U.K. Institution of Science and Technology for Brain-Inspired Intelligence Fudan University Shanghai China Institute of High Performance Computing (IHPC) A*STAR Singapore School of Intelligence Science and Technology Nanjing University Nanjing China Qilu University of Technology Jinan China

Optical coherence tomography angiography (OCTA) plays a crucial role in quantifying and analyzing retinal vascular diseases. However, the limited field of view (FOV) inherent in most commercial OCTA imaging systems poses a significant challenge for clinicians, restricting the possibility to analyze larger retinal regions of high resolution. Automatic stitching of OCTA scans in adjacent regions may provide a promising solution to extend the region of interest. However, commonly-used stitching algorithms face difficulties in achieving effective alignment due to noise, artifacts and dense vasculature present in OCTA images. To address these challenges, we propose a novel retinal OCTA image stitching network, named $\text{MR}^{2}$ -Net, which integrates multi-scale representation learning and dynamic location guidance. In the first stage, an image registration network with a progressive multi-resolution feature fusion is proposed to derive deep semantic information effectively. Additionally, we introduce a dynamic guidance strategy to locate the foveal avascular zone (FAZ) and constrain registration errors in overlapping vascular regions. In the second stage, an image fusion network based on multiple mask constraints and adjacent image aggregation (AIA) strategies is developed to further eliminate the artifacts in the overlapping areas of stitched images, thereby achieving precise vessel alignment. To validate the effectiveness of our method, we conduct a series of experiments on two delicately constructed datasets, i.e., OPTOVUE-OCTA and Svision-OCTA. Experimental results demonstrate that our method outperforms other image stitching methods and effectively generates high-quality wide-field OCTA images, achieving a structural similarity index (SSIM) score of 0.8264 and 0.8014 on the two datasets, respectively.

关键词： Feature extraction Image stitching Retina Image registration Convolutional codes bioinformatics Representation learning

来源：评论

学校读者我要写书评

暂无评论

Shifting More Attention to Breast Lesion Segmentation in Ultrasound Videos

arXiv

引用

arXiv 2023年

作者： Lin, Junhao Dai, Qian Zhu, Lei Fu, Huazhu Wang, Qiong Li, Weibin Rao, Wenhao Huang, Xiaoyang Wang, Liansheng School of Informatics Xiamen University Xiamen China Guangzhou China Department of Electronic and Computer Engineering The Hong Kong University of Science and Technology Hong Kong Institute of High Performance Computing Agency for Science Technology and Research Singapore Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen China School of Medicine Xiamen University Xiamen China

Breast lesion segmentation in ultrasound (US) videos is essential for diagnosing and treating axillary lymph node metastasis. However, the lack of a well-established and large-scale ultrasound video dataset with high-quality annotations has posed a persistent challenge for the research community. To overcome this issue, we meticulously curated a US video breast lesion segmentation dataset comprising 572 videos and 34,300 annotated frames, covering a wide range of realistic clinical scenarios. Furthermore, we propose a novel frequency and localization feature aggregation network (FLA-Net) that learns temporal features from the frequency domain and predicts additional lesion location positions to assist with breast lesion segmentation. We also devise a localization-based contrastive loss to reduce the lesion location distance between neighboring video frames within the same video and enlarge the location distances between frames from different ultrasound videos. Our experiments on our annotated dataset and two public video polyp segmentation datasets demonstrate that our proposed FLA-Net achieves state-of-the-art performance in breast lesion segmentation in US videos and video polyp segmentation while significantly reducing time and space complexity. Our model and dataset are available at https://***/jhlDet/FLA-Net. Copyright © 2023, The Authors. All rights reserved.

关键词： Location

来源：评论

学校读者我要写书评

暂无评论

Sampling methods for efficient training of graph convolutional networks: A survey

arXiv

引用

arXiv 2021年

作者： Liu, Xin Yan, Mingyu Deng, Lei Li, Guoqi Ye, Xiaochun Fan, Dongrui State Key Laboratory of Computer Architecture Institute of Computing Technology Chinese Academy of Sciences Beijing100086 China Department of Precision Instrument Center for Brain Inspired Computing Research Tsinghua University Beijing100084 China School of Computer Science and Technology University of Chinese Academy of Sciences

—Graph Convolutional Networks (GCNs) have received significant attention from various research fields due to the excellent performance in learning graph representations. Although GCN performs well compared with other methods, it still faces challenges. Training a GCN model for large-scale graphs in a conventional way requires high computation and storage costs. Therefore, motivated by an urgent need in terms of efficiency and scalability in training GCN, sampling methods have been proposed and achieved a significant effect. In this paper, we categorize sampling methods based on the sampling mechanisms and provide a comprehensive survey of sampling methods for efficient training of GCN. To highlight the characteristics and differences of sampling methods, we present a detailed comparison within each category and further give an overall comparative analysis for the sampling methods in all categories. Finally, we discuss some challenges and future research directions of the sampling methods. Copyright © 2021, The Authors. All rights reserved.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

CONIC10K: A Challenging Math Problem Understanding and Reasoning Dataset

arXiv

引用

arXiv 2023年

作者： Wu, Haoyi Hui, Wenyang Chen, Yezeng Wu, Weiqi Tu, Kewei Zhou, Yi School of Information Science and Technology ShanghaiTech University China Shanghai Engineering Research Center of Intelligent Vision and Imaging China School of Information Science and Technology University of Science and Technology of China China National Engineering Laboratory for Brain-inspired Intelligence Technology and Application China Key Laboratory of Brain Cognition and Education Sciences Ministry of Education China Shanghai Innovation Center for Processor Technologies China Department of Computer Science and Engineering Shanghai Jiao Tong University China

Mathematical understanding and reasoning are crucial tasks for assessing the capabilities of artificial intelligence (AI). However, existing benchmarks either require just a few steps of reasoning, or only contain a small amount of data in one specific topic, making it hard to analyse AI's behaviour with reference to different problems within a specific topic in detail. In this work, we propose CONIC10K, a challenging math problem dataset on conic sections in Chinese senior high school education. Our dataset contains various problems with different reasoning depths, while only the knowledge from conic sections is required. Since the dataset only involves a narrow range of knowledge, it is easy to separately analyse the knowledge a model possesses and the reasoning ability it has. For each problem, we provide a high-quality formal representation, the reasoning steps, and the final solution. Experiments show that existing large language models, including GPT-4, exhibit weak performance on complex reasoning. We hope that our findings could inspire more advanced techniques for precise natural language understanding and reasoning. Our dataset and codes are available at https://***/whyNLP/Conic10K. © 2023, CC BY.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Adaptive Wavelet Filters as Practical Texture Feature Amplifiers for Parkinson’s Disease Screening in OCT

arXiv

引用

arXiv 2025年

作者： Zhang, Xiaoqing Shi, Hanfeng Li, Xiangyu Ye, Haili Xu, Tao Li, Na Hu, Yan Lv, Fan Chen, Jiangfan Liu, Jiang Center for High Performance Computing and Shenzhen Key Laboratory of Intelligent Bioinformatics Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen China Research Institute of Trustworthy Autonomous Systems Department of Computer Science and Engineering Southern University of Science and Technology Shenzhen518055 China State Key Laboratory of Ophthalmology Optometry and Vision Science Wenzhou Medical University Wenzhou China Centre for Computational Science and Mathematical Modelling Coventry University Coventry United Kingdom School of Computer Science University of Nottingham Ningbo China Ningbo315100 China School of Ophthalmology and Optometry Wenzhou Medical University Wenzhou325035 China Department of Electronic and Information Engineering Changchun University Changchun130022 China

Parkinson’s disease (PD) is a prevalent neurodegenerative disorder globally. The eye’s retina is an extension of the brain and has great potential in PD screening. Recent studies have suggested that texture features extracted from retinal layers can be adopted as biomarkers for PD diagnosis under optical coherence tomography (OCT) images. Frequency domain learning techniques can enhance the feature representations of deep neural networks (DNNs) by decomposing frequency components involving rich texture features. Additionally, previous works have not exploited texture features for automated PD screening in OCT. Motivated by the above analysis, we propose a novel Adaptive Wavelet Filter (AWF) that serves as the Practical Texture Feature Amplifier to fully leverage the merits of texture features to boost the PD screening performance of DNNs with the aid of frequency domain learning. Specifically, AWF first enhances texture feature representation diversities via channel mixer, then emphasizes informative texture feature representations with the well-designed adaptive wavelet filtering token mixer. By combining the AWFs with the DNN stem, AWFNet is constructed for automated PD screening. Additionally, we introduce a novel Balanced Confidence (BC) Loss by mining the potential of sample-wise predicted probabilities of all classes and class frequency prior, to further boost the PD screening performance and trustworthiness of AWFNet. The extensive experiments manifest the superiority of our AWFNet and BC over state-of-the-art methods in terms of PD screening performance and trustworthiness. © 2025, CC BY-NC-SA.

关键词： Neurodegenerative diseases

来源：评论

学校读者我要写书评

暂无评论

Line Drawing Guided Progressive Inpainting of Mural Damage

arXiv

引用

arXiv 2022年

作者： Li, Luxi Zou, Qin Zhang, Fan Yu, Hongkai Chen, Long Song, Chengfang Huang, Xianfeng Wang, Xiaoguang Li, Qingquan Department of Computer Science Technology United International College of Beijing Normal University HongKong Baptist University Zhuhai China Machine Vision and Robotics Laboratory School of Computer Science Wuhan University Wuhan China State Key Laboratory of Surveying Mapping and Remote Sensing Information Engineering Wuhan University Wuhan China Department of Electrical Engineering and Computer Science Cleveland State University OH United States Institute of Automation Chinese Academy of Sciences Beijing China Cultural Heritage Intelligent Computing Laboratory Wuhan University Wuhan China Guangming Laboratory Shenzhen University Shenzhen China

Mural image inpainting is far less explored compared to its natural image counterpart and remains largely unsolved. Most existing image-inpainting methods tend to take the target image as the only input and directly repair the damage to generate a visually plausible result. These methods obtain high performance in restoration or completion of some pre-defined objects, e.g., human face, fabric texture, and printed texts, etc., however, are not suitable for repairing murals with varying subjects and large damaged areas. Moreover, due to discrete colors in paints, mural inpainting may suffer from apparent color bias. To this end, in this paper, we propose a line drawing guided progressive mural inpainting method. It divides the inpainting process into two steps: structure reconstruction and color correction, implemented by a structure reconstruction network (SRN) and a color correction network (CCN), respectively. In structure reconstruction, SRN utilizes the line drawing as an assistant to achieve large-scale content authenticity and structural stability. In color correction, CCN operates a local color adjustment for missing pixels which reduces the negative effects of color bias and edge jumping. The proposed approach is evaluated against the current state-of-the-art image inpainting methods. Qualitative and quantitative results demonstrate the superiority of the proposed method in mural image inpainting. The codes and data are available at https://***/qinnzou/mural-image-inpainting . © 2022, CC BY-NC-ND.

关键词： Restoration

来源：评论

学校读者我要写书评

暂无评论

Pyramid Pixel Context Adaption Network for Medical Image Classification with Supervised Contrastive Learning

arXiv

引用

arXiv 2023年

作者： Zhang, Xiaoqing Xiao, Zunjie Wu, Xiao Chen, Yanlin Zhao, Jilu Hu, Yan Liu, Jiang Research Institute of Trustworthy Autonomous Systems Southern University of Science and Technology Shenzhen518055 China Department of Computer Science and Engineering Southern University of Science and Technology Shenzhen518055 China Center for High Performance Computing Shenzhen Key Laboratory of Intelligent Bioinformatics Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China Guangdong Provincial Key Laboratory of Brain-inspired Intelligent Computation Southern University of Science and Technology Shenzhen518055 China Singapore Eye Research Institute 169856 Singapore

Spatial attention mechanism has been widely incorporated into deep neural networks (DNNs), significantly lifting the performance in computer vision tasks via long-range dependency modeling. However, it may perform poorly in medical image analysis. Unfortunately, existing efforts are often unaware that long-range dependency modeling has limitations in highlighting subtle lesion regions. To overcome this limitation, we propose a practical yet lightweight architectural unit, Pyramid Pixel Context Adaption (PPCA) module, which exploits multiscale pixel context information to recalibrate pixel position in a pixel-independent manner dynamically. PPCA first applies a well-designed cross-channel pyramid pooling to aggregate multiscale pixel context information, then eliminates the inconsistency among them by the well-designed pixel normalization, and finally estimates per pixel attention weight via a pixel context integration. By embedding PPCA into a DNN with negligible overhead, the PPCANet is developed for medical image classification. In addition, we introduce supervised contrastive learning to enhance feature representation by exploiting the potential of label information via supervised contrastive loss. The extensive experiments on six medical image datasets show that PPCANet outperforms state-of-the-art attention-based networks and recent deep neural networks. We also provide visual analysis and ablation study to explain the behavior of PPCANet in the decision-making process. © 2023, CC BY.

关键词： Pixels

来源：评论

学校读者我要写书评

暂无评论

Power Efficient Video Super-Resolution on Mobile NPUs with Deep Learning, Mobile AI & AIM 2022 Challenge: Report

Power Efficient Video Super-Resolution on Mobile NPUs with...

引用

17th European Conference on computer vision, ECCV 2022

作者： Ignatov, Andrey Timofte, Radu Chiang, Cheng-Ming Kuo, Hsien-Kai Xu, Yu-Syuan Lee, Man-Yu Lu, Allen Cheng, Chia-Ming Chen, Chih-Cheng Yong, Jia-Ying Shuai, Hong-Han Cheng, Wen-Huang Jia, Zhuang Xu, Tianyu Zhang, Yijian Bao, Long Sun, Heng Zhang, Diankai Gao, Si Liu, Shaoli Wu, Biao Zhang, Xiaofeng Zheng, Chengjian Lu, Kaidi Wang, Ning Sun, Xiao Wu, HaoDong Liu, Xuncheng Zhang, Weizhan Yan, Caixia Du, Haipeng Zheng, Qinghua Wang, Qi Chen, Wangdu Duan, Ran Sun, Mengdi Zhu, Dan Chen, Guannan Cho, Hojin Kim, Steve Yue, Shijie Li, Chenghua Zhuge, Zhengyang Chen, Wei Wang, Wenxu Zhou, Yufeng Cai, Xiaochen Cai, Hengxing Xu, Kele Liu, Li Cheng, Zehua Lian, Wenyi Lian, Wenjing Computer Vision Lab ETH Zurich Zürich Switzerland AI Witchlabs Zürich Switzerland University of Wuerzburg Würzburg Germany MediaTek Inc. Hsinchu Taiwan National Yang Ming Chiao Tung University Hsinchu Taiwan Video Algorithm Group Camera Department Xiaomi Inc. Beijing China Audio & Video Technology Platform Department ZTE Corporation Shenzhen China Beijing China School of Computer Science and Technology Xi’an Jiaotong University Xi’an China MIGU Video Co. Ltd. Beijing China BOE Technology Group Co. Ltd. Beijing China GenGenAI Seoul Korea Republic of North China University of Technology Beijing China Institute of Automation Chinese Academy of Sciences Beijing China State Key Laboratory of Computer Architecture Institute of Computing Technology Beijing China 4Paradigm Inc. Beijing China National University of Defense Technology Changsha China University of Oxford Oxford United Kingdom Uppsala University Uppsala Sweden Northeastern University Shenyang China

ISBN: (纸本)9783031250651

Video super-resolution is one of the most popular tasks on mobile devices, being widely used for an automatic improvement of low-bitrate and low-resolution video streams. While numerous solutions have been proposed for this problem, they are usually quite computationally demanding, demonstrating low FPS rates and power efficiency on mobile devices. In this Mobile AI challenge, we address this problem and propose the participants to design an end-to-end real-time video super-resolution solution for mobile NPUs optimized for low energy consumption. The participants were provided with the REDS training dataset containing video sequences for a 4X video upscaling task. The runtime and power efficiency of all models was evaluated on the powerful MediaTek Dimensity 9000 platform with a dedicated AI processing unit capable of accelerating floating-point and quantized neural networks. All proposed solutions are fully compatible with the above NPU, demonstrating an up to 500 FPS rate and 0.2 [Watt/30 FPS] power consumption. A detailed description of all models developed in the challenge is provided in this paper. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Energy utilization

来源：评论

学校读者我要写书评

暂无评论

A Hybrid Adaptive Filter for Head Tracking in Augmented Reality (AR)-based Flight Simulators

引用

IEEE Transactions on computers 2025年

作者： Nwobodo, Onyeka J. Kuaban, Godlove Suila Nkemeni, Valery Wereszczynski, Kamil Cyran, Krzysztof A. Silesian University of Technology Department of Computer Graphics Vision and Digital Systems Faculty of Automatic Control Electronics and Computer Science Gliwice Poland Polish Academy of Sciences Institute of Theoretical and Applied Informatics Poland University of Buea Laboratory of Electrical Engineering and Computing Faculty of Engineering and Technology Buea Cameroon

This paper presents a novel approach for head tracking in augmented reality (AR) flight simulators using an adaptive fusion of Kalman and particle filters. This fusion dynamically balances the strengths of both algorithms, leveraging Kalman filters for computational efficiency and particle filters for handling non-linearities based on real-time factors such as sensor noise and head movement patterns. Our method demonstrates superior tracking precision and reduced latency, making it particularly effective for immersive pilot training in AR-based flight simulations. While focused on flight simulation, our approach holds high potential for broader applications in other AR and virtual reality (VR) environments where precise, real-time head tracking is crucial. These results provide actionable design guidance for developers optimizing tracking systems in environments that require fast response times and high accuracy. Future extensions of this research could explore the generalization of our approach across diverse AR applications, including human-computer interaction (HCI), medical simulations, and gaming. © 1968-2012 IEEE.

关键词： Flight simulators

来源：评论

学校读者我要写书评

暂无评论

Non-invasive suppression of essential tremor via phase-locked disruption of its temporal coherence

引用

Brain Stimulation 2023年第1期16卷 276-277页

作者： Li, Junheng Schreglmann, Sebastian Wang, David Peach, Robert Laurate, Anna Rhodes, Edward Panella, Emanuele Cassara, Antonino Boyden, Edward Barahona, Mauricio Rothwell, John Bhatia, Kailash Grossman, Nir Department of Brain Sciences Imperial College London London UK UK Dementia Research Institute UK Institute of Neurology Department of Clinical and Movement Neuroscience Queen Square University College London (UCL) UK Computer Science and Artificial Intelligence Laboratory Massachussetts Institute of Technology (MIT) USA Department of Brain Sciences Imperial College London UK Department of Mathematics and EPSRC Centre for Mathematics of Precision Healthcare Imperial College London UK Department of Physics Imperial College London London SW7 2AZ UK IT’IS Foundation for Research on Information Technologies in Society Switzerland Department of Media Arts and Sciences MIT USA McGovern Institute for Brain Research MIT USA Howard Hughes Medical Institute Cambridge USA Department of Biological Engineering MIT USA Department of Brain and Cognitive Sciences MIT USA Centre for Neurobiological Engineering MIT USA Koch Institute for Integrative Cancer Research MIT USA Centre for Bio-Inspired Technology Department of Electrical and Electronic Engineering Imperial College London UK Centre for Neurotechnology Imperial College London UK

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：