检索结果-内蒙古大学图书馆

DAMPER: A Dual-Stage Medical Report Generation Framework with Coarse-Grained MeSH Alignment and Fine-Grained Hypergraph Matching

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Huang, Xiaofei Chen, Wenting Liu, Jie Lu, Qisheng Luo, Xiaoling Shen, Linlin Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen China Department of Electrical Engineering City University of Hong Kong Kowloon Hong Kong National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

Medical report generation is crucial for clinical diagnosis and patient management, summarizing diagnoses and recommendations based on medical imaging. However, existing work often overlook the clinical pipeline involved in report writing, where physicians typically conduct an initial quick review followed by a detailed examination. Moreover, current alignment methods may lead to misaligned relationships. To address these issues, we propose DAMPER, a dual-stage framework for medical report generation that mimics the clinical pipeline of report writing in two stages. In the first stage, a MeSH-Guided Coarse-Grained Alignment (MCG) stage that aligns chest X-ray (CXR) image features with medical subject headings (MeSH) features to generate a rough keyphrase representation of the overall impression. In the second stage, a Hypergraph-Enhanced Fine-Grained Alignment (HFG) stage that constructs hypergraphs for image patches and report annotations, modeling high-order relationships within each modality and performing hypergraph matching to capture semantic correlations between image regions and textual phrases. Finally,the coarse-grained visual features, generated MeSH representations, and visual hypergraph features are fed into a report decoder to produce the final medical report. Extensive experiments on public datasets demonstrate the effectiveness of DAMPER in generating comprehensive and accurate medical reports, outperforming state-of-the-art methods across various evaluation metrics. Copyright © 2024, The Authors. All rights reserved.

关键词： Coarse-grained modeling

An Improved SSD for small target detection

学校读者我要写书评

暂无评论

An Improved SSD for small target detection

作者： Xiang Li Haibo LuoX Key Laboratory of Opt-Electronic Information Processing Chinese Academy of Sciences Shenyang Institute of Automation Chinese Academy of Sciences Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences University of Chinese Academy of Sciences The Key Laboratory of Image Understanding and Computer Vision

SSD is one of heuristic one-stage target detection *** it has got impressive results in general target detection,it still struggles in small-size object detection and precise *** this paper,we proposed an improved SSD which forces on the small-size target *** include a shallow and high resolution feature into the hierarchical detection feature which are used for ***,we fuse the detection features(including the shallow and high resolution one) as a feature pyramid through some 1 × 1 convolution layers and unsample operations to pass information from deep features to the shallow ones,aiming to enrich the semantic information of the shallow *** make the network easier to converge,we add a L2 normalization to the bottom detection feature of the feature pyramid to make a norm balance between each pyramid *** experimental results on the VEDAI dataset show that the proposed method has obtained impressive progress than the original SSD for the small targets detection.

关键词： Convolution neural network Target detection SSD Small targets

Corrigendum to “PSFHS challenge report: pubic symphysis and fetal head segmentation from intrapartum ultrasound images” [Medical Image Analysis 99 (2025),103353]

学校读者我要写书评

暂无评论

Medical Image Analysis 2025年

作者： Jieyun Bai Zihao Zhou Zhanhong Ou Gregor Koehler Raphael Stock Klaus Maier-Hein Marawan Elbatel Robert Martí Xiaomeng Li Yaoyang Qiu Panjie Gou Gongping Chen Lei Zhao Jianxun Zhang Yu Dai Fangyijie Wang Guénolé Silvestre Kathleen Curran Hongkun Sun Jing Xu Karim Lekadir Guangdong Provincial Key Laboratory of Traditional Chinese Medicine Informatization Jinan University Guangzhou China Auckland Bioengineering Institute The University of Auckland Auckland New Zealand Division of Medical Image Computing German Cancer Research Center (DKFZ) Heidelberg Germany Department of Computer Science and Engineering The Chinese University of Hong Kong China Computer Vision and Robotics Group University of Girona Girona Spain Canon Medical Systems (China) Co. LTD Beijing China College of Artificial Intelligence Nankai University Tianjin China College of Computer Science and Electronic Engineering Hunan University Changsha China School of Medicine University College Dublin Dublin Ireland School of Computer Science University College Dublin Dublin Ireland School of Statistics & Mathematics Zhejiang Gongshang University Hangzhou China Departament de Matemàtiques i Informàtica Universitat de Barcelona Barcelona Spain Institució Catalana de Recerca i Estudis Avançats (ICREA) Barcelona Spain

Super-resolving Compressed Images via Parallel and Series Integration of Artifact Reduction and Resolution Enhancement

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Luo, Hongming Zhou, Fei Liao, Guangsen Qiu, Guoping College of Electronics and Information Engineering Shenzhen University China Peng Cheng Laboratory Shenzhen China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen China Shenzhen Key Laboratory of Digital Creative Technology China Shenzhen Institute for Artificial Intelligence and Robotics for Society Shenzhen China School of Computer Science University of Nottingham NottinghamNG8 1BB United Kingdom Guangdong-Hong Kong Joint Laboratory for Big Data Imaging and Communication Guangdong Shenzhen China

In real-world applications, such as sharing photos on social media platforms, images are always not only sub-sampled but also heavily compressed thus often containing various artefacts. Simple methods for enhancing the resolution of such images will exacerbate the artefacts, rendering them visually objectionable. In spite of its high practical values, super-resolving compressed images is not well studied in the literature. In this paper, we propose a novel compressed image super resolution (CISR) framework based on parallel and series integration of artefacts removal and resolution enhancement. Based on a mathematical inference model for estimating a clean low-resolution (LR) image and a clean high-resolution (HR) image from a down-sampled and compressed observation, we have designed a CISR architecture consisting of two deep neural network modules: the artefacts removal module (ARM) and the resolution enhancement module (REM). The ARM and the REM work in parallel with both taking the compressed LR image as their inputs, at the same time they also work in series with the REM taking the output of the ARM as one of its inputs and the ARM taking the output of the REM as its other input. A technique called unfolding is introduced to recursively suppress the compression artefacts and restore the image resolution. A unique feature of our CISR system is that it exploits the parallel and series connections between the ARM and the REM, and recursive optimization to reduce the model's dependency on specific types of degradation thus making it possible to train a single model to super-resolve images compressed by different methods to different qualities. Experiments are conducted on a mixture of JPEG and WebP compressed images without assuming apriori compression type and compression quality factor. To demonstrate our technique's real-world application value, we have also applied the trained models directly to restore social media images which have undergone scaling and compre

关键词： Deep neural networks

Mx2M: Masked Cross-Modality Modeling in Domain Adaptation for 3D Semantic Segmentation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhang, Boxiang Wang, Zunran Ling, Yonggen Guan, Yuanyuan Zhang, Shenghao Li, Wenhui College of Computer Science and Technology Jilin University Changchun China Robotics X Tencent Shenzhen China Key Laboratory of Symbolic Computation and Knowledge Engineer Jilin University Changchun China

Existing methods of cross-modal domain adaptation for 3D semantic segmentation predict results only via 2D-3D complementarity that is obtained by cross-modal feature matching. However, as lacking supervision in the target domain, the complementarity is not always reliable. The results are not ideal when the domain gap is large. To solve the problem of lacking supervision, we introduce masked modeling into this task and propose a method Mx2M, which utilizes masked cross-modality modeling to reduce the large domain gap. Our Mx2M contains two components. One is the core solution, cross-modal removal and prediction (xMRP), which makes the Mx2M adapt to various scenarios and provides cross-modal self-supervision. The other is a new way of cross-modal feature matching, the dynamic cross-modal filter (DxMF) that ensures the whole method dynamically uses more suitable 2D-3D complementarity. Evaluation of the Mx2M on three DA scenarios, including Day/Night, USA/Singapore, and A2D2/SemanticKITTI, brings large improvements over previous methods on many metrics. Copyright © 2023, The Authors. All rights reserved.

关键词： Semantic Segmentation

EfficientFCN: Holistically-guided decoding for semantic segmentation

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Liu, Jianbo He, Junjun Zhang, Jiawei Ren, Jimmy S. Li, Hongsheng CUHK-SenseTime Joint Laboratory Chinese University of Hong Kong Hong Kong Shenzhen Key Lab of Computer Vision and Pattern Recognition Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China SenseTime Research China

Both performance and efficiency are important to semantic segmentation. State-of-the-art semantic segmentation algorithms are mostly based on dilated Fully Convolutional Networks (dilatedFCN), which adopt dilated convolutions in the backbone networks to extract high-resolution feature maps for achieving high-performance segmentation performance. However, due to many convolution operations are conducted on the high-resolution feature maps, such dilatedFCN-based methods result in large computational complexity and memory consumption. To balance the performance and efficiency, there also exist encoder-decoder structures that gradually recover the spatial information by combining multi-level feature maps from the encoder. However, the performances of existing encoder-decoder methods are far from comparable with the dilatedFCN-based methods. In this paper, we propose the EfficientFCN, whose backbone is a common ImageNet pretrained network without any dilated convolution. A holistically-guided decoder is introduced to obtain the high-resolution semantic-rich feature maps via the multi-scale features from the encoder. The decoding task is converted to novel codebook generation and codeword assembly task, which takes advantages of the high-level and low-level features from the encoder. Such a framework achieves comparable or even better performance than state-of-the-art methods with only 1/3 of the computational cost. Extensive experiments on PASCAL Context, PASCAL VOC, ADE20K validate the effectiveness of the proposed EfficientFCN. Copyright © 2020, The Authors. All rights reserved.

关键词： Convolution

OSRT: Omnidirectional Image Super-Resolution with Distortion-aware Transformer

学校读者我要写书评

暂无评论

OSRT: Omnidirectional Image Super-Resolution with Distortion...

Conference on computer vision and Pattern Recognition (CVPR)

作者： Fanghua Yu Xintao Wang Mingdeng Cao Gen Li Ying Shan Chao Dong ShenZhen Key Lab of Computer Vision and Pattern Recognition Shenzhen Institute of Advanced Technology Chinese Academy of Sciences ARC Tencent PCG The University of Tokyo Platform Technologies Tencent Online Video Shanghai Artificial Intelligence Laboratory

Omnidirectional images (ODIs) have obtained lots of research interest for immersive experiences. Although ODIs require extremely high resolution to capture details of the entire scene, the resolutions of most ODIs are insufficient. Previous methods attempt to solve this issue by image super-resolution (SR) on equirectangular projection (ERP) images. However, they omit geometric properties of ERP in the degradation process, and their models can hardly generalize to real ERP images. In this paper, we propose Fisheye downsampling, which mimics the real-world imaging process and synthesizes more realistic low-resolution samples. Then we design a distortion-aware Transformer (OSRT) to modulate ERP distortions continuously and self-adaptively. Without a cumbersome process, OSRT outperforms previous methods by about 0.2dB on PSNR. Moreover, we propose a convenient data augmentation strategy, which synthesizes pseudo ERP images from plain images. This simple strategy can alleviate the over-fitting problem of large networks and significantly boost the performance of ODISR. Extensive experiments have demonstrated the state-of-the-art performance of our OSRT.

关键词：

GRATIS: Deep Learning Graph Representation with Task-specific Topology and Multi-dimensional Edge Features

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Song, Siyang Song, Yuxin Luo, Cheng Song, Zhiyuan Kuzucu, Selim Jia, Xi Guo, Zhijiang Xie, Weicheng Shen, Linlin Gunes, Hatice The Department of Computer Science and Technology University of Cambridge CambridgeCB3 0FT United Kingdom Baidu Inc Beijing100193 China Computer Vision Institute School of Computer Science & Software Engineering Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518060 China Department of Computer Engineering Middle East Technical University Ankara Turkey School of Computer Science University of Birmingham Birmingham United Kingdom

Graph is powerful for representing various types of real-world data. The topology (edges’ presence) and edges’ features of a graph decides the message passing mechanism among vertices within the graph. While most existing approaches only manually define a single-value edge to describe the connectivity or strength of association between a pair of vertices, task-specific and crucial relationship cues may be disregarded by such manually defined topology and single-value edge features. In this paper, we propose the first general graph representation learning framework (called GRATIS) which can generate a strong graph representation with a task-specific topology and task-specific multi-dimensional edge features from any arbitrary input (i.e., graph or non-graph data). To learn each edge’s presence and multi-dimensional feature, our framework takes both of the corresponding vertices pair and their global contextual information into consideration, enabling the generated graph representation to have a globally optimal message passing mechanism for different down-stream tasks. The principled investigation results achieved for various graph analysis tasks (e.g., graph classification, vertex classification, and link prediction) on 11 graph and non-graph datasets show that our GRATIS can not only largely enhance pre-defined graphs but also learns a strong graph representation for non-graph data, with clear performance improvements on all tasks. In particular, the learned topology and multi-dimensional edge features provide complementary task-related cues for graph analysis tasks. Our framework is effective, robust and flexible, and is a plug-and-play module that can be combined with different backbones and Graph Neural Networks (GNNs) to generate a task-specific graph representation from various graph and non-graph data. Our code is made publicly available at https://***/SSYSteve/Learning-Graph-Representation-with-Task-specific-Topology-and-Multi-dimensional-Edge-Feature

关键词： Graph neural networks

A unified leader-follower scheme for mobile robots with uncalibrated on-board camera

学校读者我要写书评

暂无评论

A unified leader-follower scheme for mobile robots with unca...

2017 IEEE International Conference on robotics and Automation, ICRA 2017

作者： Guo, Dejun Wang, Hesheng Chen, Weidong Liu, Ming Xia, Zeyang Leang, Kam K. Lab University of Utah Robotics Center Salt Lake CityUT84112 United States Department of Automation Shanghai Jiao Tong University Shanghai200240 China Department of Electronics and Computer Engineering Hong Kong University of Science and Technology Hong Kong Hong Kong Institute of Biomedical and Health Engineering Key Laboratory of Human-Machine Intelligence-Synergy Systems Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Shenzhen China

ISBN: (纸本)9781509046331

This paper studies the problem of image-based leader-follower formation control for mobile robots, where the controller is designed independently of the leader's motion. An adaptive control scheme, which is suitable for both omnidirectional and perspective cameras, is proposed. The proposed approach avoids the need for accurate calibration of the extrinsic parameters of the omnidirectional camera as well as the intrinsic and extrinsic parameters of perspective camera. Additionally, the coefficients of the plane where the feature point moves relative to the camera frame can be uncertain. These uncertain constant parameters are estimated using an adaptive estimator. Uniform Semi-global Practical Asymptotic Stability (USPAS) of the system is shown using the Lyapunov approach. Experimental results are presented to demonstrate the effectiveness of the proposed control scheme. © 2017 IEEE.

关键词： Mobile robots