检索结果-内蒙古大学图书馆

Weak-Mamba-UNet: visual Mamba Makes CNN and ViT Work Better for Scribble-based Medical Image Segmentation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Ziyang Ma, Chao Department of Computer Science University of Oxford United Kingdom Mianyang Visual Object Detection and Recognition Engineering Center China

Medical image segmentation is increasingly reliant on deep learning techniques, yet the promising performance often come with high annotation costs. This paper introduces Weak-Mamba-UNet, an innovative weakly-supervised learning (WSL) framework that leverages the capabilities of Convolutional Neural Network (CNN), Vision Transformer (ViT), and the cutting-edge visual Mamba (VMamba) architecture for medical image segmentation, especially when dealing with scribble-based annotations. The proposed WSL strategy incorporates three distinct architecture but same symmetrical encoder-decoder networks: a CNN-based UNet for detailed local feature extraction, a Swin Transformer-based SwinUNet for comprehensive global context understanding, and a VMamba-based Mamba-UNet for efficient long-range dependency modeling. The key concept of this framework is a collaborative and cross-supervisory mechanism that employs pseudo labels to facilitate iterative learning and refinement across the networks. The effectiveness of Weak-Mamba-UNet is validated on a publicly available MRI cardiac segmentation dataset with processed scribble annotations, where it surpasses the performance of a similar WSL framework utilizing only UNet or SwinUNet. This highlights its potential in scenarios with sparse or imprecise annotations. The source code is made publicly accessible. © 2024, CC BY.

关键词： Network architecture

Highway Obstacle detection Method Based on PP-YOLOv2

学校读者我要写书评

暂无评论

Highway Obstacle Detection Method Based on PP-YOLOv2

International Conference on Network and Information Systems for Computers (ICNISC)

作者： Limei Zhao Luofeng Jiang Liu Yang Fei Yang Mengmeng Yang Tianshu Liu Mianyang Polytechnic Mianyang Visual Target Detection and Recognition Engineering Technology Research Center Mianyang China

In order to solve the problem that obstacles on the highway cannot be identified in time for warning and lead to traffic accidents, this paper uses PP-YOLOv2 target detection algorithm to effectively identify and classify obstacles on the highway. The highway obstacle training set is utilized for model training, and the testing of the training model is completed through the test set. The test results show that compared with the YOLOv5 algorithm, the PP-YOLOv2 algorithm improves the Rvalue and mAP value of highway obstacle target detection by 1.5% and 1.2%, respectively, which verifies the effectiveness of the model. The study can be used for the detection of highway obstacles, and the detection results can be used to provide early warning to traveling vehicles, and provide information support for the traffic control department to dispatch staff to clear obstacles in time, which has certain practical application value.

关键词：

Self-supervised 3D Point Cloud Completion via Multi-view Adversarial Learning

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wu, Lintai Cheng, Xianjing Xu, Yong Zeng, Huanqiang Hou, Junhui Bio-Computing Research Center Harbin Institute of Technology Shenzhen Guangdong Shenzhen518055 China The Department of Computer Science City University of Hong Kong Hong Kong School of Computer Science and Technology Harbin Institute of Technology Shenzhen Guangdong Shenzhen518055 China Department of Computer Science City University of Hong Kong Hong Kong Shenzhen Key Laboratory of Visual Object Detection and Recognition Guangdong Shenzhen518055 China School of Engineering Huaqiao University Quanzhou362021 China School of Information Science and Engineering Huaqiao University Xiamen361021 China

In real-world scenarios, scanned point clouds are often incomplete due to occlusion issues. The task of self-supervised point cloud completion involves reconstructing missing regions of these incomplete objects without the supervision of complete ground truth. Current self-supervised methods either rely on multiple views of partial observations for supervision or overlook the intrinsic geometric similarity that can be identified and utilized from the given partial point clouds. In this paper, we propose MAL-SPC, a framework that effectively leverages both region-level and category-specific geometric similarities to complete missing structures. Our MAL-SPC does not require any 3D complete supervision and only necessitates a single partial point cloud for each object. Specifically, we first introduce a Pattern Retrieval Network to retrieve similar position and curvature patterns between the partial input and the predicted shape, then leverage these similarities to densify and refine the reconstructed results. Additionally, we render the reconstructed complete shape into multi-view depth maps and design an adversarial learning module to learn the geometry of the target shape from category-specific single-view depth images. To achieve anisotropic rendering, we design a density-aware radius estimation algorithm to improve the quality of the rendered images. Our MAL-SPC yields the best results compared to current state-of-the-art methods. We will make the source code publicly available at https://***/ltwu6/malspc. Copyright © 2024, The Authors. All rights reserved.

关键词： Self-supervised learning

DS-TransUNet: Dual swin transformer U-net for medical image segmentation

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Lin, Ailiang Chen, Bingzhi Xu, Jiayu Zhang, Zheng Lu, Guangming Shenzhen Medical Biometrics Perception and Analysis Engineering Laboratory Harbin Institute of Technology Shenzhen518055 China Bio-Computing Research Center Harbin Institute of Technology Shenzhen518055 China Shenzhen Key Laboratory of Visual Object Detection and Recognition Shenzhen518055 China

Automatic medical image segmentation has made great progress benefit from the development of deep learning. However, most existing methods are based on convolutional neural networks (CNNs), which fail to build long-range dependencies and global context connections due to the limitation of receptive field in convolution operation. Inspired by the success of Transformer whose self-attention mechanism has the powerful abilities of modeling the long-range contextual information, some researchers have expended considerable efforts in designing the robust variants of Transformer-based U-Net. Moreover, the patch division used in vision transformers usually ignores the pixel-level intrinsic structural features inside each patch. To alleviate these problems, in this paper, we propose a novel deep medical image segmentation framework called Dual Swin Transformer U-Net (DS-TransUNet), which might be the first attempt to concurrently incorporate the advantages of hierarchical Swin Transformer into both encoder and decoder of the standard U-shaped architecture to enhance the semantic segmentation quality of varying medical images. Unlike many prior Transformer-based solutions, the proposed DS-TransUNet first adopts dual-scale encoder subnetworks based on Swin Transformer to extract the coarse and fine-grained feature representations of different semantic scales. As the core component for our DS-TransUNet, a well-designed Transformer Interactive Fusion (TIF) module is proposed to effectively establish global dependencies between features of different scales through the self-attention mechanism, in order to make full use of these obtained multi-scale feature representations. Furthermore, we also introduce the Swin Transformer block into decoder to further explore the long-range contextual information during the up-sampling process. Extensive experiments across four typical tasks for medical image segmentation demonstrate the effectiveness of DS-TransUNet, and show that our approac

关键词： Semantic Segmentation

Asymmetric CNN for image super-resolution

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Tian, Chunwei Xu, Yong Zuo, Wangmeng Lin, Chia-Wen Zhang, David The Bio-Computing Research Center Harbin Institute of Technology ShenzhenShenzhenGuangdong518055 China Shenzhen Key Laboratory of Visual Object Detection and Recognition ShenzhenGuangdong518055 China The School of Computer Science and Technology Harbin Institute of Technology HarbinHeilongjiang150001 China The Peng Cheng Laboratory ShenzhenGuangdong518055 China Shenzhen Key Laboratory of Visual Object Detection and Recognition Shenzhen Guangdong518055 China The Department of Electrical Engineering The Institute of Communications Engineering National Tsing Hua University Hsinchu Taiwan ShenzhenGuangdong518172 China The Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen China

Deep convolutional neural networks (CNNs) have been widely applied for low-level vision over the past five years. According to nature of different applications, designing appropriate CNN architectures is developed. However, customized architectures gather different features via treating all pixel points as equal to improve the performance of given application, which ignores the effects of local power pixel points and results in low training efficiency. In this paper, we propose an asymmetric CNN (ACNet) comprising an asymmetric block (AB), a memory enhancement block (MEB) and a high-frequency feature enhancement block (HFFEB) for image super-resolution. The AB utilizes one-dimensional asymmetric convolutions to intensify the square convolution kernels in horizontal and vertical directions for promoting the influences of local salient features for SISR. The MEB fuses all hierarchical low-frequency features from the AB via residual learning (RL) technique to resolve the long-term dependency problem and transforms obtained low-frequency features into high-frequency features. The HFFEB exploits low- and high-frequency features to obtain more robust super-resolution features and address excessive feature enhancement problem. Additionally, it also takes charge of reconstructing a high-resolution (HR) image. Extensive experiments show that our ACNet can effectively address single image super-resolution (SISR), blind SISR and blind SISR of blind noise problems. The code of the ACNet is shown at https://***/hellloxiaotian/ACNet. © 2021, CC BY-NC-ND.

关键词： Image enhancement

Lightweight Image Super-Resolution with Enhanced CNN

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Tian, Chunwei Zhuge, Ruibin Wu, Zhihao Xu, Yong Zuo, Wangmeng Chen, Chen Lin, Chia-Wen Bio-Computing Research Center Harbin Institute of Technology Shenzhen ShenzhenGuangdong518055 China Shenzhen Key Laboratory of Visual Object Detection and Recognition ShenzhenGuangdong518055 China Peng Cheng Laboratory ShenzhenGuangdong518055 China School of Computer Science and Technology Harbin Institute of Technology HarbinHeilongjiang150001 China Department of Electrical and Computer Engineering University of North Carolina CharlotteNC28223 United States Department of Electrical Engineering Institute of Communications Engineering National Tsing Hua University Hsinchu Taiwan

Deep convolutional neural networks (CNNs) with strong expressive ability have achieved impressive performances on single image super-resolution (SISR). However, their excessive amounts of convolutions and parameters usually consume high computational cost and more memory storage for training a SR model, which limits their applications to SR with resource-constrained devices in real world. To resolve these problems, we propose a lightweight enhanced SR CNN (LESRCNN) with three successive sub-blocks, an information extraction and enhancement block (IEEB), a reconstruction block (RB) and an information refinement block (IRB). Specifically, the IEEB extracts hierarchical low-resolution (LR) features and aggregates the obtained features step-by-step to increase the memory ability of the shallow layers on deep layers for SISR. To remove redundant information obtained, a heterogeneous architecture is adopted in the IEEB. After that, the RB converts low-frequency features into high-frequency features by fusing global and local features, which is complementary with the IEEB in tackling the long-term dependency problem. Finally, the IRB uses coarse high-frequency features from the RB to learn more accurate SR features and construct a SR image. The proposed LESRCNN can obtain a high-quality image by a model for different scales. Extensive experiments demonstrate that the proposed LESRCNN outperforms state-of-the-arts on SISR in terms of qualitative and quantitative evaluation. The code of LESRCNN is accessible on https://***/hellloxiaotian/LESRCNN. Copyright © 2020, The Authors. All rights reserved.

关键词： Convolutional neural networks

Lightweight Image Super-Resolution with Enhanced CNN

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Tian, Chunwei Zhuge, Ruibin Wu, Zhihao Xu, Yong Zuo, Wangmeng Chen, Chen Lin, Chia-Wen Bio-Computing Research Center Harbin Institute of Technology Shenzhen ShenzhenGuangdong518055 China Shenzhen Key Laboratory of Visual Object Detection and Recognition ShenzhenGuangdong518055 China Peng Cheng Laboratory ShenzhenGuangdong518055 China School of Computer Science and Technology Harbin Institute of Technology HarbinHeilongjiang150001 China Department of Electrical and Computer Engineering University of North Carolina at Charlotte NC28223 United States Department of Electrical Engineering Institute of Communications Engineering National Tsing Hua University Hsinchu Taiwan

关键词： Convolutional neural networks

Designing and Training of A Dual CNN for Image Denoising

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Zuo, Wangmeng Zhang, David Lin, Chia-Wen Xu, Yong Tian, Chunwei Du, Bo Bio-Computing Research Center Harbin Institute of Technology Shenzhen China Shenzhen Key Laboratory of Visual Object Detection and Recognition ShenzhenGuangdong518055 China Peng Cheng Laboratory Shenzhen518055 China School of Computer Science and Technology Harbin Institute of Technology 150001 HarbinHeilongjiang China Peng Cheng Laboratory Shenzhen518055 China School of Computer Science Wuhan University 430072 WuhanHubei China Department of Electrical Engineering Institute of Communications Engineering National Tsing Hua University Hsinchu Taiwan 518172 ShenzhenGuangdong China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen China

Deep convolutional neural networks (CNNs) for image denoising have recently attracted increasing research interest. However, plain networks cannot recover fine details for a complex task, such as real noisy images. In this paper, we propose a Dual denoising Network (DudeNet) to recover a clean image. Specifically, DudeNet consists of four modules: a feature extraction block, an enhancement block, a compression block, and a reconstruction block. The feature extraction block with a sparse mechanism extracts global and local features via two sub-networks. The enhancement block gathers and fuses the global and local features to provide complementary information for the latter network. The compression block refines the extracted information and compresses the network. Finally, the reconstruction block is utilized to reconstruct a denoised image. The DudeNet has the following advantages: (1) The dual networks with a parse mechanism can extract complementary features to enhance the generalized ability of denoiser. (2) Fusing global and local features can extract salient features to recover fine details for complex noisy images. (3) A Small-size filter is used to reduce the complexity of denoiser. Extensive experiments demonstrate the superiority of DudeNet over existing current state-of-the-art denoising methods. Copyright © 2020, The Authors. All rights reserved.

关键词： Recovery

Deep learning on image denoising: An overview

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Tian, Chunwei Fei, Lunke Zheng, Wenxian Xu, Yong Zuo, Wangmeng Lin, Chia-Wen Bio-Computing Research Center Harbin Institute of Technology Shenzhen Shenzhen Guangdong518055 China Shenzhen Key Laboratory of Visual Object Detection and Recognition Shenzhen Guangdong518055 China School of Computers Guangdong University of Technology Guangzhou Guangdong510006 China Tsinghua Shenzhen International Graduate School Shenzhen Guangdong518055 China Peng Cheng Laboratory Shenzhen Guangdong518055 China School of Computer Science and Technology Harbin Institute of Technology Harbin Heilongjiang150001 China Department of Electrical Engineering Institute of Communications Engineering National Tsing Hua University Hsinchu Taiwan

Deep learning techniques have obtained much attention in image denoising. However, deep learning methods of different types deal with the noise have enormous differences. Specifically, discriminative learning based on deep learning can well address the Gaussian noise. Optimization model methods based on deep learning have good effect on estimating of the real noise. So far, there are little related researches to summarize different deep learning techniques for image denoising. In this paper, we make such a comparative study of different deep techniques in image denoising. We first classify the (1) deep convolutional neural networks (CNNs) for additive white noisy images, (2) deep CNNs for real noisy images, (3) deep CNNs for blind denoising and (4) deep CNNs for hybrid noisy images, which is the combination of noisy, blurred and low-resolution images. Then, we analyze the motivations and principles of deep learning methods of different types. Next, we compare and verify the state-of-the-art methods on public denoising datasets in terms of quantitative and qualitative analysis. Finally, we point out some potential challenges and directions of future research. Copyright © 2019, The Authors. All rights reserved.

关键词： Deep neural networks