检索结果-内蒙古大学图书馆

A Comprehensive Analysis of Mamba for 3D Volumetric Medical Image Segmentation

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wang, Chaohan Xie, Yutong Chen, Qi Zhou, Yuyin Wu, Qi Australian Institute for Machine Learning The University of Adelaide Adelaide Australia Computer Vision Department MBZUAI Abu Dhabi United Arab Emirates Computer Science and Engineering Department UC Santa Cruz Santa Cruz United States

Mamba, with its selective State Space Models (SSMs), offers a more computationally efficient solution than Transformers for long-range dependency modeling. However, there is still a debate about its effectiveness in high-resolution 3D medical image segmentation. In this study, we present a comprehensive investigation into Mamba’s capabilities in 3D medical image segmentation by tackling three pivotal questions: Can Mamba replace Transformers? Can it elevate multi-scale representation learning? Is complex scanning necessary to unlock its full potential? We evaluate Mamba’s performance across three large public benchmarks—AMOS, TotalSegmentator, and BraTS. Our findings reveal that UlikeMamba, a U-shape Mamba-based network, consistently surpasses UlikeTrans, a U-shape Transformer-based network, particularly when enhanced with custom-designed 3D depthwise convolutions, boosting accuracy and computational efficiency. Further, our proposed multi-scale Mamba block demonstrates superior performance in capturing both fine-grained details and global context, especially in complex segmentation tasks, surpassing Transformer-based counterparts. We also critically assess complex scanning strategies, finding that simpler methods often suffice, while our Tri-scan approach delivers notable advantages in the most challenging scenarios. By integrating these advancements, we introduce a new network for 3D medical image segmentation, positioning Mamba as a transformative force that outperforms leading models such as nnUNet, CoTr, and U-Mamba, offering competitive accuracy with superior computational efficiency. This study provides key insights into Mamba’s unique advantages, paving the way for more efficient and accurate approaches to 3D medical imaging. © 2025, CC BY-NC-ND.

关键词：

Underwater Object Detection Enhancement via Channel Stabilization

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Ali, Muhammad Khan, Salman Department of Machine Learning Mohamed bin Zayed University of AI Abu Dhabi United Arab Emirates Department of Computer Vision Mohamed bin Zayed University of AI Abu Dhabi United Arab Emirates

The complex marine environment exacerbates the challenges of object detection manifold. With the advent of the modern era, marine trash presents a danger to the aquatic ecosystem, and it has always been challenging to address this issue with a complete grip. Therefore, there is a significant need to precisely detect marine deposits and locate them accurately in challenging aquatic surroundings. To ensure the safety of the marine environment caused by waste, the deployment of underwater object detection is a crucial tool to mitigate the harm of such waste. Our work explains the image enhancement strategies used and experiments exploring the best detection obtained after applying these methods. Specifically, we evaluate Detectron 2’s backbone performance using different base models and configurations for the underwater detection task. We first propose a novel channel stabilization technique on top of a simplified image enhancement model to help reduce haze and color cast in training images. The proposed procedure shows improved results on multi-scaled objects present in the data set. Following image processing, we investigate various backbones in Detectron2 to provide the best detection accuracy for these images. In addition, we use a sharpening filter with augmentation techniques. This highlights the profile of the object, which helps us easily recognize it. We demonstrate our results by verifying them on the TrashCan Data set, both instance and material versions. We then explore the best-performing backbone method for this setting. We apply our channel stabilization and augmentation methods to the best-performing technique. We also compare our detection results from Detectron2 using the best backbones with those from Deformable Transformer. The detection result for small-sized objects in the instance-version of TrashCan 1.0 gives us a 9.53% absolute increase in average precision, while for the bounding box, we get an absolute gain of 7% compared to the baseline. The

关键词： Underwater imaging

UAV-Assisted Real-Time Disaster Detection Using Optimized Transformer Model

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Jankovic, Branislava Jangirova, Sabina Ullah, Waseem Khan, Latif U. Guizani, Mohsen Computer Vision Department Mohamed Bin Zayed University of Artificial Intelligence Abu Dhabi United Arab Emirates Machine Learning Department Mohamed Bin Zayed University of Artificial Intelligence Abu Dhabi United Arab Emirates

Dangerous surroundings and difficult-to-reach landscapes introduce significant complications for adequate disaster management and recuperation. These problems can be solved by engaging unmanned aerial vehicles (UAVs) provided with embedded platforms and optical sensors. In this work, we focus on enabling onboard aerial image processing to ensure proper and real-time disaster detection. Such a setting usually causes challenges due to the limited hardware resources of UAVs. However, privacy, connectivity, and latency issues can be avoided. We suggest a UAV-assisted edge framework for disaster detection, leveraging our proposed model optimized for onboard real-time aerial image classification. The optimization of the model is achieved using post-training quantization techniques. To address the limited number of disaster cases in existing benchmark datasets and therefore ensure real-world adoption of our model, we construct a novel dataset, DisasterEye, featuring disaster scenes captured by UAVs and individuals on-site. Experimental results reveal the efficacy of our model, reaching high accuracy with lowered inference latency and memory use on both traditional machines and resource-limited devices. This shows that the scalability and adaptability of our method make it a powerful solution for real-time disaster management on resource-constrained UAV platforms. Copyright © 2025, The Authors. All rights reserved.

关键词： Unmanned aerial vehicles (UAV)

SIR-HCL: Semantic-Inconsistency Reasoning and Hybrid Contrastive learning for Efficient Cross-Emotion Anomaly Detection

学校读者我要写书评

暂无评论

IEEE Transactions on Cognitive and Developmental Systems 2025年

作者： Liu, Xin Chen, Qiyan Cheung, Yiu-Ming Peng, Shu-Juan Huaqiao University Department of Computer Science Xiamen361021 China Hong Kong Baptist University Department of Computer Science SAR Hong Kong Hong Kong Xiamen Key Laboratory of Computer Vision and Pattern Recognition Xiamen361021 China Huaqiao University Fujian Key Laboratory of Big Data Intelligence and Security Xiamen361021 China Huaqiao University Department of Artificial Intelligence Xiamen China Fujian Province University Key Laboratory of Computer Vision and Machine Learning Huaqiao University Xiamen361021 China

Cross-emotion anomaly detection is an emerging and challenging research topic in cognitive analysis field, which aims at identifying the abnormal emotion pair whose semantic patterns are inconsistent across different emotional modalities. To the best of our knowledge, this topic has yet to be well studied, which could potentially benefit lots of valuable cognitive applications such as autistic children diagnosis and criminal deception detection. To this end, this paper proposes an efficient cross-emotion anomaly detection approach via semanticinconsistency reasoning and hybrid contrastive learning (SIR-HCL), which is the first attempt to detect the anomalous emotional pairs across the audio-visual emotions. First, the proposed framework utilizes dual-branch network to obtain the deep emotional features in each modality, and then employs the shared residual block to derive the semantically compatible features. Subsequently, an efficient hybrid contrastive learning approach is designed to enlarge the semantic-inconsistency among abnormal emotional pair with different affective classes, while enhancing the semantic-consistency and increasing the feature correlation between normal emotional pair from the same affective class. At the same time, an efficient bidirectional learning scheme is employed to significantly improve the data utilization and a two-component Beta Mixture Model is adaptively utilized to reason the anomalous emotion pairs. Extensive experiments evaluated on two benchmark datasets show that the proposed SIR-HCL method can well detect the anomalous emotional pairs across audio-visual emotional data, and brings substantial improvements over the state-of-the-art competing methods. © 2016 IEEE.

关键词： Contrastive learning

Blessemflood21: Advancing Flood Analysis with a High-Resolution Georeferenced Dataset for Humanitarian Aid Support

学校读者我要写书评

暂无评论

Blessemflood21: Advancing Flood Analysis with a High-Resolut...

IEEE International Symposium on Geoscience and Remote Sensing (IGARSS)

作者： Vladyslav Polushko Alexander Jenal Jens Bongartz Immanuel Weber Damjan Hatic Ronald Rösch Thomas März Markus Rauhut Andreas Weinmann Image Processing Department Fraunhofer ITWM Kaiserslautern Germany Working Group Algorithms for Computer Vision Imaging and Data Analysis Darmstadt Germany Center for Machine Learning and Sensor Technology Hochschule Koblenz Remagen Germany

ISBN: (数字)9798350360325

ISBN: (纸本)9798350360332

Floods are an increasingly common global threat, causing emergencies and severe damage to infrastructure. During crises, organisations such as the World Food Programme use remotely sensed imagery, typically obtained through drones, for rapid situational analysis to plan life-saving actions. computer vision tools are needed to support task force experts on-site in the evaluation of the imagery to improve their efficiency and to allocate resources strategically. We introduce the BlessemFlood21 dataset to stimulate research on efficient flood detection tools. The imagery was acquired during the 2021 Erftstadt-Blessem flooding event and consists of high-resolution and georeferenced RGB-NIR images. In the resulting RGB dataset, the images are supplemented with detailed water masks, obtained via a semi-supervised human-in-the-loop technique, where in particular the NIR information is leveraged to classify pixels as either water or non-water. We evaluate our dataset by training and testing established Deep learning models for semantic segmentation. With BlessemFlood21 we provide labeled high-resolution RGB data and a baseline for further development of algorithmic solutions tailored to flood detection in RGB imagery.

关键词： Deep learning Training Semantic segmentation Human in the loop Sensors Floods Task analysis

Multi-Task learning for Fatigue Detection and Face Recognition of Drivers via Tree-Style Space-Channel Attention Fusion Network

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Qu, Shulei Gao, Zhenguo Chen, Xiaowei Li, Na Wang, Yakai Wu, Xiaoxiao Department of Computer Science and Technology Huaqiao University Fujian Xiamen361021 China Key Laboratory of Computer Vision Machine Learning of Fujian Provincial Universities Fujian Xiamen361021 China Department of Mechanical Engineering and Automation Huaqiao University Fujian Xiamen361021 China

In driving scenarios, automobile active safety systems are increasingly incorporating deep learning technology. These systems typically need to handle multiple tasks simultaneously, such as detecting fatigue driving and recognizing the driver’s identity. However, the traditional parallel-style approach of combining multiple single-task models tends to waste resources when dealing with similar tasks. Therefore, we propose a novel tree-style multi-task modeling approach for multi-task learning, which rooted at a shared backbone, more dedicated separate module branches are appended as the model pipeline goes deeper. Following the tree-style approach, we propose a multi-task learning model for simultaneously performing driver fatigue detection and face recognition for identifying a driver. This model shares a common feature extraction backbone module, with further separated feature extraction and classification module branches. The dedicated branches exploit and combine spatial and channel attention mechanisms to generate space-channel fused-attention enhanced features, leading to improved detection performance. As only single-task datasets are available, we introduce techniques including alternating updation and gradient accumulation for training our multi-task model using only the single-task datasets. The effectiveness of our tree-style multi-task learning model is verified through extensive validations. © 2024, CC BY.

关键词： Face recognition

BLESSEMFLOOD21: ADVANCING FLOOD ANALYSIS WITH A HIGH-RESOLUTION GEOREFERENCED DATASET FOR HUMANITARIAN AID SUPPORT

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Polushko, Vladyslav Jenal, Alexander Bongartz, Jens Weber, Immanuel Hatic, Damjan Rösch, Ronald März, Thomas Rauhut, Markus Weinmann, Andreas Image Processing Department Fraunhofer ITWM Kaiserslautern Germany Working Group Algorithms for Computer Vision Imaging and Data Analysis Hochschule Darmstadt Darmstadt Germany Center for Machine Learning and Sensor Technology Hochschule Koblenz Remagen Germany

关键词： Floods

B-cos Alignment for Inherently Interpretable CNNs and vision Transformers

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Böhle, Moritz Singh, Navdeeppal Fritz, Mario Schiele, Bernt Department of Computer Vision and Machine Learning Max Planck Institute for Informatics Saarland Informatics Campus Saarbrucken66123 Germany CISPA Helmholtz Center for Information Security Saarbrucken66123 Germany

We present a new direction for increasing the interpretability of deep neural networks (DNNs) by promoting weight-input alignment during training. For this, we propose to replace the linear transformations in DNNs by our novel B-cos transformation. As we show, a sequence (network) of such transformations induces a single linear transformation that faithfully summarises the full model computations. Moreover, the B-cos transformation is designed such that the weights align with relevant signals during optimisation. As a result, those induced linear transformations become highly interpretable and highlight task-relevant features. Importantly, the B-cos transformation is designed to be compatible with existing architectures and we show that it can easily be integrated into virtually all of the latest state of the art models for computer vision-e.g. ResNets, DenseNets, ConvNext models, as well as vision Transformers-by combining the B-cos-based explanations with normalisation and attention layers, all whilst maintaining similar accuracy on ImageNet. Finally, we show that the resulting explanations are of high visual quality and perform well under quantitative interpretability metrics. Copyright © 2023, The Authors. All rights reserved.

关键词： Linear transformations

FetalCLIP: A Visual-Language Foundation Model for Fetal Ultrasound Image Analysis

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Maani, Fadillah Saeed, Numan Saleem, Tausifa Farooq, Zaid Alasmawi, Hussain Diehl, Werner Mohammad, Ameera Waring, Gareth Valappi, Saudabi Bricker, Leanne Yaqub, Mohammad Department of Computer Vision Mohamed bin Zayed University of Artificial Intelligence Abu Dhabi United Arab Emirates Department of Machine Learning Mohamed bin Zayed University of Artificial Intelligence Abu Dhabi United Arab Emirates Abu Dhabi United Arab Emirates

Foundation models are becoming increasingly effective in the medical domain, offering pre-trained models on large datasets that can be readily adapted for downstream tasks. Despite progress, fetal ultrasound images remain a challenging domain for foundation models due to their inherent complexity, often requiring substantial additional training and facing limitations due to the scarcity of paired multimodal data. To overcome these challenges, here we introduce FetalCLIP, a vision-language foundation model capable of generating universal representation of fetal ultrasound images. FetalCLIP was pre-trained using a multimodal learning approach on a diverse dataset of 210,035 fetal ultrasound images paired with text. This represents the largest paired dataset of its kind used for foundation model development to date. This unique training approach allows FetalCLIP to effectively learn the intricate anatomical features present in fetal ultrasound images, resulting in robust representations that can be used for a variety of downstream applications. In extensive benchmarking across a range of key fetal ultrasound applications, including classification, gestational age estimation, congenital heart defect (CHD) detection, and fetal structure segmentation, FetalCLIP outperformed all baselines while demonstrating remarkable generalizability and strong performance even with limited labeled data. We plan to release the FetalCLIP model publicly for the benefit of the broader scientific community © 2025, CC BY-NC-ND.

关键词： Ultrasonic imaging