检索结果-内蒙古大学图书馆

HIVE-Net: Centerline-Aware HIerarchical View-Ensemble Convolutional Network for Mitochondria Segmentation in EM Images

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Yuan, Zhimin Ma, Xiaofen Yi, Jiajin Luo, Zhengrong Peng, Jialin College of Computer Science and Technology Huaqiao University Xiamen361021 China Department of Medical Imaging Guangdong Second Provincial General Hospital Guangzhou510317 China Xiamen Key Laboratory of Computer Vision and Pattern Recognition Huaqiao University Xiamen361021 China

Background and objective: With the advancement of electron microscopy (EM) imaging technology, neuroscientists can investigate the function of various intracellular organelles, e.g, mitochondria, at nano-scale. Semantic segmentation of electron microscopy (EM) is an essential step to efficiently obtain reliable morphological statistics. Despite the great success achieved using deep convolutional neural networks (CNNs), they still produce coarse segmentations with lots of discontinuities and false positives for mitochondria segmentation. Methods: In this study, we introduce a centerline-aware multitask network by utilizing centerline as an intrinsic shape cue of mitochondria to regularize the segmentation. Since the application of 3D CNNs on large medical volumes is usually hindered by their substantial computational cost and storage overhead, we introduce a novel hierarchical view-ensemble convolution (HVEC), a simple alternative of 3D convolution to learn 3D spatial contexts using more efficient 2D convolutions. The HVEC enables both decomposing and sharing multi-view information, leading to increased learning capacity. Results: Extensive validation results on two challenging benchmarks show that, the proposed method performs favorably against the state-of-the-art methods in accuracy and visual quality but with a greatly reduced model size. Moreover, the proposed model also shows significantly improved generalization ability, especially when training with quite limited amount of training data. Detailed sensitivity analysis and ablation study have also been conducted, which show the robustness of the proposed model and effectiveness of the proposed modules. Conclusions: The experiments highlighted that the proposed architecture enables both simplicity and efficiency leading to increased capacity of learning spatial contexts. Moreover, incorporating shape cues such as centerline information is a promising approach to improve the performance of mitochondria segmentati

关键词： Convolution

A Riemannian Residual Learning Mechanism for SPD Network

学校读者我要写书评

暂无评论

A Riemannian Residual Learning Mechanism for SPD Network

International Joint Conference on Neural Networks (IJCNN)

作者： Zhenyu Cai Rui Wang Tianyang Xu Xiaojun Wu Josef Kittler School of Artificial Intelligence and Computer Science Jiangnan University Wuxi China Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Wuxi China Centre for Vision Speech and Signal Processing University of Surrey Guildford U.K.

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

The generalization of Euclidean network paradigm to the Riemannian manifolds has attracted much attention for offering useful geometric representations in processing manifold-valued data in recent years. However, the information degradation during data compression mapping hinders Riemannian networks from going deeper, and there are very few solutions specifically designed for this problem. Given the remarkable success of deep Residual learning in Euclidean networks, a novel Riemannian residual learning mechanism (RRLM) is proposed in the context of Symmetric Positive Definite (SPD) manifolds, enabling the characterization of deep spatiotemporal features while preserving the manifold properties. Based on RRLM, a stack of SPD manifold-constrained residual-like blocks is designed on the tail of the original SPDNet(backbone) for the sake of conducting deep Riemannian residual learning. For simplicity, we refer to the network architecture introduced above as Riemannian residual SPD network (ResSPDNet). The experimental results achieved on three types of visual classification tasks, i.e., facial emotion recognition, drone recognition, and action recognition, demonstrate that our method can achieve improved accuracy with a deepened network structure.

关键词： Manifolds Learning systems Degradation Emotion recognition Visualization Accuracy Face recognition

From recognition to Prediction: Leveraging Sequence Reasoning for Action Anticipation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Xin Hao, Chao Yu, Zitong Yue, Huanjing Yang, Jingyu School of Electrical and Information Engineering Tianjin University China Computer Vision and Pattern Recognition Laboratory School of Engineering Sciences Lappeenranta-Lahti University of Technology LUT Finland School of Computing and Information Technology Great Bay University China

The action anticipation task refers to predicting what action will happen based on observed videos, which requires the model to have a strong ability to summarize the present and then reason about the future. Experience and common sense suggest that there is a significant correlation between different actions, which provides valuable prior knowledge for the action anticipation task. However, previous methods have not effectively modeled this underlying statistical relationship. To address this issue, we propose a novel end-to-end video modeling architecture that utilizes attention mechanisms, named Anticipation via recognition and Reasoning (ARR). ARR decomposes the action anticipation task into action recognition and sequence reasoning tasks, and effectively learns the statistical relationship between actions by next action prediction (NAP). In comparison to existing temporal aggregation strategies, ARR is able to extract more effective features from observable videos to make more reasonable predictions. In addition, to address the challenge of relationship modeling that requires extensive training data, we propose an innovative approach for the unsupervised pre-training of the decoder, which leverages the inherent temporal dynamics of video to enhance the reasoning capabilities of the network. Extensive experiments on the Epic-kitchen-100, EGTEA Gaze+, and 50salads datasets demonstrate the efficacy of the proposed methods. The code is available at https://***/linuxsino/ARR. Copyright © 2024, The Authors. All rights reserved.

关键词： Video analysis

Answering Diverse Questions via Text Attached with Key Audio-Visual Clues

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Ye, Qilang Yu, Zitong Liu, Xin The School of Computing and Information Technology Great Bay University Dongguan523000 China The School of Computer Science and Engineering Chongqing University of Technology Chongqing401300 China The Computer Vision and Pattern Recognition Laboratory Lappeenranta-Lahti University of Technology LUT Lappeenranta53850 Finland

Audio-visual question answering (AVQA) requires reference to video content and auditory information, followed by correlating the question to predict the most precise answer. Although mining deeper layers of audio-visual information to interact with questions facilitates the multimodal fusion process, the redundancy of audio-visual parameters tends to reduce the generalization of the inference engine to multiple question-answer pairs in a single video. Indeed, the natural heterogeneous relationship between audiovisuals and text makes the perfect fusion challenging, to prevent high-level audio-visual semantics from weakening the network’s adaptability to diverse question types, we propose a framework for performing mutual correlation distillation (MCD) to aid question inference. MCD is divided into three main steps: 1) firstly, the residual structure is utilized to enhance the audio-visual soft associations based on self-attention, then key local audio-visual features relevant to the question context are captured hierarchically by shared aggregators and coupled in the form of clues with specific question vectors. 2) Secondly, knowledge distillation is enforced to align audiovisual-text pairs in a shared latent space to narrow the cross-modal semantic gap. 3) And finally, the audio-visual dependencies are decoupled by discarding the decision-level integrations. We evaluate the proposed method on two publicly available datasets containing multiple question-and-answer pairs, i.e., Music-AVQA and AVQA. Experiments show that our method outperforms other state-of-the-art methods, and one interesting finding behind is that removing deep audio-visual features during inference can effectively mitigate overfitting. The source code is released at http://***/rikeilong/MCD-forAVQA. © 2024, CC BY.

关键词： Distillation

Efficient Image Super-Resolution using Vast-Receptive-Field Attention

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zhou, Lin Cai, Haoming Gu, Jinjin Li, Zheyuan Liu, Yingqi Chen, Xiangyu Qiao, Yu Dong, Chao ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China Shanghai AI Laboratory Shanghai China The University of Sydney Australia University of Macau China

The attention mechanism plays a pivotal role in designing advanced super-resolution (SR) networks. In this work, we design an efficient SR network by improving the attention mechanism. We start from a simple pixel attention module and gradually modify it to achieve better super-resolution performance with reduced parameters. The specific approaches include: (1) increasing the receptive field of the attention branch, (2) replacing large dense convolution kernels with depth-wise separable convolutions, and (3) introducing pixel normalization. These approaches paint a clear evolutionary roadmap for the design of attention mechanisms. Based on these observations, we propose VapSR, the VAst-receptive-field Pixel attention network. Experiments demonstrate the superior performance of VapSR. VapSR outperforms the present lightweight networks with even fewer parameters. And the light version of VapSR can use only 21.68% and 28.18% parameters of IMDB and RFDN to achieve similar performances to those networks. The code and models are available at https://***/zhoumumu/VapSR. Copyright © 2022, The Authors. All rights reserved.

关键词： Pixels

Blueprint Separable Residual Network for Efficient Image Super-Resolution

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Zheyuan Liu, Yingqi Chen, Xiangyu Cai, Haoming Gu, Jinjin Qiao, Yu Dong, Chao ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China University of Macau China Shanghai AI Laboratory Shanghai China The University of Sydney Australia

Recent advances in single image super-resolution (SISR) have achieved extraordinary performance, but the computational cost is too heavy to apply in edge devices. To alleviate this problem, many novel and effective solutions have been proposed. Convolutional neural network (CNN) with the attention mechanism has attracted increasing attention due to its efficiency and effectiveness. However, there is still redundancy in the convolution operation. In this paper, we propose Blueprint Separable Residual Network (BSRN) containing two efficient designs. One is the usage of blueprint separable convolution (BSConv), which takes place of the redundant convolution operation. The other is to enhance the model ability by introducing more effective attention modules. The experimental results show that BSRN achieves state-of-the-art performance among existing efficient SR methods. Moreover, a smaller variant of our model BSRN-S won the first place in model complexity track of NTIRE 2022 Efficient SR Challenge. The code is available at https://***/xiaom233/BSRN. Copyright © 2022, The Authors. All rights reserved.

关键词： Blueprints

Pose focus transformer meet inter-part relation

学校读者我要写书评

暂无评论

Expert Systems with Applications 2024年 240卷

作者： Luo, Yanmin Lin, Hongwei Huang, Wenlin Wang, Youjie Du, Jixiang Guo, Jing-Ming College of Computer Science and Technology Huaqiao University Xiamen361021 China Xiamen Key Laboratory of Computer Vision and Pattern Recognition Huaqiao University Xiamen361021 China Maynooth International Engineering College Fuzhou University Fuzhou350108 China Department of Electrical Engineering National Taiwan University of Science and Technology Taipei10607 China

Human pose estimation in crowded scenes is a challenging task. Due to overlap and occlusion, it is difficult to infer pose clues from individual keypoints. We proposed PFFormer, a new transformer-based approach that treats pose estimation as a hierarchical set prediction problem that first focuses on human windows and coarsely predicts whole-body poses globally within them. In PFFormer, we designed a Windows Clustering Transformer (WCT), which reorganizes the image windows by filtering the attentive windows and fusing the inattentive ones, allowing the transformer to focus on the important regions while reducing the interference from the complex background, followed by compensating for the loss of information with a global transformer. Then we partition the learned body pose into a set of structural parts and perform the Inter-Part Relation Module (IPRM) to capture the correlation between multiple parts. These full-body poses and component features are refined at a finer level through the Part-to-Joint Decoder (PJD). Extensive experiments show that PFFormer performs favorably against its counterpart on challenging datasets, including COCO2017, CrowdPose, and OChuman datasets. The performance of crowded scenes, in particular, demonstrates the robustness of the proposed methods to deal with occlusion. © 2023 Elsevier Ltd

关键词： Information filtering

Co-clustering Documents and Words Using Bipartite Isoperimetric Graph Partitioning

学校读者我要写书评

暂无评论

Co-clustering Documents and Words Using Bipartite Isoperimet...

IEEE International Conference on Data Mining (ICDM)

作者： Manjeet Rege Ming Dong Farshad Fotouhi Machine Vision and Pattern Recognition Laboratory Database and Multimedia Systems GroupDepartment of Computer Science Wayne State University Detroit MI USA Database and Multimedia Systems Group Database and Multimedia Systems GroupDepartment of Computer Science Wayne State University Detroit MI USA

In this paper, we present a novel graph theoretic approach to the problem of document-word co-clustering. In our approach, documents and words are modeled as the two vertices of a bipartite graph. We then propose isoperimetric co-clustering algorithm (ICA) - a new method for partitioning the document-word bipartite graph. ICA requires a simple solution to a sparse system of linear equations instead of the eigenvalue or SVD problem in the popular spectral co-clustering approach. Our extensive experiments performed on publicly available datasets demonstrate the advantages of ICA over spectral approach in terms of the quality, efficiency and stability in partitioning the document-word bipartite graph.

关键词： Bipartite graph Partitioning algorithms Independent component analysis Equations Eigenvalues and eigenfunctions Stability Data mining Random variables Mutual information Machine vision

DAPlankton: Benchmark Dataset For Multi-Instrument Plankton recognition Via Fine-Grained Domain Adaptation

学校读者我要写书评

暂无评论

DAPlankton: Benchmark Dataset For Multi-Instrument Plankton ...

IEEE International Conference on Image Processing

作者： Daniel Batrakhanov Tuomas Eerola Kaisa Kraft Lumi Haraguchi Lasse Lensu Sanna Suikkanen María Teresa Camarena-Gómez Jukka Seppälä Heikki Kälviäinen Computer Vision and Pattern Recognition Laboratory LUT University Finland Research Infrastructure Finnish Environment Institute Finland Marine and Freshwater Solutions Finnish Environment Institute Finland Centro Oceanografico de Malaga Instituto Español de Oceanografia Spain

ISBN: (数字)9798350349399

ISBN: (纸本)9798350349405

Plankton recognition provides novel possibilities to study various environmental aspects and an interesting real-world context to develop domain adaptation (DA) methods. Different imaging instruments cause domain shift between datasets hampering the development of general plankton recognition methods. A promising remedy for this is DA allowing to adapt a model trained on one instrument to other instruments. In this paper, we present a new DA dataset called DAPlankton which consists of phytoplankton images obtained with different instruments. Phytoplankton provides a challenging DA problem due to the fine-grained nature of the task and high class imbalance in real-world datasets. DAPlankton consists of two subsets. $\mathrm{DAPlankton}_{\text {LAB }}$ contains images of cultured phytoplankton providing a balanced dataset with minimal label uncertainty. $\mathrm{DAPlankton}_{\text {SEA }}$ consists of images collected from the Baltic Sea providing challenging real-world data with large intra-class variance and class imbalance. We further present a benchmark comparison of three widely used DA methods.

关键词： Adaptation models Image recognition Uncertainty Protocols Target recognition Instruments Imaging