检索结果-内蒙古大学图书馆

Interaction Confidence Attention for Human–Object Interaction Detection

International Journal of computer vision 2025年 1-20页

作者： Zhang, Hong-Bo Lin, Wang-Kai Su, Hang Lei, Qing Liu, Jing-Hua Du, Ji-Xiang Department of Computer Science and Technology Huaqiao University Xiamen361021 China Fujian Key Laboratory of Big Data Intelligence and Security Huaqiao University Xiamen361021 China Xiamen Key Laboratory of Computer Vision and Pattern Recognition Huaqiao University Xiamen361021 China Fujian Province University Xiamen361021 China

In human–object interaction (HOI) detection task, ensuring that interactive pairs receive higher attention weights while reducing the weight of non-interaction pairs is imperative for enhancing HOI detection accuracy. Guiding attention learning is also a key aspect of existing transformer-based algorithms. To tackle this challenge, this study proposes a novel approach termed Interaction Confidence Score Learning Attention (ICSLA), which introduces weakening and augmentation operations into the original attention weight calculation and feature extraction processes. In ICSLA, feature learning is coupled with confidence score learning, simultaneously. Leveraging ICSLA, a new and universal decoder is devised, establishing a transformer-based one-stage HOI detection architecture. Experimental results demonstrate the effectiveness of the proposed method in improving HOI detection accuracy, offering valuable insights for further optimization of attention mechanisms. © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2025.

关键词： Augmentation operation Human–object interaction detection Interaction confidence score learning attention Weakening operation

来源：评论

学校读者我要写书评

暂无评论

A New HourGlass Network for Detecting Text in Shaky and Non-shaky Video Frames 27th

A New HourGlass Network for Detecting Text in Shaky and Non-...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Halder, Arnab Palaiahnakote, Shivakumara Pal, Umapada Blumenstein, Michael Gornale, Shivanand S. Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata Kolkata India School of Science Engineering and Environment University of Salford Manchester United Kingdom University of Technology Sydney Sydney Australia Department of Computer Science Rani Channamma University Belagavi India

ISBN: (纸本)9783031784972

Shaky and non-shaky videos are quite common in real-time applications such as surveillance and monitoring vehicles and human movements in protected areas. As a result, text detection in such videos is a formidable challenge due to motion blur, noise, shaky cameras, poor quality and poor visibility. In contrast to existing text detection methods, which focus on text detection in scene images or specific types of images, the present work focuses on text detection in both shaky and non-shaky video frames. Inspired by the impressive performance of the HourGlass network for adverse situations, we explore the HourGlass network for successful text detection in shaky, non-shaky video frames and natural scene images. To improve the performance of the HourGlass network, we employ the Real-Time Model (RTMHead) for predicting text precisely and the Cross Stage Partial Network (CSPNet), which is a neck architecture for robust feature fusion. In addition, the integration of the SiLu activation function with the HourGlass network improves the discriminative power ability. To test the efficacy of the proposed method, we conducted experiments on shaky and non-shaky video frames, as well as ICDAR 2015 video frames. Furthermore, to show the effectiveness of the proposed method, we used Total-Text scene images for experimentation. The results on different datasets and a comparative study with the state-of-the-art models show that the proposed model outperforms the existing methods. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Image enhancement

来源：评论

学校读者我要写书评

暂无评论

Generalist Segmentation Algorithm for Photoreceptors Analysis in Adaptive Optics Imaging 27th

Generalist Segmentation Algorithm for Photoreceptors Analys...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Kulyabin, Mikhail Sindel, Aline Pedersen, Hilde R. Gilson, Stuart Baraas, Rigmor Maier, Andreas Pattern Recognition Lab Department of Computer Science Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany National Centre for Optics Vision and Eye Care Faculty of Health and Social Sciences University of South-Eastern Norway Kongsberg Norway

ISBN: (纸本)9783031781032

Analyzing the cone photoreceptor pattern in images obtained from the living human retina using quantitative methods can be crucial for the early detection and management of various eye conditions. Confocal adaptive optics scanning light ophthalmoscope (AOSLO) imaging enables visualization of the cones from reflections of waveguiding cone photoreceptors. While there have been significant improvements in automated algorithms for segmenting cones in confocal AOSLO images, the process of labeling data remains labor-intensive and manual. This paper introduces a method based on deep learning (DL) for detecting and segmenting cones in AOSLO images. The models were trained on a semi-automatically labeled dataset of 20 AOSLO batches of images of 18 participants for 0∘, 1∘, and 2∘ from the foveal center. F1 scores were 0.968, 0.958, and 0.954 for 0∘, 1∘, and 2∘, respectively, which is better than previously reported DL approaches. Our method minimizes the need for labeled data by only necessitating a fraction of labeled cones, which is especially beneficial in the field of ophthalmology, where labeled data can often be limited. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Adaptive optics

来源：评论

学校读者我要写书评

暂无评论

PulmoNetX: A Hybrid vision Transformer Approach for Multi-scale Spatial Feature Reduction in Pneumonia Classification 27th

PulmoNetX: A Hybrid Vision Transformer Approach for Multi-sc...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Lasker, Asifuzzaman Ghosh, Mridul Obaidullah, Sk Md Chakraborty, Chandan Roy, Kaushik Pal, Umapada Department of Computer Science and Engineering Aliah University Kolkata700160 India Department of Computer Science Shyampur Siddheswari Mahavidyalaya Howrah711312 India Department of Computer Science and Engineering National Institute of Technical Teachers’ Training and Research Kolkata700106 India Department of Computer Science West Bengal State University Barasat700126 India Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata India

ISBN: (纸本)9783031781650

An innovative deep learning structure, PulmoNetX, integrates the capabilities of Convolutional Neural Networks (CNNs) and vision Transformers (ViTs) to enhance pneumonia detection in chest X-ray imagery. During preprocessing, images are normalized in size, converted to grayscale, and subjected to contrast amplification to emphasize essential features. PulmoNetX employs a hybrid methodology to capture both the local and global characteristics of images, leading to significant advancements in diagnosing different pneumonia types, such as COVID-19-induced, viral, and bacterial pneumonia. Comparative studies reveal that PulmoNetX surpasses leading vision Transformer models in terms of precision, recall, F1-score, and overall accuracy, highlighting its advanced processing abilities and its promise as an effective diagnostic tool in X-ray lung disease detection. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Convolutional neural networks

来源：评论

学校读者我要写书评

暂无评论

DATR: Domain Agnostic Text Recognizer 27th

DATR: Domain Agnostic Text Recognizer

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Purkayastha, Kunal Sarkar, Shashwat Palaiahnakote, Shivakumara Pal, Umapada Ghosal, Palash Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata India School of Science Engineering and Environment University of Salford Manchester United Kingdom Department of Information Technology Sikkim Manipal Institute of Technology Sikkim Manipal University Sikkim Gangtok India

ISBN: (纸本)9783031784460

Recognizing text extracted from multiple domains is complex and challenging because complexities vary from one domain to another. Most existing methods focus either on natural scene text or specific text type but not text of multiple domains, namely, scene, underwater, and drone texts. In addition, the state-of-the-art models ignore the vital cues that exist in multiple instances of the text. This paper presents a new method called the Student-Teacher-Assistant (STA) network, which involves dual CLIP models to exploit cues in multiple text instances. The model that uses ResNet50 in its image encoder is called helper CLIP, while the model that uses ViT in its image encoder is called primary CLIP. The proposed work processes both models simultaneously to extract visual and textual features through image and text encoders. Our work uses cosine similarity for the randomly chosen input image to detect instances similar to the input image. The input and similar instances are supplied to primary and helper CLIPs for visual and textual feature extraction. The outputs of dual CLIPs are fused in a different way through the alignment step for recognizing text accurately, irrespective of domains. To demonstrate the proposed model’s significance, experiments are conducted on a set of standard natural scene text datasets (regular and irregular), underwater images, and drone images. The results on three different domains show that the proposed model outperforms the state-of-the-art recognition models. The datasets and code for public use in training and testing shall be made available on GitHub. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Underwater imaging

来源：评论

学校读者我要写书评

暂无评论

A New Attention Based UNet and Gated Edge Attention Network for Retinal Vessel Segmentation 27th

A New Attention Based UNet and Gated Edge Attention Network ...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Roy, Ayush Palaiahnakote, Shivakumara Pal, Umapada Chanda, Sukalpa Department of Electrical Engineering Jadavpur University Kolkata India School of Science Engineering and Environment University of Salford Salford United Kingdom Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata Kolkata India Østfold University College Halden Norway

ISBN: (纸本)9783031781032

Early diagnosis of retinal diseases is crucial for preventing blindness. However, due to background variations and degradation in the images, retinal vessel segmentation has become challenging. As a result, accurate segmentation of the retinal vessels is essential for enhancing diagnosis to identify the disease. To achieve this, inspired by the special ability of the attention mechanism, which detects vital regions, and UNet, which segments the vital region, we propose a combination of a new attention mechanism and modified UNet for segmenting vessels in retina images. In the proposed segmentation model, the convolutional blocks have been modified to capture multiscale spatial information by varying the convolution dilation rates. Similarly, the Trainable tanh activation (T-Tanh) is adapted in a new way to identify changes in the flow of the feature gradients to differentiate between the retinal vessel pixels and the background. Furthermore, to make the segmentation robust, the Gated Edge Attention (GEA) network is proposed. The effectiveness of the segmentation is demonstrated by testing on two benchmark datasets, namely, STARE and CHASE. The results show that the performance of the proposed method is superior to the state-of-the-art methods. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Ophthalmology

来源：评论

学校读者我要写书评

暂无评论

A New StyleGAN Latent Space Based Model for Image Style Transfer 27th

A New StyleGAN Latent Space Based Model for Image Style Tran...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Dey, Rakesh Palaiahnakote, Shivakumara Bhattacharya, Saumik Chanda, Sukalpa Pal, Umapada Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata Baranagar India School of Science Engineering and Environment University of Salford Salford United Kingdom Department of Electrical and Electronics Communication IIT-Kharagpur Kharagpur India Østfold University College Halden Norway

ISBN: (纸本)9783031781940

Cross-domain image style transfer task is an attractive topic for several applications, such as image-to-image style transfer, text-to-image style transfer, artistic image generation, etc. In cross-domain image style transfer tasks (e.g., image-to-image style transfer, artistic image-to-image style transfer, text-to-image style transfer, etc.), training becomes cumbersome due to differences in data distribution across domains and complex model architectures. Unlike existing domain adaptation and domain-independent methods that focus on robust and sufficient feature extraction, this work focuses on disentangling the latent space through latent optimization. For this purpose here we propose a new idea of styled image generation from the latent space of StyleGAN which works well for image-to-image and text-to-image style transfer. We critically analyzed the low-dimensional latent structure and its effect on cross-domain image style transfer tasks and finally proposed a method along with a latent optimizing procedure to overcome the problem of style transfer. The experimental results on different standard datasets show that the proposed model is robust, effective, and generic compared to the state-of-the-art models. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Generative adversarial networks

来源：评论

学校读者我要写书评

暂无评论

DITS: A New Domain Independent Text Spotter 27th

DITS: A New Domain Independent Text Spotter

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Purkayastha, Kunal Sarkar, Shashwat Shivakumara, Palaiahnakote Pal, Umapada Ghosal, Palash Wu, Xiao-Jun Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata Baranagar India School of Science Engineering and Environment University of Salford Manchester United Kingdom Department of Information Technology Sikkim Manipal Institute of Technology Sikkim Manipal University Sikkim Gangtok India Jiangnan University Wuxi China

ISBN: (纸本)9783031784941

Text spotting in diverse domains, such as drone-captured images, underwater scenes, and natural scene images, presents unique challenges due to variations in image quality, contrast, text appearance, background complexity, and external factors like water surface reflections and weather conditions. While most existing approaches focus on text spotting in natural scene images, we propose a Domain-Independent Text Spotter (DITS) that effectively handles multiple domains. We innovatively combine the Real-ESRGAN, developed for regular image enhancement, with the DeepSolo, developed for scene text spotting, in an end-to-end fashion for text detection and spotting on images of different domains. The key idea behind our approach is that improving image quality and text-spotting accuracy are complementary goals. Real-ESRGAN enhances image quality, making the text more discernible, while DeepSolo, a state-of-the-art text spotting model, accurately localizes and recognizes text in the enhanced images. We validate the superiority of our proposed model by evaluating it on datasets from drone, underwater, and scene domains (ICDAR 2015, CTW1500, and Total-Text). Furthermore, we demonstrate the domain independence of our model through cross-domain validation, where we train on one domain and test on others. Our dataset and code will be publicly available on GitHub. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Image quality

来源：评论

学校读者我要写书评

暂无评论

Non-Uniform Illumination Attack for Fooling Convolutional Neural Networks

IEEE Transactions on Artificial Intelligence

引用

IEEE Transactions on Artificial Intelligence 2025年

作者： Jain, Akshay Dubey, Shiv Ram Singh, Satish Kumar Santosh, K.C. Chaudhuri, Bidyut Baran Indian Institute of Information Technology Allahabad Computer Vision and Biometrics Lab Department of Information Technology Uttar Pradesh Prayagraj211015 India University of South Dakota AI Research Lab Department of Computer Science VermillionSD57069 United States Indian Statistical Institute Computer Vision and Pattern Recognition Unit Kolkata700108 India

Convolutional Neural Networks (CNNs) have made remarkable strides;however, they remain susceptible to vulnerabilities, particularly to image perturbations that humans can easily recognize. This weakness, often termed as 'attacks,' underscores the limited robustness of CNNs and the need for research into fortifying their resistance against such manipulations. This study introduces a novel Non-Uniform Illumination (NUI) attack technique, where images are subtly altered using varying NUI masks. Extensive experiments are conducted on widely-accepted datasets including CIFAR10, TinyImageNet, CalTech256 and NWPU-RESISC45 focusing on image classification with 12 different NUI masks. The resilience of VGG, ResNet, MobilenetV3-small, InceptionV3 and efficientNet b0 models against NUI attacks are evaluated. Our results show a substantial decline in the CNN models' classification accuracy when subjected to NUI attacks, due to changes in the image pixel value distribution, indicating their vulnerability under non-uniform illumination. To mitigate this, a defense strategy is proposed, including NUI-attacked images, generated through the new NUI transformation, into the training set. The results demonstrate a significant enhancement in CNN model performance when confronted with perturbed images affected by NUI attacks. This strategy seeks to bolster CNN models' resilience against NUI attacks. A comparative study with other attack techniques shows the effectiveness of the NUI attack and defense technique. © 2020 IEEE.

关键词： Convolutional neural networks

来源：评论

学校读者我要写书评

暂无评论

Multi-stage query-based feature generating and encoding for robust early action recognition

引用

Visual computer 2025年 1-17页

作者： Chen, Jie Pan, Wei-Xiang Zhang, Hong-Bo Lin, Ming-Xuan Lei, Qing Liu, Jing-Hua Department of Computer Science and Technology Huaqiao University Xiamen 361021 China Fujxian Key Laboratory of Big Data Intelligence and Security Huaqiao University Xiamen 361021 China Xiamen Key Laboratory of Computer Vision and Pattern Recognition Huaqiao University Xiamen 361021 China

This paper proposes a novel early action recognition (EAR) method based on multi-stage query-based feature generation and encoding. Existing EAR approaches often struggle with the similarity of initial action features, making it challenging to accurately extract discriminative information. To address this, our method divides the unobserved feature reconstruction process into multiple sub-stages, with each stage focusing on generating and restoring a small segment of action information. This segmentation strategy ensures that the reconstructed action information is more consistent with real-world scenarios. Furthermore, we introduce a query encoding network to model the relationships between sub-stage action features, effectively integrating them to enrich feature representations, enhance model generalization, and improve sequence coherence. Experimental results on public datasets HMDB51 and UCF101 demonstrate that our method significantly outperforms existing methods, achieving robust and accurate early action recognition. Specifically, its ability to handle action progression under different observation rates also specifically reflects the robustness of the proposed method. The code of this work is publicly available at https://***/Chenjie0921/Multiple-stage. © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2025.

关键词： Early action recognition Multi-stage query Query encoding Unobserved feature reconstruction

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：