检索结果-内蒙古大学图书馆

FDDH: Fast discriminative discrete hashing for large-scale cross-modal retrieval

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Liu, Xin Wang, Xingzhi Cheung, Yiu-Ming Department of Computer Science Huaqiao University Xiamen Key Laboratory of Computer Vision and Pattern Recognition Fujian Key Laboratory of Big Data Intelligence and Security Xiamen361021 China School of Electronics and Information Technology Sun Yat-sen University Guangzhou510006 China Department of Computer Science Hong Kong Baptist University Hong Kong Hong Kong

Cross-modal hashing, favored for its effectiveness and efficiency, has received wide attention to facilitating efficient retrieval across different modalities. Nevertheless, most existing methods do not sufficiently exploit the discriminative power of semantic information when learning the hash codes, while often involving time-consuming training procedure for handling the large-scale dataset. To tackle these issues, we formulate the learning of similarity-preserving hash codes in terms of orthogonally rotating the semantic data so as to minimize the quantization loss of mapping such data to hamming space, and propose an efficient Fast Discriminative Discrete Hashing (FDDH) approach for large-scale cross-modal retrieval. More specifically, FDDH introduces an orthogonal basis to regress the targeted hash codes of training examples to their corresponding semantic labels, and utilizes ϵ-dragging technique to provide provable large semantic margins. Accordingly, the discriminative power of semantic information can be explicitly captured and maximized. Moreover, an orthogonal transformation scheme is further proposed to map the nonlinear embedding data into the semantic subspace, which can well guarantee the semantic consistency between the data feature and its semantic representation. Consequently, an efficient closedform solution is derived for discriminative hash code learning, which is very computationally efficient. In addition, an effective and stable online learning strategy is presented for optimizing modality-specific projection functions, featuring adaptivity to different training sizes and streaming data. The proposed FDDH approach theoretically approximates the bi-Lipschitz continuity, runs sufficiently fast, and also significantly improves the retrieval performance over the state-of-the-art methods. The source code is released at: https://***/starxliu/FDDH. © 2021, CC0.

关键词： Hash functions

Reflash Dropout in Image Super-Resolution

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Kong, Xiangtao Liu, Xina Gu, Jinjin Qiao, Yu Dong, Chao ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab. Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China The University of Sydney Australia Shanghai AI Laboratory Shanghai China

Dropout is designed to relieve the overfitting problem in high-level vision tasks but is rarely applied in low-level vision tasks, like image super-resolution (SR). As a classic regression problem, SR exhibits a different behaviour as high-level tasks and is sensitive to the dropout operation. However, in this paper, we show that appropriate usage of dropout benefits SR networks and improves the generalization ability. Specifically, dropout is better embedded at the end of the network and is significantly helpful for the multi-degradation settings. This discovery breaks our common sense and inspires us to explore its working mechanism. We further use two analysis tools – one is from a recent network interpretation work, and the other is specially designed for this task. The analysis results provide side proofs to our experimental findings and show us a new perspective to understand SR networks. Copyright © 2021, The Authors. All rights reserved.

关键词： Optical resolving power

PPT Fusion: Pyramid Patch Transformer for a Case Study in Image Fusion

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Fu, Yu Xu, Tianyang Wu, Xiao-Jun Kittler, Josef Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Jiangnan University Wuxi 214122 China Centre for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

The Transformer architecture has witnessed a rapid development in recent years, outperforming the CNN architectures in many computer vision tasks, as exemplified by the vision Transformers (ViT) for image classification. However, existing visual transformer models aim to extract semantic information for high-level tasks, such as classification and detection. These methods ignore the importance of the spatial resolution of the input image, thus sacrificing the local correlation information of neighboring pixels. In this paper, we propose a Patch Pyramid Transformer(PPT) to effectively address the above issues. Specifically, we first design a Patch Transformer to transform the image into a sequence of patches, where transformer encoding is performed for each patch to extract local representations. In addition, we construct a Pyramid Transformer to effectively extract the non-local information from the entire image. After obtaining a set of multi-scale, multi-dimensional, and multi-angle features of the original image, we design the image reconstruction network to ensure that the features can be reconstructed into the original input. To validate the effectiveness, we apply the proposed Patch Pyramid Transformer to image fusion tasks. The experimental results demonstrate its superior performance, compared to the state-of-the-art fusion approaches, achieving the best results on several evaluation indicators. Thanks to the underlying representational capacity of the PPT network, it can directly be applied to different image fusion tasks without redesigning or retraining the network. Copyright © 2021, The Authors. All rights reserved.

关键词： Deep learning

RFN-Nest: An end-to-end residual fusion network for infrared and visible images

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Li, Hui Wu, Xiao-Jun Kittler, Josef Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Jiangnan University Wuxi214122 China The Center for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

In the image fusion field, the design of deep learning-based fusion methods is far from routine. It is invariably fusion-task specific and requires a careful consideration. The most difficult part of the design is to choose an appropriate strategy to generate the fused image for a specific task in hand. Thus, devising learnable fusion strategy is a very challenging problem in the community of image fusion. To address this problem, a novel end-to-end fusion network architecture (RFN-Nest) is developed for infrared and visible image fusion. We propose a residual fusion network (RFN) which is based on a residual architecture to replace the traditional fusion approach. A novel detail-preserving loss function, and a feature enhancing loss function are proposed to train RFN. The fusion model learning is accomplished by a novel two-stage training strategy. In the first stage, we train an auto-encoder based on an innovative nest connection (Nest) concept. Next, the RFN is trained using the proposed loss functions. The experimental results on public domain data sets show that, compared with the existing methods, our end-to-end fusion network delivers a better performance than the state-of-the-art methods in both subjective and objective evaluation. The code of our fusion method is available at https://***/hli1221/imagefusion-rfn-nest. © 2021, CC BY-NC-ND.

关键词： Image fusion

EDEN: Deep feature distribution pooling for Saimaa ringed seals pattern matching

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Chelak, Ilia Nepovinnykh, Ekaterina Eerola, Tuomas Kälviäinen, Heikki Belykh, Igor Peter the Great St. Petersburg Polytechnic University Saint Petersburg Russia Lappeenranta-Lahti University of Technology LUT School of Engineering Science Department of Computational Engineering Computer Vision and Pattern Recognition Laboratory P.O.Box 20 Lappeenranta53850 Finland

In this paper, pelage pattern matching is considered to solve the individual re-identification of the Saimaa ringed seals. Animal re-identification together with the access to large amount of image material through camera traps and crowd-sourcing provide novel possibilities for animal monitoring and conservation. We propose a novel feature pooling approach that allow aggregating the local pattern features to get a fixed size embedding vector that incorporate global features by taking into account the spatial distribution of features. This is obtained by eigen decomposition of covariances computed for probability mass functions representing feature maps. Embedding vectors can then be used to find the best match in the database of known individuals allowing animal re-identification. The results show that the proposed pooling method outperforms the existing methods on the challenging Saimaa ringed seal image data. © 2021, CC BY-NC-ND.

关键词： pattern matching

MorphMLP: An Efficient MLP-Like Backbone for Spatial-Temporal Representation Learning

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhang, David Junhao Li, Kunchang Wang, Yali Chen, Yunpeng Chandra, Shashwat Qiao, Yu Liu, Luoqi Shou, Mike Zheng National University of Singapore Singapore Meitu Inc China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China Shanghai AI Laboratory China

Recently, MLP-Like networks have been revived for image recognition. However, whether it is possible to build a generic MLP-Like architecture on video domain has not been explored, due to complex spatial-temporal modeling with large computation burden. To fill this gap, we present an efficient self-attention free backbone, namely MorphMLP, which flexibly leverages the concise Fully-Connected (FC) layer for video representation learning. Specifically, a MorphMLP block consists of two key layers in sequence, i.e., MorphFCs and MorphFCt, for spatial and temporal modeling respectively. MorphFCs can effectively capture core semantics in each frame, by progressive token interaction along both height and width dimensions. Alternatively, MorphFCt can adaptively learn long-term dependency over frames, by temporal token aggregation on each spatial location. With such multi-dimension and multi-scale factorization, our MorphMLP block can achieve a great accuracy-computation balance. Finally, we evaluate our MorphMLP on a number of popular video benchmarks. Compared with the recent state-of-the-art models, MorphMLP significantly reduces computation but with better accuracy, e.g., MorphMLP-S only uses 50% GFLOPs of VideoSwin-T but achieves 0.9% top-1 improvement on Kinetics400, under ImageNet1K pretraining. MorphMLP-B only uses 43% GFLOPs of MViT-B but achieves 2.4% top-1 improvement on SSV2, even though MorphMLP-B is pretrained on ImageNet1K while MViT-B is pretrained on Kinetics400. Moreover, our method adapted to the image domain outperforms previous SOTA MLP-Like architectures. Code is available at https://***/MTLab/MorphMLP. Copyright © 2021, The Authors. All rights reserved.

关键词： Image recognition

Regional attention with architecture-rebuilt 3D network for RGB-D gesture recognition

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhou, Benjia Li, Yunan Wan, Jun Macau University of Science and Technology China National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing China School of Computer Science and Technology Xidian Univeristy China Xi'an Key Laboratory of Big Data and Intelligent Vision China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China

Human gesture recognition has drawn much attention in the area of computer vision. However, the performance of gesture recognition is always influenced by some gesture-irrelevant factors like the background and the clothes of performers. Therefore, focusing on the regions of hand/arm is important to the gesture recognition. Meanwhile, a more adaptive architecture-searched network structure can also perform better than the block-fixed ones like ResNet since it increases the diversity of features in different stages of the network better. In this paper, we propose a regional attention with architecture-rebuilt 3D network (RAAR3DNet) for gesture recognition. We replace the fixed Inception modules with the automatically rebuilt structure through the network via Neural Architecture Search (NAS), owing to the different shape and representation ability of features in the early, middle, and late stage of the network. It enables the network to capture different levels of feature representations at different layers more adaptively. Meanwhile, we also design a stackable regional attention module called Dynamic-Static Attention (DSA), which derives a Gaussian guidance heatmap and dynamic motion map to highlight the hand/arm regions and the motion information in the spatial and temporal domains, respectively. Extensive experiments on two recent large-scale RGB-D gesture datasets validate the effectiveness of the proposed method and show it outperforms state-of-the-art methods. The codes of our method are available at: https://***/zhoubenjia/RAAR3DNet. Copyright © 2021, The Authors. All rights reserved.

关键词： Large dataset

UMFA: A photorealistic style transfer method based on U-Net and multi-layer feature aggregation

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Rao, Dongyu Wu, Xiao-Jun Li, Hui Kittler, Josef Xu, Tianyang Jiangnan University Jiangsu Provincial Engineerinig Laboratory of Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Lihu Avenue Wuxi214122 China University of Surrey Centre for Vision Speech and Signal Processing GuildfordGU2 7XH United Kingdom

In this paper, we propose a photorealistic style transfer network to emphasize the natural effect of photo realistic image stylization. In general, distortion of the image content and lacking of details are two typical issues in the style transfer field. To this end, we design a novel framework employing the U-Net structure to maintain the rich spatial clues, with a multi-layer feature aggregation (MFA) method to simultaneously provide the details obtained by the shallow layers in the stylization processing. In particular, an encoder based on the dense block and a decoder form a symmetrical structure of U-Net are jointly staked to realize an effective feature extraction and image reconstruc tion. Besides, a transfer module based on MFA and "adaptive instance normalization" (AdaIN) is inserted in the skip connection positions to achieve the stylization. Accordingly, the stylized image possesses the texture of a real photo and preserves rich content details without introducing any mask or post-processing steps. The experimental results on public datasets demonstrate that our method achieves a more faithful structural similarity with a lower style loss, reflecting the effectiveness and merit of our approach. © 2021, CC0.

关键词： Deep learning

Towards Phytoplankton Parasite Detection Using Autoencoders

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Bilik, Simon Batrakhanov, Daniel Eerola, Tuomas Haraguchi, Lumi Kraft, Kaisa Van den Wyngaert, Silke Kangas, Jonna Sjöqvist, Conny Madsen, Karin Lensu, Lasse Kälviäinen, Heikki Horak, Karel Computer Vision and Pattern Recognition Laboratory Department of Computational Engineering Lappeenranta-Lahti University of Technology LUT Yliopistonkatu 34 Lappeenranta53850 Finland Department of Control and Instrumentation Faculty of Electrical Engineering and Communication Brno University of Technology Technická 3058/10 Brno61600 Czech Republic Marine Ecology Measurements Finnish Environment Institute Agnes Sjöbergin Katu 2 Helsinki00790 Finland Department of Biology University of Turku Vesilinnantie 5 Turku20014 Finland Environmental and Marine Biology Åbo Akademi University Henrikinkatu 2 Turku20014 Finland

Phytoplankton parasites are largely understudied microbial components with a potentially significant ecological impact on phytoplankton bloom dynamics. To better understand their impact, we need improved detection methods to integrate phytoplankton parasite interactions in monitoring aquatic ecosystems. Automated imaging devices usually produce high amount of phytoplankton image data, while the occurrence of anomalous phytoplankton data is rare. Thus, we propose an unsupervised anomaly detection system based on the similarity of the original and autoencoder-reconstructed samples. With this approach, we were able to reach an overall F1 score of 0.75 in nine phytoplankton species, which could be further improved by species-specific fine-tuning. The proposed unsupervised approach was further compared with the supervised Faster R-CNN based object detector. With this supervised approach and the model trained on plankton species and anomalies, we were able to reach the highest F1 score of 0.86. However, the unsupervised approach is expected to be more universal as it can detect also unknown anomalies and it does not require any annotated anomalous data that may not be always available in sufficient quantities. Although other studies have dealt with plankton anomaly detection in terms of non-plankton particles, or air bubble detection, our paper is according to our best knowledge the first one which focuses on automated anomaly detection considering putative phytoplankton parasites or infections. © 2023, CC BY.

关键词： Object detection