检索结果-内蒙古大学图书馆

FDDH: Fast discriminative discrete hashing for large-scale cross-modal retrieval

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Liu, Xin Wang, Xingzhi Cheung, Yiu-Ming Department of Computer Science Huaqiao University Xiamen Key Laboratory of Computer Vision and Pattern Recognition Fujian Key Laboratory of Big Data Intelligence and Security Xiamen361021 China School of Electronics and Information Technology Sun Yat-sen University Guangzhou510006 China Department of Computer Science Hong Kong Baptist University Hong Kong Hong Kong

Cross-modal hashing, favored for its effectiveness and efficiency, has received wide attention to facilitating efficient retrieval across different modalities. Nevertheless, most existing methods do not sufficiently exploit the discriminative power of semantic information when learning the hash codes, while often involving time-consuming training procedure for handling the large-scale dataset. To tackle these issues, we formulate the learning of similarity-preserving hash codes in terms of orthogonally rotating the semantic data so as to minimize the quantization loss of mapping such data to hamming space, and propose an efficient Fast Discriminative Discrete Hashing (FDDH) approach for large-scale cross-modal retrieval. More specifically, FDDH introduces an orthogonal basis to regress the targeted hash codes of training examples to their corresponding semantic labels, and utilizes ϵ-dragging technique to provide provable large semantic margins. Accordingly, the discriminative power of semantic information can be explicitly captured and maximized. Moreover, an orthogonal transformation scheme is further proposed to map the nonlinear embedding data into the semantic subspace, which can well guarantee the semantic consistency between the data feature and its semantic representation. Consequently, an efficient closedform solution is derived for discriminative hash code learning, which is very computationally efficient. In addition, an effective and stable online learning strategy is presented for optimizing modality-specific projection functions, featuring adaptivity to different training sizes and streaming data. The proposed FDDH approach theoretically approximates the bi-Lipschitz continuity, runs sufficiently fast, and also significantly improves the retrieval performance over the state-of-the-art methods. The source code is released at: https://***/starxliu/FDDH. © 2021, CC0.

关键词： Hash functions

The devil is in the channels: Mutual-channel loss for fine-grained image classification

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Chang, Dongliang Ding, Yifeng Xie, Jiyang Bhunia, Ayan Kumar Li, Xiaoxu Ma, Zhanyu Wu, Ming Guo, Jun Song, Yi-Zhe Pattern Recognition and Intelligent System Laboratory School of Information and Communication Engineering Beijing University of Posts and Telecommunications Beijing100876 China School of Computer and Communication Lanzhou University of Technology Lanzhou730050 China Centre for Vision Speech and Signal Processing University of Surrey London United Kingdom

The key to solving fine-grained image categorization is finding discriminate and local regions that correspond to subtle visual traits. Great strides have been made, with complex networks designed specifically to learn part-level discriminate feature representations. In this paper, we show that it is possible to cultivate subtle details without the need for overly complicated network designs or training mechanisms- a single loss is all it takes. The main trick lies with how we delve into individual feature channels early on, as opposed to the convention of starting from a consolidated feature map. The proposed loss function, termed as mutual-channel loss (MC-Loss), consists of two channel-specific components: a discriminality component and a diversity component. The discriminality component forces all feature channels belonging to the same class to be discriminative, through a novel channel-wise attention mechanism. The diversity component additionally constraints channels so that they become mutually exclusive across the spatial dimension. The end result is therefore a set of feature channels, each of which reflects different locally discriminative regions for a specific class. The MC-Loss can be trained end-to-end, without the need for any boundingbox/ part annotations, and yields highly discriminative regions during inference. Experimental results show our MC-Loss when implemented on top of common base networks can achieve stateof- the-art performance on all four fine-grained categorization datasets (CUB-Birds, FGVC-Aircraft, Flowers-102, and Stanford Cars). Ablative studies further demonstrate the superiority of the MC-Loss when compared with other recently proposed generalpurpose losses for visual classification, on two different base networks. Code available at https://***/dongliangchang/ Mutual-Channel-Loss. Copyright © 2020, The Authors. All rights reserved.

关键词： Image classification

MorphMLP: An Efficient MLP-Like Backbone for Spatial-Temporal Representation Learning

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhang, David Junhao Li, Kunchang Wang, Yali Chen, Yunpeng Chandra, Shashwat Qiao, Yu Liu, Luoqi Shou, Mike Zheng National University of Singapore Singapore Meitu Inc China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China Shanghai AI Laboratory China

Recently, MLP-Like networks have been revived for image recognition. However, whether it is possible to build a generic MLP-Like architecture on video domain has not been explored, due to complex spatial-temporal modeling with large computation burden. To fill this gap, we present an efficient self-attention free backbone, namely MorphMLP, which flexibly leverages the concise Fully-Connected (FC) layer for video representation learning. Specifically, a MorphMLP block consists of two key layers in sequence, i.e., MorphFCs and MorphFCt, for spatial and temporal modeling respectively. MorphFCs can effectively capture core semantics in each frame, by progressive token interaction along both height and width dimensions. Alternatively, MorphFCt can adaptively learn long-term dependency over frames, by temporal token aggregation on each spatial location. With such multi-dimension and multi-scale factorization, our MorphMLP block can achieve a great accuracy-computation balance. Finally, we evaluate our MorphMLP on a number of popular video benchmarks. Compared with the recent state-of-the-art models, MorphMLP significantly reduces computation but with better accuracy, e.g., MorphMLP-S only uses 50% GFLOPs of VideoSwin-T but achieves 0.9% top-1 improvement on Kinetics400, under ImageNet1K pretraining. MorphMLP-B only uses 43% GFLOPs of MViT-B but achieves 2.4% top-1 improvement on SSV2, even though MorphMLP-B is pretrained on ImageNet1K while MViT-B is pretrained on Kinetics400. Moreover, our method adapted to the image domain outperforms previous SOTA MLP-Like architectures. Code is available at https://***/MTLab/MorphMLP. Copyright © 2021, The Authors. All rights reserved.

关键词： Image recognition

New COLD Feature Based Handwriting Analysis for Enthnicity/Nationality Identification

学校读者我要写书评

暂无评论

New COLD Feature Based Handwriting Analysis for Enthnicity/N...

International Workshop on Frontiers in Handwriting recognition

作者： Sauradip Nag Palaiahnakote Shivakumara Yirui Wu Umapada Pal Tong Lu Kalyani Government Engineering College Kalyani Kolkata India Faculty of Computer Science and Information Technology University of Malaya Kuala Lumpur Malaysia College of Computer and Information Hohai University Nanjing China Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata India National Key Lab for Novel Software Technology Nanjing University Nanjing China

Identifying crime for forensic investigating teams when crimes involve people of different nationals is challenging. This paper proposes a new method for ethnicity (nationality) identification based on Cloud of Line Distribution (COLD) features of handwriting components. The proposed method, at first, uses tangent angle of the contour pixels in each row and the mean of intensity values of each row for segmenting text lines. For segmented text lines, we use tangent angle and direction of base lines to remove rule lines in the image. We use polygonal approximation for finding dominant points for contours of edge components. Then the proposed method connects the nearest dominant points of every dominant point, which results in line segments of dominant point pairs. For each line segment, the proposed method estimates angle and length, which gives a point in polar domain. For all the line segments, the proposed method generates dense points in polar domain, which results in COLD distribution. As character component shapes change, according to nationals, the shape of the distribution changes. This observation is extracted based on distance from pixels of distribution to Principal Axis of the distribution. Then the features are subjected to an SVM classifier for identifying nationals. Experiments are conducted on a complex dataset, which show the proposed method is effective and outperforms the existing method.

关键词： Feature extraction Shape Image edge detection Writing Image segmentation Forensics Support vector machines

A novel approach for delineation and feature extraction in QRS complex of ECG signal

学校读者我要写书评

暂无评论

A novel approach for delineation and feature extraction in Q...

International Conference on Image Information Processing

作者： Sayak Pramanik Rupendra Nath Mitra Sucharita Mitra Bidyut Baran Chaudhuri Department of Electronics & Communication Institute of Engineering and Management Kolkata India Department of Electronics Netaji Nagar Day College Kolkata India Network Planning & Optimization Nokia Siemens Networks Private Limited Kolkata India Computer Vision & Pattern Recognition Unit Indian Statistical Institute Kolkata India

This paper reports the development of a software suite to be accessed in future with any General Packet Radio Service (GPRS) enabled mobile phone or Personal Digital Assistant (PDA) for the extraction and analysis of disease-related features from the images of paper based ECG records. In India and other developing countries, the cheaper paper based ECG machines are mainly used. Also in rural areas of these countries - where there is acute dearth of qualified cardiologists, the cardiac diseases are still the major silent killers. One way of addressing this problem is cellular medicine which necessitates an intelligent cardiac parameter extraction algorithm. In our bid to address exactly this requirement, a software is developed with the help of few image processing techniques. At first, the background noises i.e. the gridlines are removed by thresholding technique. Binarization and thinning has been done for extraction of digital time data and then Discrete Wavelet Transform (DWT) and water reservoir based pattern recognition technique are subsequently used to delineate other important ECG parameters for ECG interpretation.

关键词： Electrocardiography Feature extraction pattern recognition Information processing Reservoirs Strips

Investigate indistinguishable points in semantic segmentation of 3D point cloud

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Xu, Mingye Zhou, Zhipeng Zhang, Junhao Qiao, Yu ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences University of Chinese Academy of Sciences China Shanghai AI Lab Shanghai China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society

This paper investigates the indistinguishable points (difficult to predict label) in semantic segmentation for large-scale 3D point clouds. The indistinguishable points consist of those located in complex boundary, points with similar local textures but different categories, and points in isolate small hard areas, which largely harm the performance of 3D semantic segmentation. To address this challenge, we propose a novel Indistinguishable Area Focalization Network (IAF-Net), which selects indistinguishable points adaptively by utilizing the hierarchical semantic features and enhance fine-grained features for points especially those indistinguishable points. We also introduce multi-stage loss to improve the feature representation in a progressive way. Moreover, in order to analyze the segmentation performances of indistinguishable areas, we propose a new evaluation metric called Indistinguishable Points Based Metric (IPBM). Our IAF-Net achieves the comparable results with state-of-the-art performance on several popular 3D point cloud datasets e.g. S3DIS and ScanNet, and clearly outperforms other methods on IPBM. Our code will be available at https://***/MingyeXu/IAF-Net. Copyright © 2021, The Authors. All rights reserved.

关键词： Semantic Segmentation

UMFA: A photorealistic style transfer method based on U-Net and multi-layer feature aggregation

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Rao, Dongyu Wu, Xiao-Jun Li, Hui Kittler, Josef Xu, Tianyang Jiangnan University Jiangsu Provincial Engineerinig Laboratory of Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Lihu Avenue Wuxi214122 China University of Surrey Centre for Vision Speech and Signal Processing GuildfordGU2 7XH United Kingdom

In this paper, we propose a photorealistic style transfer network to emphasize the natural effect of photo realistic image stylization. In general, distortion of the image content and lacking of details are two typical issues in the style transfer field. To this end, we design a novel framework employing the U-Net structure to maintain the rich spatial clues, with a multi-layer feature aggregation (MFA) method to simultaneously provide the details obtained by the shallow layers in the stylization processing. In particular, an encoder based on the dense block and a decoder form a symmetrical structure of U-Net are jointly staked to realize an effective feature extraction and image reconstruc tion. Besides, a transfer module based on MFA and "adaptive instance normalization" (AdaIN) is inserted in the skip connection positions to achieve the stylization. Accordingly, the stylized image possesses the texture of a real photo and preserves rich content details without introducing any mask or post-processing steps. The experimental results on public datasets demonstrate that our method achieves a more faithful structural similarity with a lower style loss, reflecting the effectiveness and merit of our approach. © 2021, CC0.

关键词： Deep learning

Real-time 3D human pose estimation without skeletal a priori structures

学校读者我要写书评

暂无评论

Image and vision Computing 2023年 132卷

作者： Bai, Guihu Luo, Yanmin Pan, Xueliang Wang, Jia Guo, Jing-Ming College of Computer Science and Technology Huaqiao University 668 Jimei Avenue Jimei District Fujian Xiamen361021 China Key Laboratory for Computer Vision and Pattern Recognition Huaqiao University 668 Jimei Avenue Jimei District Fujian Xiamen361021 China The Department of Electrical Engineering National Taiwan University of Science and Technology Taipei10607 Taiwan

This study is about real-time 2D-3D human pose estimation without using the a priori structure of the skeleton and with a low number of parameters for regression tasks. Current graph convolution-based 3D human pose tasks require structural knowledge of the skeleton, which limits the exploration of pose estimation for unknown structures. Inspired by tyre rotation and circular convolution, weights rotation is used to fully learn the potential connections between the human joints. We refer to this process as the weight cyclic sharing mechanism, a novel method for updating features. It does not require knowledge of the structure of the human skeleton and learns different constraints between joints with a low number of parameters. We propose an end-to-end weight circular sharing network (WCirSNet) based on the weight circular sharing mechanism. We propose a simple and efficient weighted residual block in this WCirSNet. The superiorities of the weight circular sharing mechanism and weighted residual block were verified by abundant ablation studies. Extensive evaluations on two challenging benchmark datasets (Human 3.6 M, MPI-INF-3DHP) show that the performance and generalization capabilities of our framework are superior to the results of many previously advanced methods. © 2023 Elsevier B.V.

关键词： Benchmarking

Feature refinement: An expression-specific feature learning and fusion method for micro-expression recognition

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhou, Ling Mao, Qirong Huang, Xiaohua Zhang, Feifei Zhang, Zhihong School of Computer Science and Communication Engineering Jiangsu University ZhenjiangJiangsu212013 China School of Computer Engineering Nanjing Institute of Technology China National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing100190 China Xiamen University Xiamen China Center for Machine Vision and Signal Analysis University of Oulu Finland

Micro-Expression recognition has become challenging, as it is extremely difficult to extract the subtle facial changes of micro-expressions. Recently, several approaches proposed several expression-shared features algorithms for micro-expression recognition. However, they do not reveal the specific discriminative characteristics, which lead to sub-optimal performance. This paper proposes a novel Feature Refinement (FR) with expression-specific feature learning and fusion for micro-expression recognition. It aims to obtain salient and discriminative features for specific expressions and also predict expression by fusing the expression-specific features. FR consists of an expression proposal module with attention mechanism and a classification branch. First, an inception module is designed based on optical flow to obtain expression-shared features. Second, in order to extract salient and discriminative features for specific expression, expression-shared features are fed into an expression proposal module with attention factors and proposal loss. Last, in the classification branch, labels of categories are predicted by a fusion of the expression-specific features. Experiments on three publicly available databases validate the effectiveness of FR under different protocol. Results on public benchmarks demonstrate that our FR provides salient and discriminative information for micro-expression recognition. The results also show our FR achieves better or competitive performance with the existing state-of-the-art methods on micro-expression recognition. Copyright © 2021, The Authors. All rights reserved.

关键词： Deep learning