检索结果-内蒙古大学图书馆

Local Neighbor Propagation on Graphs for Robust Feature Matching

学校读者我要写书评

暂无评论

SSRN

SSRN 2023年

作者： Guo, Hanlin Xiao, Guobao Su, Lumei Zhou, Jiaxing Wang, Dahan Xiamen Key Laboratory of Frontier Electric Power Equipment and Intelligent Control School of Electrical Engineering and Automation Xiamen University of Technology China Fujian Key Laboratory of Sensing and Computing for Smart Cities School of Information Science and Engineering Xiamen University China College of Computer and Control Engineering Minjiang University China Fujian Key Laboratory of Pattern Recognition and Image Understanding School of Computer and Information Engineering Xiamen University of Technology China

Establishing reliable correspondences between two sets of feature points is a critical preprocessing step in many computer vision and pattern recognition tasks. In this paper, we propose a novel robust Local Neighbor Propagation on Graphs based feature matching (LNPG) method, to obtain good correspondences for feature matching. LNPG starts from a novel neighborhood graph construction strategy. The strategy leverages the spatial consistency constraint to generate a series of neighborhood sets, and employs the residual information to preserve the local neighborhood relationships of potential inliers (i.e., true matches). Subsequently, LNPG incorporates local neighbor propagation into the graph to enhance connections between data in different neighborhoods, by using the path-based similarity measurement and the adaptive graph partition. In addition, LNPG includes a novel consistency-filtering-based clustering algorithm for robust feature matching. This clustering algorithm introduces a reliable neighborhood consistency measure function and an effective cluster merging criterion for cluster detection and cluster merging during the clustering process, respectively. Overall, LNPG not only effectively distinguishes inliers from outliers, but also reliably classifies inliers into different transformation models between pairs of images. Experiments on publicly available datasets with different types of image transformations show the superiority of our LNPG in comparison with other state-of-the-art methods. © 2023, The Authors. All rights reserved.

关键词： Clustering algorithms

Unsupervised detection of small hyperreflective features in ultrahigh resolution optical coherence tomography

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Reimann, Marcel Won, Jungeun Takahashi, Hiroyuki Yaghy, Antonio Hwang, Yunchan Ploner, Stefan Lin, Junhong Girgis, Jessica Lam, Kenneth Chen, Siyu Waheed, Nadia K. Maier, Andreas Fujimoto, James G. Department of Electrical Engineering and Computer Science Research Laboratory of Electronics Massachusetts Institute of Technology United States Pattern Recognition Lab Friedrich-Alexander-Universität Erlangen-Nürnberg Germany New England Eye Center Tufts Medical Center United States

Recent advances in optical coherence tomography such as the development of high speed ultrahigh resolution scanners and corresponding signal processing techniques may reveal new potential biomarkers in retinal diseases. Newly visible features are, for example, small hyperreflective specks in age-related macular degeneration. Identifying these new markers is crucial to investigate potential association with disease progression and treatment outcomes. Therefore, it is necessary to reliably detect these features in 3D volumetric scans. Because manual labeling of entire volumes is infeasible a need for automatic detection arises. Labeled datasets are often not publicly available and there are usually large variations in scan protocols and scanner types. Thus, this work focuses on an unsupervised approach that is based on local peak-detection and random walker segmentation to detect small features on each B-scan of the volume. © 2023, CC BY-NC-SA.

关键词： Optical tomography

A Simple yet Effective Network based on Vision Transformer for Camouflaged Object and Salient Object Detection

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Hao, Chao Yu, Zitong Liu, Xin Xu, Jun Yue, Huanjing Yang, Jingyu The School of Electrical and Information Engineering Tianjin University Tianjin300072 China The School of Computing and Information Technology Great Bay University Dongguan523000 China The Computer Vision and Pattern Recognition Laboratory Lappeenranta-Lahti University of Technology LUT Lappeenranta53850 Finland The School of Statistics and Data Science Nankai University Tianjin300072 China

Camouflaged object detection (COD) and salient object detection (SOD) are two distinct yet closely-related computer vision tasks widely studied during the past decades. Though sharing the same purpose of segmenting an image into binary foreground and background regions, their distinction lies in the fact that COD focuses on concealed objects hidden in the image, while SOD concentrates on the most prominent objects in the image. Previous works achieved good performance by stacking various hand-designed modules and multi-scale features. However, these carefully-designed complex networks often performed well on one task but not on another. In this work, we propose a simple yet effective network (SENet) based on vision Transformer (ViT), by employing a simple design of an asymmetric ViT-based encoder-decoder structure, we yield competitive results on both tasks, exhibiting greater versatility than meticulously crafted ones. Furthermore, to enhance the Transformer’s ability to model local information, which is important for pixel-level binary segmentation tasks, we propose a local information capture module (LICM). We also propose a dynamic weighted loss (DW loss) based on Binary Cross-Entropy (BCE) and Intersection over Union (IoU) loss, which guides the network to pay more attention to those smaller and more difficult-to-find target objects according to their size. Moreover, we explore the issue of joint training of SOD and COD, and propose a preliminary solution to the conflict in joint training, further improving the performance of SOD. Extensive experiments on multiple benchmark datasets demonstrate the effectiveness of our method. The code is available at https://***/linuxsino/SENet. Copyright © 2024, The Authors. All rights reserved.

关键词： Object detection

Synchronization of Nonlinear Neural Networks with Hybrid Couplings and Uncertain Time-Varying Perturbations: A Novel Distributed-Delay Impulsive Comparison Principle

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Fan, Hongguang Shi, Kaibo Zhao, Yi College of Computer Chengdu University Chengdu610106 China Key Laboratory of Pattern Recognition and Intelligent Information Processing Institutions of Higher Education of Sichuan Province Chengdu University Chengdu610106 China School of Electronic Information and Electrical Engineering Chengdu University Chengdu610106 China School of Mathematical Sciences Shenzhen University Shenzhen518060 China

In this paper, the synchronization of nonlinear drive-response neural networks with uncertain time-varying perturbations, non-delayed coupling, and distributed delay coupling is studied. To address the impact of distributed delay and discrete delay on the system, a novel impulsive comparison principle is established, which can be viewed as an effective continuation of the Halanay inequality. Besides, with the help of Lyapunov stability theory, sufficient conditions guaranteeing the exponential synchronization of concerned neural networks are derived by using a delayed impulsive controller with historical status information, which releases the conventional limitation that impulsive delays should be smaller than impulsive intervals, and generalize the existing synchronization results regarding distributed delay networks. Besides, numerical simulations for chaotic neural networks are presented to demonstrate the validity of theoretical results and the sensitivity of the control gain matrix. © 2024, The Authors. All rights reserved.

关键词： Complex networks

Real-time 3D human pose estimation without skeletal a priori structures

学校读者我要写书评

暂无评论

Image and Vision Computing 2023年 132卷

作者： Bai, Guihu Luo, Yanmin Pan, Xueliang Wang, Jia Guo, Jing-Ming College of Computer Science and Technology Huaqiao University 668 Jimei Avenue Jimei District Fujian Xiamen361021 China Key Laboratory for Computer Vision and Pattern Recognition Huaqiao University 668 Jimei Avenue Jimei District Fujian Xiamen361021 China The Department of Electrical Engineering National Taiwan University of Science and Technology Taipei10607 Taiwan

This study is about real-time 2D-3D human pose estimation without using the a priori structure of the skeleton and with a low number of parameters for regression tasks. Current graph convolution-based 3D human pose tasks require structural knowledge of the skeleton, which limits the exploration of pose estimation for unknown structures. Inspired by tyre rotation and circular convolution, weights rotation is used to fully learn the potential connections between the human joints. We refer to this process as the weight cyclic sharing mechanism, a novel method for updating features. It does not require knowledge of the structure of the human skeleton and learns different constraints between joints with a low number of parameters. We propose an end-to-end weight circular sharing network (WCirSNet) based on the weight circular sharing mechanism. We propose a simple and efficient weighted residual block in this WCirSNet. The superiorities of the weight circular sharing mechanism and weighted residual block were verified by abundant ablation studies. Extensive evaluations on two challenging benchmark datasets (Human 3.6 M, MPI-INF-3DHP) show that the performance and generalization capabilities of our framework are superior to the results of many previously advanced methods. © 2023 Elsevier B.V.

关键词： Benchmarking

Retinal blood flow speed quantification at the capillary level using temporal autocorrelation fitting OCTA

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Hwang, Yunchan Won, Jungeun Yaghy, Antonio Takahashi, Hiroyuki Girgis, Jessica M. Lam, Kenneth Chen, Siyu Moult, Eric M. Ploner, Stefan B. Maier, Andreas Waheed, Nadia K. Fujimoto, James G. Department of Electrical Engineering and Computer Science Research Laboratory of Electronics Massachusetts Institute of Technology CambridgeMA02139 United States New England Eye Center Tufts Medical Center BostonMA02116 United States Pattern Recognition Lab Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany

Optical coherence tomography angiography (OCTA) can visualize vasculature structures, but provides limited information about the blood flow speeds. Here, we present a second generation variable interscan time analysis (VISTA) OCTA, which evaluates a quantitative surrogate marker for blood flow speed in vasculature. At the capillary level, spatially compiled OCTA and a simple temporal autocorrelation model, ρ(τ) = exp(-ατ), were used to evaluate a temporal autocorrelation decay constant, α, as the blood flow speed marker. A 600 kHz A-scan rate swept-source provides short interscan time OCTA and fine A-scan spacing acquisition, while maintaining multi mm2field of views for human retinal imaging. We demonstrate the cardiac pulsatility and repeatability of α measured with VISTA. We show different α for different retinal capillary plexuses in healthy eyes and present representative VISTA OCTA of eyes with diabetic retinopathy. Copyright © 2023, The Authors. All rights reserved.

关键词： Optical tomography

Multi-scale Promoted Self-adjusting Correlation Learning for Facial Action Unit Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Liu, Xin Yuan, Kaishen Niu, Xuesong Shi, Jingang Yu, Zitong Yue, Huanjing Yang, Jingyu The School of Electrical and Information Engineering Tianjin University Tianjin300072 China Computer Vision and Pattern Recognition Laboratory School of Engineering Science Lappeenranta-Lahti University of Technology LUT Lappeenranta53850 Finland Beijing Institute for General Artificial Intelligence Beijing100080 China School of Software Engineering Xi’an Jiaotong University Xi’an710049 China Great Bay University Dongguan523000 China

Facial Action Unit (AU) detection is a crucial task in affective computing and social robotics as it helps to identify emotions expressed through facial expressions. Anatomically, there are innumerable correlations between AUs, which contain rich information and are vital for AU detection. Previous methods used fixed AU correlations based on expert experience or statistical rules on specific benchmarks, but it is challenging to comprehensively reflect complex correlations between AUs via hand-crafted settings. There are alternative methods that employ a fully connected graph to learn these dependencies exhaustively. However, these approaches can result in a computational explosion and high dependency with a large dataset. To address these challenges, this paper proposes a novel self-adjusting AU-correlation learning (SACL) method with less computation for AU detection. This method adaptively learns and updates AU correlation graphs by efficiently leveraging the characteristics of different levels of AU motion and emotion representation information extracted in different stages of the network. Moreover, this paper explores the role of multi-scale learning in correlation information extraction, and design a simple yet effective multi-scale feature learning (MSFL) method to promote better performance in AU detection. By integrating AU correlation information with multi-scale features, the proposed method obtains a more robust feature representation for the final AU detection. Extensive experiments show that the proposed method outperforms the state-of-the-art methods on widely used AU detection benchmark datasets, with only 28.7% and 12.0% of the parameters and FLOPs of the best method, respectively. The code for this method is available at https://***/linuxsino/Self-adjusting-AU. Copyright © 2023, The Authors. All rights reserved.

关键词： Large dataset

Attention-Guided Multi-scale Interaction Network for Face Super-Resolution

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wan, Xujie Li, Wenjie Gao, Guangwei Lu, Huimin Yang, Jian Lin, Chia-Wen The Institute of Advanced Technology Nanjing University of Posts and Telecommunications Nanjing210046 China Key Laboratory of Artificial Intelligence Ministry of Education Shanghai200240 China The Provincial Key Laboratory for Computer Information Processing Technology Soochow University Suzhou215006 China The Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing100080 China The School of Automation Southeast University Nanjing210096 China The School of Computer Science and Technology Nanjing University of Science and Technology Nanjing210094 China The Department of Electrical Engineering National Tsing Hua University Hsinchu30013 Taiwan

Recently, CNN and Transformer hybrid networks demonstrated excellent performance in face super-resolution (FSR) tasks. Since numerous features at different scales in hybrid networks, how to fuse these multi-scale features and promote their complementarity is crucial for enhancing FSR. However, existing hybrid network-based FSR methods ignore this, only simply combining the Transformer and CNN. To address this issue, we propose an attention-guided Multi-scale interaction network (AMINet), which contains local and global feature interactions as well as encoder-decoder phases feature interactions. Specifically, we propose a Local and Global Feature Interaction Module (LGFI) to promote fusions of global features and different receptive fields' local features extracted by our Residual Depth Feature Extraction Module (RDFE). Additionally, we propose a Selective Kernel Attention Fusion Module (SKAF) to adaptively select fusions of different features within LGFI and encoder-decoder phases. Our above design allows the free flow of multi-scale features from within modules and between encoder and decoder, which can promote the complementarity of different scale features to enhance FSR. Comprehensive experiments confirm that our method consistently performs well with less computational consumption and faster inference. Copyright © 2024, The Authors. All rights reserved.

关键词： Decoding

Open source simulation of fixational eye drift motion in oct scans: Towards better comparability and accuracy in retrospective OCT motion correction

学校读者我要写书评

暂无评论

Open source simulation of fixational eye drift motion in oct...

International workshop on Algorithmen - Systeme - Anwendungen, 2020

作者： Nau, Merlin A. Ploner, Stefan B. Moult, Eric M. Fujimoto, James G. Maier, Andreas K. Pattern Recognition Lab Friedrich-Alexander-Universität Erlangen-Nürnberg Erlangen Germany Department for Electrical Engineering and Computer Science and Research Laboratory for Electronics Massachusetts Institute of Technology Cambridge United States

ISBN: (纸本)9783658292669

Point-wise scanning modalities like Optical Coherence Tomography (OCT) or Scanning Laser Ophthalmoscopy suffer from distortions due to the perpetual motion of the eye. While various motion correction approaches have been proposed, the absence of ground truth displacements or images entails a lack of accurate and comparable evaluations. The purpose of this paper is to close this gap by initiating an open source framework for the simulation of realistic eye motion and corresponding artificial distortion of scans, thereby for the first time enabling the community to a) create datasets with accessible ground truth and b) compare the correction of identical motion patterns in data acquired with different scanners or scan patterns. This paper extends previous work on simulation of fixational eye drift via a self-avoiding random walk in a potential to a continuous domain in time and space, allowing the derivation of smooth displacement fields. The model is demonstrated by presenting an examplary motion path, whose properties resemble reported properties of recordings in current literature on fixational eye motion. Furthermore, the artificial distortion of scans is demonstrated by showing a correspondingly distorted image of a virtual raster scan modeled according to the properties of an existing OCT scanner. All experiments can be reproduced and adapted to arbitrary scanner- and raster scan pattern-properties in the publicly available framework. Beyond that, the open source code provides a starting point for the community to integrate extensions like saccadic or axial eye motion. © Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature 2020.

关键词： Optical tomography