检索结果-内蒙古大学图书馆

UformPose: A U-Shaped Hierarchical Multi-Scale Keypoint-Aware Framework for Human Pose Estimation

IEEE Transactions on Circuits and Systems for Video Technology 2023年第4期33卷 1697-1709页

作者： Wang, You-Jie Luo, Yan-Min Bai, Gui-Hu Guo, Jing-Ming Huaqiao University Key Laboratory for Computer Vision and Pattern Recognition The College of Computer Science and Technology Xiamen361021 China National Taiwan University of Science and Technology Department of Electrical Engineering Taipei10607 Taiwan

Human pose estimation is a fundamental yet challenging task in computer vision. However, difficult scenarios such as invisible keypoints, occlusions and small-scale persons are still not well-handed. In this paper, we present a novel pose estimation framework named UformPose which targets to relieve these issues. UformPose has two core designs: Shared Feature Pyramid Stem (SFPS) and U-shaped hierarchical Multi-scale Keypoint-aware Attention Module (U-MKAM). SFPS is a feature pyramid stem with shared mechanism to learn stronger low-level features at the initial stage, and the shared mechanism can facilitate cross-resolution commonality learning. Our U-MKAM attempts to generate high-quality high-resolution representations by integrating all levels of feature representation of the backbone layer by layer. More importantly, we utilize the flexibility of attention operations for keypoint-aware modeling, which explicitly captures and trades-offs the dependencies between keypoints. We empirically demonstrate the effectiveness of our framework through the competitive pose estimation results on the COCO dataset. Extensive experiments and visual analysis on CrowdPose demonstrate the robustness of our model in crowd scenes. © 1991-2012 IEEE.

关键词： computer vision

来源：评论

学校读者我要写书评

暂无评论

Spatio-temporal Attention Graph Convolutions for Skeleton-based Action recognition 23rd

Spatio-temporal Attention Graph Convolutions for Skeleton-b...

引用

22nd Scandinavian Conference on Image Analysis, SCIA 2023

作者： Le, Cuong Liu, Xin Computer Vision and Pattern Recognition Laboratory School of Engineering Science Lappeenranta-Lahti University of Technology LUT Lappeenranta Finland Computer Vision Laboratory Department of Electrical Engineering Linköping University Linköping Sweden

ISBN: (纸本)9783031314346

In skeleton-based action recognition, graph convolutional networks (GCN) have been applied to extract features based on the dynamic of the human body and the method has achieved excellent results recently. However, GCN-based techniques only focus on the spatial correlations between human joints and often overlook the temporal relationships. In an action sequence, the consecutive frames in a neighborhood contain similar poses and using only temporal convolutions for extracting local features limits the flow of useful information into the calculations. In many cases, the discriminative features can present in long-range time steps and it is important to also consider them in the calculations to create stronger representations. We propose an attentional graph convolutional network, which adapts self-attention mechanisms to respectively model the correlations between human joints and between every time steps for skeleton-based action recognition. On two common datasets, the NTU-RGB+D60 and the NTU-RGB+D120, the proposed method achieved competitive classification results compared to state-of-the-art methods. The project’s GitHub page: STA-GCN. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

Multi-Scale Promoted Self-Adjusting Correlation Learning for Facial Action Unit Detection

引用

IEEE Transactions on Affective Computing 2025年第2期16卷 697-711页

作者： Liu, Xin Yuan, Kaishen Niu, Xuesong Shi, Jingang Yu, Zitong Yue, Huanjing Yang, Jingyu Tianjin University School of Electrical and Information Engineering Tianjin300072 China Lappeenranta-Lahti University of Technology Computer Vision and Pattern Recognition Laboratory School of Engineering Science Lappeenranta53850 Finland Beijing Institute for General Artificial Intelligence Beijing100080 China Xi’an Jiaotong University School of Software Engineering Xi’an710049 China Great Bay University Dongguan523000 China

Facial Action Unit (AU) detection is a crucial task in affective computing and social robotics as it helps to identify emotions expressed through facial expressions. Anatomically, there are innumerable correlations between AUs, which contain rich information and are vital for AU detection. Previous methods used fixed AU correlations based on expert experience or statistical rules on specific benchmarks, but it is challenging to comprehensively reflect complex correlations between AUs via hand-crafted settings. There are alternative methods that employ a fully connected graph to learn these dependencies exhaustively. However, these approaches can result in a computational explosion and high dependency with a large dataset. To address these challenges, this paper proposes a novel self-adjusting AU-correlation learning (SACL) method with less computation for AU detection. This method adaptively learns and updates AU correlation graphs by efficiently leveraging the characteristics of different levels of AU motion and emotion representation information extracted in different stages of the network. Moreover, this paper explores the role of multi-scale learning in correlation information extraction, and design a simple yet effective multi-scale feature learning (MSFL) method to promote better performance in AU detection. By integrating AU correlation information with multi-scale features, the proposed method obtains a more robust feature representation for the final AU detection. Extensive experiments show that the proposed method outperforms the state-of-the-art methods on widely used AU detection benchmark datasets, with only 28.7% and 12.0% of the parameters and FLOPs of the best method, respectively. © 2010-2012 IEEE.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

Abstract: A Spatiotemporal Model for Precise and Efficient Fully-automatic 3D Motion Correction in OCT

Abstract: A Spatiotemporal Model for Precise and Efficient F...

引用

Bildverarbeitung für die Medizin Workshop, BVM 2023

作者： Ploner, Stefan B. Chen, Siyu Won, Jungeun Husvogt, Lennart Breininger, Katharina Schottenhamml, Julia Fujimoto, James G. Maier, Andreas K. Pattern Recognition Lab Friedrich-Alexander-Universität Erlangen-Nürnberg Germany Department of Electrical Engineering and Computer Science Research Laboratory for Electronics Massachusetts Institute of Technology CambridgeMA United States

ISBN: (纸本)9783658416560

Optical coherence tomography (OCT) is a micrometer-scale, volumetric imaging modality that has become a clinical standard in ophthalmology. OCT instruments image by raster-scanning a focused light spot across the retina, acquiring sequential cross-sectional images to generate volumetric data. Patient eye motion during the acquisition poses unique challenges: Non-rigid, discontinuous distortions can occur, leading to gaps in data and distorted topographic measurements. We present a new distortion model and a corresponding fully-automatic, reference-free optimization strategy for computational motion correction in orthogonally raster-scanned, retinal OCT volumes. Using a novel, domain-specific spatiotemporal parametrization of forward-warping displacements, eye motion can be corrected continuously for the first time. Parameter estimation with temporal regularization improves robustness and accuracy over previous spatial approaches. We correct each A-scan individually in 3D in a single mapping, including repeated acquisitions used in OCT angiography protocols. Specialized 3D forward image warping reduces median runtime to © 2023 Der/die Autor(en), exklusiv lizenziert an Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature.

关键词： Optical tomography

来源：评论

学校读者我要写书评

暂无评论

A Parallel High-Utility Itemset Mining Algorithm Based on Hadoop

引用

Complex System Modeling and Simulation 2023年第1期3卷 47-58页

作者： Zaihe Cheng Wei Shen Wei Fang Jerry Chun-Wei Lin School of Internet of Things Wuxi Institute of TechnologyWuxi 214121China School of Artificial Intelligence and Computer Science Jiangnan UniversityWuxi 214122China Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence Jiangnan UniversityWuxi 214122China Department of Computer Science Electrical Engineering and Mathematical SciencesWestern Norway University of Applied SciencesBergen 5020Norway

High-utility itemset mining(HUIM)can consider not only the profit factor but also the profitable factor,which is an essential task in data ***,most HUIM algorithms are mainly developed on a single machine,which is inefficient for big data since limited memory and processing capacities are available.A parallel efficient high-utility itemset mining(P-EFIM)algorithm is proposed based on the Hadoop platform to solve this problem in this *** P-EFIM,the transaction-weighted utilization values are calculated and ordered for the itemsets with the MapReduce *** the ordered itemsets are renumbered,and the low-utility itemsets are pruned to improve the dataset *** the Map phase,the P-EFIM algorithm divides the task into multiple independent *** uses the proposed S-style distribution strategy to distribute the subtasks evenly across all nodes to ensure ***,the P-EFIM uses the EFIM algorithm to mine each subtask dataset to enhance the performance in the Reduce *** are performed on eight datasets,and the results show that the runtime performance of P-EFIM is significantly higher than that of the PHUI-Growth,which is also HUIM algorithm based on the Hadoop framework.

关键词： pattern mining data mining Hadoop parallel high-utility itemset mining big data

来源：评论

学校读者我要写书评

暂无评论

Ensemble and Personalized Transformer Models for Subject Identification and Relapse Detection in E-Prevention Challenge

Ensemble and Personalized Transformer Models for Subject Ide...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Salvatore Calcagno Raffaele Mineo Daniela Giordano Concetto Spampinato Department of Electrical Electronics and Computer Engineering Pattern Recognition and Computer Vision Laboratory (PeRCeiVe Lab) University of Catania Italy

In this short paper, we present the devised solutions for the subject identification and relapse detection tasks, which are part of the e-Prevention Challenge hosted at the ICASSP 2023 conference [1] [2] [3]. We specifically design an ensemble scheme of six models - five transformer-based ones and a CNN model - for the identification of subjects from wearable devices, while a personalized - one for each subject - scheme is used for relapse detection in psychotic disorder. Our final submitted solutions yield top performance on both tracks of the challenge: we ranked 2 nd on the subject identification task (with an accuracy of 93.85%) and 1 st on the relapse detection task (with a ROC-AUC and PR-AUC of about 0.65). Code and details are available at https://***/perceivelab/e-prevention-icassp-2023.

关键词： Performance evaluation Codes Wearable computers Signal processing Transformers Acoustics Object recognition

来源：评论

学校读者我要写书评

暂无评论

Unsupervised detection of Small Hyperreflective Features in Ultrahigh Resolution Optical Coherence Tomography

Unsupervised detection of Small Hyperreflective Features in ...

引用

Bildverarbeitung für die Medizin Workshop, BVM 2023

作者： Reimann, Marcel Won, Jungeun Takahashi, Hiroyuki Yaghy, Antonio Hwang, Yunchan Ploner, Stefan Lin, Junhong Girgis, Jessica Lam, Kenneth Chen, Siyu Waheed, Nadia K. Maier, Andreas Fujimoto, James G. Department of Electrical Engineering and Computer Science Research Laboratory of Electronics Massachusetts Institute of Technology United States Pattern Recognition Lab Friedrich-Alexander-Universität Erlangen-Nürnberg Germany New England Eye Center Tufts Medical Center United States

ISBN: (纸本)9783658416560

Recent advances in optical coherence tomography such as the development of high speed ultrahigh resolution scanners and corresponding signal processing techniques may reveal new potential biomarkers in retinal diseases. Newly visible features are, for example, small hyperreflective specks in age-related macular degeneration. Identifying these new markers is crucial to investigate potential association with disease progression and treatment outcomes. Therefore, it is necessary to reliably detect these features in 3D volumetric scans. Because manual labeling of entire volumes is infeasible a need for automatic detection arises. Labeled datasets are often not publicly available and there are usually large variations in scan protocols and scanner types. Thus, this work focuses on an unsupervised approach that is based on local peak-detection and random walker segmentation to detect small features on each B-scan of the volume. © 2023 Der/die Autor(en), exklusiv lizenziert an Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature.

关键词： Optical tomography

来源：评论

学校读者我要写书评

暂无评论

Zero-Shot Video Restoration and Enhancement Using Pre-Trained Image Diffusion Model 39

Zero-Shot Video Restoration and Enhancement Using Pre-Traine...

引用

39th Annual AAAI Conference on Artificial Intelligence, AAAI 2025

作者： Cao, Cong Yue, Huanjing Liu, Xin Yang, Jingyu School of Electrical and Information Engineering Tianjin University Tianjin China Computer Vision and Pattern Recognition Laboratory School of Engineering Science Lappeenranta-Lahti University of Technology LUT Lappeenranta Finland

ISBN: (纸本)157735897X

Diffusion-based zero-shot image restoration and enhancement models have achieved great success in various tasks of image restoration and enhancement. However, directly applying them to video restoration and enhancement results in severe temporal flickering artifacts. In this paper, we propose the first framework for zero-shot video restoration and enhancement based on the pre-trained image diffusion model. By replacing the spatial self-attention layer with the proposed short-long-range (SLR) temporal attention layer, the pre-trained image diffusion model can take advantage of the temporal correlation between frames. We further propose temporal consistency guidance, spatial-temporal noise sharing, and an early stopping sampling strategy to improve temporally consistent sampling. Our method is a plug-and-play module that can be inserted into any diffusion-based image restoration or enhancement methods to further improve their performance. Experimental results demonstrate the superiority of our proposed method. Copyright © 2025, Association for the Advancement of Artificial Intelligence (***). All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Zero-Shot Video Restoration and Enhancement Using Pre-Trained Image Diffusion Model

arXiv

引用

arXiv 2024年

关键词： Restoration

来源：评论

学校读者我要写书评

暂无评论

Enhancing Micro Gesture recognition for Emotion Understanding via Context-aware Visual-Text Contrastive Learning

arXiv

引用

arXiv 2024年

作者： Li, Deng Xing, Bohao Liu, Xin School of Electrical and Information Engineering Tianjin University Tianjin300072 China Computer Vision and Pattern Recognition Laboratory Lappeenranta-Lahti University of Technology LUT Lappeenranta53850 Finland

Psychological studies have shown that Micro Gestures (MG) are closely linked to human emotions. MG-based emotion understanding has attracted much attention because it allows for emotion understanding through nonverbal body gestures without relying on identity information (e.g., facial and electrocardiogram data). Therefore, it is essential to recognize MG effectively for advanced emotion understanding. However, existing Micro Gesture recognition (MGR) methods utilize only a single modality (e.g., RGB or skeleton) while overlooking crucial textual information. In this letter, we propose a simple but effective visual-text contrastive learning solution that utilizes text information for MGR. In addition, instead of using handcrafted prompts for visual-text contrastive learning, we propose a novel module called Adaptive prompting to generate context-aware prompts. The experimental results show that the proposed method achieves state-of-the-art performance on two public datasets. Furthermore, based on an empirical study utilizing the results of MGR for emotion understanding, we demonstrate that using the textual results of MGR significantly improves performance by 6%+ compared to directly using video as input. Copyright © 2024, The Authors. All rights reserved.

关键词： Gesture recognition

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：