检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Wang, Zihan Song, Siyang Luo, Cheng Deng, Songhe Xie, Weicheng Shen, Linlin Computer Vision Institute School of Computer Science & Software Engineering Shenzhen University China Shenzhen Institute of Artificial Intelligence and Robotics for Society China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China University of Leicester United Kingdom Monash University Australia

Human facial action units (AUs) are mutually related in a hierarchical manner, as not only they are associated with each other in both spatial and temporal domains but also AUs located in the same/close facial regions show stronger relationships than those of different facial regions. While none of existing approach thoroughly model such hierarchical inter-dependencies among AUs, this paper proposes to comprehensively model multi-scale AU-related dynamic and hierarchical spatio-temporal relationship among AUs for their occurrences recognition. Specifically, we first propose a novel multi-scale temporal differencing network with an adaptive weighting block to explicitly capture facial dynamics across frames at different spatial scales, which specifically considers the heterogeneity of range and magnitude in different AUs’ activation. Then, a two-stage strategy is introduced to hierarchically model the relationship among AUs based on their spatial distribution (i.e., local and cross-region AU relationship modelling). Experimental results achieved on BP4D and DISFA show that our approach is the new state-of-the-art in the field of AU occurrence recognition. Our code is publicly available at https://***/CVI-SZU/MDHR. © 2024, CC BY.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

SimMAT: Exploring Transferability from vision Foundation Models to Any Image Modality

arXiv

引用

arXiv 2024年

作者： Lei, Chenyang Chen, Liyi Cen, Jun Chen, Xiao Lei, Zhen Heide, Felix Liu, Ziwei Chen, Qifeng Zhang, Zhaoxiang Center for Artificial Intelligence and Robotics HKISI CAS Hong Kong Princeton University Department of Computer Science United States The Hong Kong Polytechnic University Hong Kong The Hong Kong University of Science and Technology Hong Kong State Key Laboratory of Multimodal Artificial Intelligence Systems CASIA China Nanyang Technological University Singapore

Foundation models like ChatGPT and Sora that are trained on a huge scale of data have made a revolutionary social impact. However, it is extremely challenging for sensors in many different fields to collect similar scales of natural images to train strong foundation models. To this end, this work presents a simple and effective framework SimMAT to study an open problem: the transferability from vision foundation models trained on natural RGB images to other image modalities of different physical properties (e.g., polarization). SimMAT consists of a modality-agnostic transfer layer (MAT) and a pretrained foundation model. We apply SimMAT to a representative vision foundation model Segment Anything Model (SAM) to support any evaluated new image modality. Given the absence of relevant benchmarks, we construct a new benchmark to evaluate the transfer learning performance. Our experiments confirm the intriguing potential of transferring vision foundation models in enhancing other sensors’ performance. Specifically, SimMAT can improve the segmentation performance (mIoU) from 22.15% to 53.88% on average for evaluated modalities and consistently outperforms other baselines. We hope that SimMAT can raise awareness of cross-modal transfer learning and benefit various fields for better results with vision foundation models. © 2024, CC BY.

关键词： Image coding

来源：评论

学校读者我要写书评

暂无评论

LMR: A Large-Scale Multi-Reference Dataset for Reference-based Super-Resolution

LMR: A Large-Scale Multi-Reference Dataset for Reference-bas...

引用

International Conference on computer vision (ICCV)

作者： Lin Zhang Xin Li Dongliang He Fu Li Errui Ding Zhaoxiang Zhang University of Chinese Academy of Sciences Institute of Automation Chinese Academy of Sciences State Key Laboratory of Multimodal Artificial Intelligence Systems School of Future Technology UCAS Department of Computer Vision Technology (VIS) Baidu Inc. Center for Artificial Intelligence and Robotics HKISI_CAS

It is widely agreed that reference-based super-resolution (RefSR) achieves superior results by referring to similar high quality images, compared to single image super-resolution (SISR). Intuitively, the more references, the better performance. However, previous RefSR methods have all focused on single-reference image training, while multiple reference images are often available in testing or practical applications. The root cause of such training-testing mismatch is the absence of publicly available multi-reference SR training datasets, which greatly hinders research efforts on multi-reference super-resolution. To this end, we construct a large-scale, multi-reference super-resolution dataset, named LMR. It contains 112, 142 groups of 300×300 training images, which is 10× of the existing largest RefSR dataset. The image size is also some times larger. More importantly, each group is equipped with 5 reference images with different similarity levels. Furthermore, we propose a new baseline method for multi-reference super-resolution: MRefSR, including a Multi-Reference Attention Module (MAM) for feature fusion of an arbitrary number of reference images, and a Spatial Aware Filtering Module (SAFM) for the fused feature selection. The proposed MRefSR achieves significant improvements over state-of-the-art approaches on both quantitative and qualitative evaluations. Our code and data are available at: https://***/wdmwhh/MRefSR.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Lprr: Locality Preserving Robust Regression Based Sparse Feature Extraction

SSRN

引用

SSRN 2024年

作者： Zhu, Yufei Wen, Jiajun Lai, Zhihui Zhou, Jie Kong, Heng The Computer Vision Institute The College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China The Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen University Shenzhen518060 China the Department of Breast and Thyroid Surgery BaoAn Central Hospital of Shenzhen Shenzhen518060 China

Jointly sparse projection learning attracts considerable attention due to its strong interpretability in feature extraction. To address the challenges related to weak discriminating representation in supervised feature extraction, we propose a more powerful regression framework. Based on the framework, we exhibit a new regression model called locality preserving robust regression (LPRR). In LPRR, we first combine the reconstruction error minimization and the projection variance maximization to explore the structured information of the data. Then, the label information is utilized and the low rank representation can be learned to explore the latent correlation structures among different classes. Furthermore, L2,1-norm is applied to measure the loss function and regularization terms, enhancing the robustness of the model and ensuring the joint sparsity of the projection matrix. An iterative algorithm is elaborately designed to achieve the optimal solutions of LPRR, in which the subproblem of LPRR can be regarded as a general quadratic problem on the Stiefel manifold. The convergence and the computational complexity of LPRR are analyzed rigorously. Finally, comprehensive experiments demonstrate the competitive performance of the proposed algorithm. © 2024, The Authors. All rights reserved.

关键词： Feature extraction

来源：评论

学校读者我要写书评

暂无评论

I Can’t Believe It’s Not Better: In-air Movement for Alzheimer Handwriting Synthetic Generation 21st

I Can’t Believe It’s Not Better: In-air Movement for Alzh...

引用

The 21st International Graphonomics Society Conference, IGS 2023

作者： Bensalah, Asma Parziale, Antonio De Gregorio, Giuseppe Marcelli, Angelo Fornés, Alicia Lladós, Josep Computer Vision Center Universitat Autònoma de Barcelona Bellaterra Spain Computer Science Department Universitat Autònoma de Barcelona Bellaterra Spain DIEM University of Salerno Via Giovanni Paolo II 132 SA Fisciano84084 Italy AI3S Unit CINI National Laboratory of Artificial Intelligence and Intelligent Systems University of Salerno SA Fisciano Italy

ISBN: (纸本)9783031454608

During recent years, there here has been a boom in terms of deep learning use for handwriting analysis and recognition. One main application for handwriting analysis is early detection and diagnosis in the health field. Unfortunately, most real case problems still suffer a scarcity of data, which makes difficult the use of deep learning-based models. To alleviate this problem, some works resort to synthetic data generation. Lately, more works are directed towards guided data synthetic generation, a generation that uses the domain and data knowledge to generate realistic data that can be useful to train deep learning models. In this work, we combine the domain knowledge about the Alzheimer’s disease for handwriting and use it for a more guided data generation. Concretely, we have explored the use of in-air movements for synthetic data generation. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2023.

关键词： Recurrent neural networks

来源：评论

学校读者我要写书评

暂无评论

Matching individual Ladoga ringed seals across short-term image sequences (vol 102, pg 957, 2022)

引用

MAMMALIAN BIOLOGY 2022年第3期102卷 1045-1045页

作者： Nepovinnykh, E. Computer Vision and Pattern Recognition Laboratory Department of Computational Engineering School of Engineering Science Lappeenranta-Lahti University of Technology LUT P.O.Box 20 53851 Lappeenranta Finland Department of Artificial Intelligence Institute of Computer Science and Technology Peter the Great St. Petersburg Polytechnic University Polytechnicheskaya 29 Saint Petersburg Russian Federation 195251 Department of Computer Science and Computational Experiment Southern Federal University Rostov-on-Don Russian Federation 344006 Interregional Charitable Public Organization “Biologists for Nature Conservation” (BFNC) 24 line 3-7 Saint Petersburg Russian Federation 199106

Automated wildlife reidentification has attracted increasing attention in recent years as it provides a non-invasive tool to identify and to track individual wild animals over time. In this paper, the first steps are taken towards the automatic photo-identification of the Ladoga ringed seals (Pusa hispida ladogensis). A method is proposed that takes a sequence of images, each containing multiple individuals as the input, and produces cropped images of seals grouped based on one certain individual per group. The method starts by detecting each seal from the images and proceeds to matching the individual seals between the images. It is shown that high grouping accuracy can be obtained with a general-purpose image retrieval method on an image sequence taken from the same location within a relatively short period of time. Each resulting group contains multiple images of one individual with slightly different variations, for example, in pose and illumination. Utilizing these images simultaneously provides more information for the individual re-identification compared to the traditional approach, i.e., which utilizes just one image at a time. It is further demonstrated that a convolutional neural network based method can be used to extract the unique pelage patterns of the seals despite the low contrast. Finally, a method is proposed and experiments with the novel Ladoga ringed seals data are carried out to provide a proof-of-concept for the individual re-identification.

关键词： Animal re-identification Convolutional neural networks Instance segmentation Ladoga ringed seal Photo-identification

来源：评论

学校读者我要写书评

暂无评论

Compositional Inversion for Stable Diffusion Models

arXiv

引用

arXiv 2023年

作者： Zhang, Xulu Wei, Xiao-Yong Wu, Jinlin Zhang, Tianyi Zhang, Zhaoxiang Lei, Zhen Li, Qing Department of Computing the Hong Kong Polytechnic University Hong Kong Center for Artificial Intelligence and Robotics HKISI CAS Hong Kong College of Computer Science Sichuan University Chengdu China School of Artificial Intelligence UCAS Beijing China State Key Laboratory of Multimodal Artificial Intelligence Systems CASIA Beijing China

Inversion methods, such as Textual Inversion, generate personalized images by incorporating concepts of interest provided by user images. However, existing methods often suffer from overfitting issues, where the dominant presence of inverted concepts leads to the absence of other desired concepts. It stems from the fact that during inversion, the irrelevant semantics in the user images are also encoded, forcing the inverted concepts to occupy locations far from the core distribution in the embedding space. To address this issue, we propose a method that guides the inversion process towards the core distribution for compositional embeddings. Additionally, we introduce a spatial regularization approach to balance the attention on the concepts being composed. Our method is designed as a post-training approach and can be seamlessly integrated with other inversion methods. Experimental results demonstrate the effectiveness of our proposed approach in mitigating the overfitting problem and generating more diverse and balanced compositions of concepts in the synthesized images. The source code is available at https://***/zhangxulu1996/Compositional-Inversion. © 2023, CC BY.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Graph Neural Networks for Human-Aware Social Navigation 21st

Graph Neural Networks for Human-Aware Social Navigation

引用

21st International Workshop of Physical Agents, WAF 2020

作者： Manso, Luis J. Jorvekar, Ronit R. Faria, Diego R. Bustos, Pablo Bachiller, Pilar Department of Computer Science College of Engineering and Physical Sciences Aston University Birmingham United Kingdom Department of Computer Engineering Pune Institute of Computer Technology Pune India Robotics and Artificial Vision Laboratory University of Extremadura Badajoz Spain

ISBN: (纸本)9783030625788

Autonomous navigation is a key skill for assistive and service robots. To be successful, robots have to comply with social rules, such as avoiding the personal spaces of the people surrounding them, or not getting in the way of human-to-human and human-to-object interactions. This paper suggests using Graph Neural Networks to model how inconvenient the presence of a robot would be in a particular scenario according to learned human conventions so that it can be used by path planning algorithms. To do so, we propose two automated scenario-to-graph transformations and benchmark them with different Graph Neural Networks using the SocNav1 dataset [1]. We achieve close-to-human performance in the dataset and argue that, in addition to its promising results, the main advantage of the approach is its scalability in terms of the number of social factors that can be considered and easily embedded in code in comparison with model-based approaches. The code used to train and test the resulting graph neural network is available in a public repository. © 2021, The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Human robot interaction

来源：评论

学校读者我要写书评

暂无评论

Exploiting Autoencoder's Weakness to Generate Pseudo Anomalies

arXiv

引用

arXiv 2024年

作者： Astrid, Marcella Zaheer, Muhammad Zaigham Aouada, Djamila Lee, Seung-Ik Department of Artificial Intelligence University of Science and Technology Daejeon34113 Korea Republic of Field Robotics Research Section Electronics and Telecommunications Research Institute Daejeon34129 Korea Republic of Interdisciplinary Centre for Security Reliability and Trust University of Luxembourg Luxembourg1855 Luxembourg Department of Computer Vision Mohamed Bin Zayed University of Artificial Intelligence Abu Dhabi United Arab Emirates

Due to the rare occurrence of anomalous events, a typical approach to anomaly detection is to train an autoencoder (AE) with normal data only so that it learns the patterns or representations of the normal training data. At test time, the trained AE is expected to well reconstruct normal but to poorly reconstruct anomalous data. However, contrary to the expectation, anomalous data is often well reconstructed as well. In order to further separate the reconstruction quality between normal and anomalous data, we propose creating pseudo anomalies from learned adaptive noise by exploiting the aforementioned weakness of AE, i.e., reconstructing anomalies too well. The generated noise is added to the normal data to create pseudo anomalies. Extensive experiments on Ped2, Avenue, ShanghaiTech, CIFAR-10, and KDDCUP datasets demonstrate the effectiveness and generic applicability of our approach in improving the discriminative capability of AEs for anomaly detection. © 2024, CC BY-NC-SA.

关键词： Anomaly detection

来源：评论

学校读者我要写书评

暂无评论

A Multi-Agent Digital Twin Framework for AI-Driven Fitness Coaching 25

A Multi-Agent Digital Twin Framework for AI-Driven Fitness C...

引用

Proceedings of the 2025 ACM International Conference on Interactive Media Experiences

作者： Monica (Monireh) Vahdati Kamran Gholizadeh HamlAbadi Fedwa Laamarti Abdulmotaleb El Saddik Multimedia Communications Research Laboratory (MCRLab) School of Electrical Engineering and Computer Science University of Ottawa Ottawa Ontario Canada Computer Vision Department Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) Abu Dhabi United Arab Emirates and Multimedia Communications Research Laboratory (MCRLab) School of Electrical Engineering and Computer Science University of Ottawa Ottawa Ontario Canada

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：