检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Feng, Guanwen Cheng, Haoran Li, Yunan Ma, Zhiyuan Li, Chaoneng Qian, Zhihao Miao, Qiguang Pun, Chi-Man School of Computer Science and Technology Xidian University Xi’an710071 China Xi’an Key Laboratory of Big Data and Intelligent Vision Xidian University Xi’an710071 China Key Laboratory of Collaborative lntelligence Systems Ministry of Education Xidian University Xi’an710071 China Department of Computer and Information Science University of Macau 999078 China

—Implementing fine-grained emotion control is crucial for emotion generation tasks because it enhances the expressive capability of the generative model, allowing it to accurately and comprehensively capture and express various nuanced emotional states, thereby improving the emotional quality and personalization of generated content. Generating fine-grained facial animations that accurately portray emotional expressions using only a portrait and an audio recording presents a challenge. In order to address this challenge, we propose a visual attribute-guided audio decoupler. This enables the obtention of content vectors solely related to the audio content, enhancing the stability of subsequent lip movement coefficient predictions. To achieve more precise emotional expression, we introduce a fine-grained emotion coefficient prediction module. Additionally, we propose an emotion intensity control method using a fine-grained emotion matrix. Through these, effective control over emotional expression in the generated videos and finer classification of emotion intensity are accomplished. Subsequently, a series of 3DMM coefficient generation networks are designed to predict 3D coefficients, followed by the utilization of a rendering network to generate the final video. Our experimental results demonstrate that our proposed method, EmoSpeaker, outperforms existing emotional talking face generation methods in terms of expression variation and lip synchronization. Project page: https://***/EmoSpeaker/ Copyright © 2024, The Authors. All rights reserved.

关键词： Forecasting

来源：评论

学校读者我要写书评

暂无评论

Reinforcement Learning for Dependency-Aware Tasks Offloading in Digital Twin Edge Networks

Reinforcement Learning for Dependency-Aware Tasks Offloading...

引用

Artificial Intelligence of Things and Systems (AIoTSys), International Conference on

作者： Jiaxin Xiong Lingxiao Chen Liang Zhao Wei Chang Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering College of Computer and Information Technology China Three Gorges University Yichang China Computer Science Department Saint Joseph’s University USA

Mobile Edge Computing (MEC) and Digital Twin (DT) technologies are crucial to meet the quality of service (QoS) of emerging applications. MEC sinks the processing power of the cloud to the edge and responds to users’ requests in real time. DT can collect and analyze a large amount of data to make the optimal decision. However, the combination of MEC and DT is always ignored. Furthermore, it is more challenging to offload dependency-aware tasks efficiently. Therefore, this paper aims to present a more comprehensive survey of DT edge networks (DTEN). We first discuss prior knowledge about DTEN, such as its basic concepts, advantages, and application scenarios. Then, we highlight the research challenges for dependency-aware task offloading in recent years, including computation offloading, resource allocation, service caching, and edge collaboration. Furthermore, we introduce Reinforcement Learning (RL) for networking systems in detail. Finally, we conduct a typical dependency-aware task offloading case study to understand DTEN more deeply.

关键词：

来源：评论

学校读者我要写书评

暂无评论

LES-Talker: Fine-Grained Emotion Editing for Talking Head Generation in Linear Emotion Space

arXiv

引用

arXiv 2024年

作者： Feng, Guanwen Qian, Zhihao Li, Yunan Jin, Siyu Miao, Qiguang Pun, Chi-Man School of Computer Science and Technology Xidian University Xi’an710071 China Xi’an Key Laboratory of Big Data and Intelligent Vision Shaanxi Xi’an710071 China Key Laboratory of Collaborative Intelligence Systems Ministry of Education Xidian University Xi’an710071 China Department of Computer and Information Science University of Macau 999078 China

While existing one-shot talking head generation models have achieved progress in coarse-grained emotion editing, there is still a lack of fine-grained emotion editing models with high interpretability. We argue that for an approach to be considered fine-grained, it needs to provide clear definitions and sufficiently detailed differentiation. We present LES-Talker, a novel one-shot talking head generation model with high interpretability, to achieve fine-grained emotion editing across emotion types, emotion levels, and facial units. We propose a Linear Emotion Space (LES) definition based on Facial Action Units to characterize emotion transformations as vector transformations. We design the Cross-Dimension Attention Net (CDAN) to deeply mine the correlation between LES representation and 3D model representation. Through mining multiple relationships across different feature and structure dimensions, we enable LES representation to guide the controllable deformation of 3D model. In order to adapt the multimodal data with deviations to the LES and enhance visual quality, we utilize specialized network design and training strategies. Experiments show that our method provides high visual quality along with multilevel and interpretable fine-grained emotion editing, outperforming mainstream methods. Project page: https://***/LES-Talker/ Copyright © 2024, The Authors. All rights reserved.

关键词： 3D modeling

来源：评论

学校读者我要写书评

暂无评论

DCHM: Dynamic Collaboration of Heterogeneous Models Through Isomerism Learning in a Blockchain-Powered Federated Learning Framework 39

DCHM: Dynamic Collaboration of Heterogeneous Models Through ...

引用

39th Annual AAAI Conference on Artificial Intelligence, AAAI 2025

作者： Hao, Zhihao Zhang, Bob Li, Haisheng School of Computer Science and Artificial Intelligence Beijing Key Laboratory of Commercial Data Security Protection and Intelligent Governance Beijing Technology and Business University Beijing China Department of Computer and Information Science Faculty of Science and Technology University of Macau Taipa Macao Centre for Artificial Intelligence and Robotics Institute of Collaborative Innovation University of Macau Taipa Macao

ISBN: (纸本)157735897X

Solutions to time-varying problems are crucial for research areas such as predicting changes in human body shape over time. While recurrent neural networks have made significant advancements in this field, their reliance on centralized processing has led to challenges such as model silos and data isolation. In response, distributed AI systems like federated learning have emerged to facilitate dynamic collaboration among models;however, they still depend on central coordinators, which pose risks to system security and efficiency. Moreover, traditional federated learning primarily supports homogeneous models and lacks effective strategies for the interaction of heterogeneous models. To address these limitations, we propose a novel method called Dynamic Collaboration of Heterogeneous Models (DCHM), based on Isomerism Learning, which leverages a consortium blockchain network to enhance model credibility and facilitate coordination among heterogeneous models. Additionally, we introduce a Distributed Hierarchical Aggregation (DHA) algorithm that enables permissioned nodes within each group to aggregate local model results and share them for standardized processing. After several iterative cycles, these nodes perform secondary integration of local results to produce global outcomes. Experimental results demonstrate that DCHM effectively analyzes the temporal variability of body shape changes with high efficiency. Copyright © 2025, Association for the Advancement of Artificial Intelligence (***). All rights reserved.

关键词： Federated learning

来源：评论

学校读者我要写书评

暂无评论

Clustering-Based Resource Management for Consumer Cost Optimization in IoT Edge Computing Environments

引用

IEEE Transactions on Consumer Electronics 2024年 1-1页

作者： Denden, Mohsen Jemmali, Mahdi Boulila, Wadii Soni, Mukesh Khan, Faheem Ahmad, Jawad Department of Computer and Information Technologies College of Telecommunication and Information CTI Riyadh Saudi Arabia Department of Computer Science College of Computing and Informatics University of Sharjah Sharjah UAE Robotics and Internet-of-Things Laboratory Prince Sultan University Riyadh Saudi Arabia Department of CSE University Centre for Research and Development Chandigarh University Mohali Punjab- India Department of Computer Engineering Gachon University Seongnam-si South Korea School of Computing Engineering and the Built Environment Edinburgh Napier University U.K

Edge computing emerges as a pivotal model in the era of next-generation consumer electronics and the emerging challenges of multimodal data-driven decision-making. Specifically, edge computing offers an open computing architecture for the vast and diverse consumer multimodal data generated by mobile computing and Internet of Things (IoT) technologies. While edge computing is instrumental in optimizing latency and bandwidth control in processing consumer multimodal data, the viability of employing edge resources is complicated by high service costs and the complexities of managing multimodal data diversity. This study introduces an innovative optimization method for distributing multimodal data on edge storage, considering both the I/O (input/output) speed and the overall distribution cost. The core part of our approach is the deployment of intelligent algorithms that ensure equitable data distribution across storage servers, thus eliminating unused space and reducing extra costs. Given the complexity of this NP-hard (non-deterministic polynomial-time) challenge, our study reveals a unique model incorporating an edge-broker component in combination with novel algorithms. The proposed algorithms aim to harmonize data distribution and reduce resource allocation expenses in a multimodal edge environment. Our proposed approach achieves excellent results, highlighting the efficacy of the proposed algorithms in several parameters such as makespan, cost, multimodal data security, and total processing time. Empirical tests reveal that the BCA (Best Clustering Algorithm) performs best, achieving a minimum load balancing rate of 92.2%, an average variance of 0.04, and an average run time of 0.56 seconds. IEEE

关键词： Edge computing

来源：评论

学校读者我要写书评

暂无评论

DAMPER: A Dual-Stage Medical Report Generation Framework with Coarse-Grained MeSH Alignment and Fine-Grained Hypergraph Matching 39

DAMPER: A Dual-Stage Medical Report Generation Framework wit...

引用

39th Annual AAAI Conference on Artificial Intelligence, AAAI 2025

作者： Huang, Xiaofei Chen, Wenting Liu, Jie Lu, Qisheng Luo, Xiaoling Shen, Linlin Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen China Department of Electrical Engineering City University of Hong Kong Kowloon Hong Kong National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

ISBN: (纸本)157735897X

Medical report generation is crucial for clinical diagnosis and patient management, summarizing diagnoses and recommendations based on medical imaging. However, existing work often overlook the clinical pipeline involved in report writing, where physicians typically conduct an initial quick review followed by a detailed examination. Moreover, current alignment methods may lead to misaligned relationships. To address these issues, we propose DAMPER, a dual-stage framework for medical report generation that mimics the clinical pipeline of report writing in two stages. In the first stage, a MeSH-Guided Coarse-Grained Alignment (MCG) stage that aligns chest X-ray (CXR) image features with medical subject headings (MeSH) features to generate a rough keyphrase representation of the overall impression. In the second stage, a Hypergraph-Enhanced Fine-Grained Alignment (HFG) stage that constructs hypergraphs for image patches and report annotations, modeling high-order relationships within each modality and performing hypergraph matching to capture semantic correlations between image regions and textual phrases. Finally,the coarse-grained visual features, generated MeSH representations, and visual hypergraph features are fed into a report decoder to produce the final medical report. Extensive experiments on public datasets demonstrate the effectiveness of DAMPER in generating comprehensive and accurate medical reports, outperforming state-of-the-art methods across various evaluation metrics. Copyright © 2025, Association for the Advancement of Artificial Intelligence (***). All rights reserved.

关键词： Diagnosis

来源：评论

学校读者我要写书评

暂无评论

Learning Multi-dimensional Edge Feature-based AU Relation Graph for Facial Action Unit Recognition

arXiv

引用

arXiv 2022年

作者： Luo, Cheng Song, Siyang Xie, Weicheng Shen, Linlin Gunes, Hatice Computer Vision Institute Shenzhen University China Shenzhen Institute of Artificial Intelligence and Robotics for Society China Guangdong Key Laboratory of Intelligent Information Processing China Department of Computer Science and Technology University of Cambridge United Kingdom

The activations of Facial Action Units (AUs) mutually influence one another. While the relationship between a pair of AUs can be complex and unique, existing approaches fail to specifically and explicitly represent such cues for each pair of AUs in each facial display. This paper proposes an AU relationship modelling approach that deep learns a unique graph to explicitly describe the relationship between each pair of AUs of the target facial display. Our approach first encodes each AU’s activation status and its association with other AUs into a node feature. Then, it learns a pair of multi-dimensional edge features to describe multiple task-specific relationship cues between each pair of AUs. During both node and edge feature learning, our approach also considers the influence of the unique facial display on AUs’ relationship by taking the full face representation as an input. Experimental results on BP4D and DISFA datasets show that both node and edge feature learning modules provide large performance improvements for CNN and transformer-based backbones, with our best systems achieving the state-of-the-art AU recognition results. Our approach not only has a strong capability in modelling relationship cues for AU recognition but also can be easily incorporated into various backbones. Our PyTorch code is made available at https://***/CVI-SZU/ME-GraphAU. Copyright © 2022, The Authors. All rights reserved.

关键词： Chemical activation

来源：评论

学校读者我要写书评

暂无评论

Context Unaware Knowledge Distillation for Image Retrieval

arXiv

引用

arXiv 2022年

作者： Reddy, Bytasandram Yaswanth Dubey, Shiv Ram Sanodiya, Rakesh Kumar Karn, Ravi Ranjan Prasad Department of Computer Science and Engineering Indian Institute of Information Technology Chittoor Sri City India Computer Vision and Biometrics Laboratory Indian Institute of Information Technology Allahabad India

Existing data-dependent hashing methods use large backbone networks with millions of parameters and are computationally complex. Existing knowledge distillation methods use logits and other features of the deep (teacher) model and as knowledge for the compact (student) model, which requires the teacher’s network to be fine-tuned on the context in parallel with the student model on the context. Training teacher on the target context requires more time and computational resources. In this paper, we propose context unaware knowledge distillation that uses the knowledge of the teacher model without fine-tuning it on the target context. We also propose a new efficient student model architecture for knowledge distillation. The proposed approach follows a two-step process. The first step involves pre-training the student model with the help of context unaware knowledge distillation from the teacher model. The second step involves fine-tuning the student model on the context of image retrieval. In order to show the efficacy of the proposed approach, we compare the retrieval results, no. of parameters and no. of operations of the student models with the teacher models under different retrieval frameworks, including deep cauchy hashing (DCH) and central similarity quantization (CSQ). The experimental results confirm that the proposed approach provides a promising trade-off between the retrieval results and efficiency. The code used in this paper is released publicly at https://***/satoru2001/CUKDFIR. Copyright © 2022, The Authors. All rights reserved.

关键词： Distillation

来源：评论

学校读者我要写书评

暂无评论

Adaptive Generalized Social Space Delimitation for Human-Robot Interaction Tasks

Adaptive Generalized Social Space Delimitation for Human-Rob...

引用

IEEE Latin American robotics Symposium, LARS

作者： Manuela M. F. Silva Aline F. F. Silva Douglas G. Macharet Department of Computer Science Computer Vision and Robotics Laboratory (VeRLab) Universidade Federal de Minas Gerais Belo Horizonte MG Brazil Laboratório de Inteligência Computacional e Robótica (LICRo) Instituto Federal do Triângulo Mineiro (IFTM) Campus Patrocínio Brazil

ISBN: (数字)9798331508807

ISBN: (纸本)9798331508814

Human-Robot Interaction (HRI) research is of paramount importance as it addresses the rapidly evolving landscape where robots are increasingly integrated into everyday life. Social spaces refer to the invisible zones that individuals maintain around themselves, dictating appropriate distances for various types of interactions. This concept is pivotal in HRI, as it ensures that robots engage with humans in ways that are both comfortable and respectful of personal boundaries. In this paper, we propose a novel social space delimitation approach based on deformable elastic bands. Our method leverages the flexibility and adaptability of elastic band theory to dynamically define and adjust social spaces around individuals and groups. The results, based on both static and dynamic cases as well as a real-world dataset, show that our approach achieves a responsive and accurate representation of social spaces, that can accommodate varying group configurations and environmental conditions.

关键词： Accuracy Human-robot interaction Robots

来源：评论

学校读者我要写书评

暂无评论

Digital Twin Definition for Detecting Abnormal Perspiration Patterns in High-Stress Professions 23

Digital Twin Definition for Detecting Abnormal Perspiration ...

引用

23rd RoEduNet Conference: Networking in Education and Research, RoEduNet 2024

作者： Vizitiu, Cristian Turcin, Ioan Dominey, Kevin Alexander Softic, Selver Dinculescu, Adrian-Catalin Bocanet, Vlad I. Dugan, Cosmin Moraru, Sorin-Aurel The Space Applications and Technologies Laboratory Institute of Space Science-Subsidiary of INFLPR Magurele Romania Transilvania University of Brasov Faculty of Electrical Engineering and Computer Science Department of Automatics and Information Technology Brasov Romania CAMPUS 02 University of Applied Sciences Department Automation Technology Graz Austria CAMPUS 02 University of Applied Sciences Department IT and Business Informatics Graz Austria Robotics and Production Management Technical University of Cluj-Napoca Cluj-Napoca Faculty of Industrial Engineering Department of Manufacturing Engineering Romania Bucharest University Emergency Hospital Bucharest Romania

ISBN: (纸本)9798331540388

Perspiration is a physiological response in high-stress situations, that also plays a key role in thermoregulation and stress management. Understanding perspiration patterns is used for assessing physiological responses and optimizing human performance especially in professions such as emergency medical services and military operations, as well as for individuals exposed to Isolated Confined Extreme (ICE) environments such as astronauts and space analog mission participants. This paper defines a Digital Twin (DT) model, that will be integrated with an existing physical sweat simulator module (SSM) prototype. Its goal is to simulate human perspiration under high-stress conditions by integrating environmental, physiological, and psychological data. The system architecture is developed via Model-Based Systems Engineering (MBSE). The scope of the designed virtual model is to accurately reflect physical perspiration, detect abnormal perspiration patterns, and generate recommendations regarding stress countermeasures. The goal is to influence the behavioral and/or physiological state of the physical twin, thereby creating a dynamic, responsive system. Machine learning (ML) models will be used to identify patterns in the environmental, physiological, and psychological inputs and predict sweat volume, chemical composition, and regional sweat distributions across the body. ML will also be used to detect abnormal perspiration patterns based on input data. The application of generative AI for creating test data from simulation templates is anticipated to facilitate the comparative analysis of two to three distinct profiles, such as astronauts, soldiers, and paramedics or firefighters, using simulated values. The SSM, with its integrated sensors, will serve the dual purpose of validating the model and providing realistic physical simulation. © 2024 IEEE.

关键词： Physiological models

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：