检索结果-内蒙古大学图书馆

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Jiang, Changlong Xiao, Yang Wu, Cunlin Zhang, Mingyang Zheng, Jinghong Cao, Zhiguo Zhou, Joey Tianyi Huazhong Univ Sci & Technol Key Lab Image Proc & Intelligent Control Minist Educ Sch Artificial Intelligence & Automat Wuhan 430074 Peoples R China Alibaba Grp Hangzhou Peoples R China Agcy Sci Technol & Res STAR Ctr Frontier AI Res Singapore Singapore Agcy Sci Technol & Res STAR Inst High Performance Comp Singapore Singapore

ISBN: (纸本)9798350301298

3D interacting hand pose estimation from a single RGB image is a challenging task, due to serious self-occlusion and inter-occlusion towards hands, confusing similar appearance patterns between 2 hands, ill-posed joint position mapping from 2D to 3D, etc.. To address these, we propose to extend A2J-the state-of-the-art depth-based 3D single hand pose estimation method-to RGB domain under interacting hand condition. Our key idea is to equip A2J with strong local-global aware ability to well capture interacting hands' local fine details and global articulated clues among joints jointly. To this end, A2J is evolved under Transformer's non-local encoding-decoding framework to build A2J-Transformer. It holds 3 main advantages over A2J. First, self-attention across local anchor points is built to make them global spatial context aware to better capture joints' articulation clues for resisting occlusion. Secondly, each anchor point is regarded as learnable query with adaptive feature learning for facilitating pattern fitting capacity, instead of having the same local representation with the others. Last but not least, anchor point locates in 3D space instead of 2D as in A2J, to leverage 3D pose prediction. Experiments on challenging InterHand 2.6M demonstrate that, A2J-Transformer can achieve state-of-the-art model-free performance (3.38mm MPJPE advancement in 2-hand case) and can also be applied to depth domain with strong generalization. The code is avaliable at https://***/ChanglongJiangGit/A2J-Transformer. [GRAPHICS] .

关键词： body gesture Humans: Face movement pose

来源：评论

学校读者我要写书评

暂无评论

OadTR: Online Action Detection with Transformers 18

OadTR: Online Action Detection with Transformers

引用

18th IEEE/CVF International Conference on Computer Vision (ICCV)

作者： Wang, Xiang Zhang, Shiwei Qing, Zhiwu Shao, Yuanjie Zuo, Zhengrong Gao, Changxin Sang, Nong Huazhong Univ Sci & Technol Sch Artificial Intelligence & Automat Key Lab Image Proc & Intelligent Control Wuhan Peoples R China Alibaba Grp Beijing Peoples R China

ISBN: (纸本)9781665428125

Most recent approaches for online action detection tend to apply Recurrent Neural Network (RNN) to capture long-range temporal structure. However, RNN suffers from nonparallelism and gradient vanishing, hence it is hard to be optimized. In this paper, we propose a new encoder-decoder framework based on Transformers, named OadTR, to tackle these problems. The encoder attached with a task token aims to capture the relationships and global interactions between historical observations. The decoder extracts auxiliary information by aggregating anticipated future clip representations. Therefore, OadTR can recognize current actions by encoding historical information and predicting future context simultaneously. We extensively evaluate the proposed OadTR on three challenging datasets: HDD, TVSeries, and THUMOS14. The experimental results show that OadTR achieves higher training and inference speeds than current RNN based approaches, and significantly outperforms the state-of-the-art methods in terms of both mAP and mcAP.

关键词： Recurrent neural networks

来源：评论

学校读者我要写书评

暂无评论

Implicit Tracking-Based Distributed Constraint-Coupled Optimization

arXiv

引用

arXiv 2022年

作者： Li, Jingwang Su, Housheng The School of Artificial Intelligence and Automation The Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Huazhong University of Science and Technology Wuhan430074 China

A class of distributed optimization problem with a globally coupled equality constraint and local constrained sets is studied in this paper. For its special case where local constrained sets are absent, an augmented primal-dual gradient dynamics is proposed and analyzed, but it cannot be implemented distributedly since the violation of the coupled constraint needs to be used. Benefiting from the brand-new comprehending of a classical distributed unconstrained optimization algorithm, the novel implicit tracking approach is proposed to track the violation distributedly, which leads to the birth of the implicit tracking-based distributed augmented primal-dual gradient dynamics (IDEA). A projected variant of IDEA, i.e., Proj-IDEA, is further designed to deal with the general case where local constrained sets exist. With the aid of the Lyapunov stability theory, the convergences of IDEA and Proj-IDEA over undigraphs and digraphs are analyzed respectively. As far as we know, Proj-IDEA is the first constant step-size distributed algorithm which can solve the studied problem without the need of the strict convexity of local cost functions. Besides, if local cost functions are strongly convex and smooth, IDEA can achieve exponential convergence with a weaker condition about the coupled constraint. Finally, numerical experiments are taken to corroborate our theoretical results. © 2022, CC BY.

关键词： Cost functions

来源：评论

学校读者我要写书评

暂无评论

GraphCFC: A Directed Graph Based Cross-Modal Feature Complementation Approach for Multimodal Conversational Emotion Recognition

arXiv

引用

arXiv 2022年

作者： Li, Jiang Wang, Xiaoping Lv, Guoqing Zeng, Zhigang The School of Artificial Intelligence and Automation The Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Huazhong University of Science and Technology Wuhan430074 China

Emotion Recognition in Conversation (ERC) plays a significant part in Human-Computer Interaction (HCI) systems since it can provide empathetic services. Multimodal ERC can mitigate the drawbacks of uni-modal approaches. Recently, Graph Neural Networks (GNNs) have been widely used in a variety of fields due to their superior performance in relation modeling. In multimodal ERC, GNNs are capable of extracting both long-distance contextual information and inter-modal interactive information. Unfortunately, since existing methods such as MMGCN directly fuse multiple modalities, redundant information may be generated and diverse information may be lost. In this work, we present a directed Graph based Cross-modal Feature Complementation (GraphCFC) module that can efficiently model contextual and interactive information. GraphCFC alleviates the problem of heterogeneity gap in multimodal fusion by utilizing multiple subspace extractors and Pair-wise Cross-modal Complementary (PairCC) strategy. We extract various types of edges from the constructed graph for encoding, thus enabling GNNs to extract crucial contextual and interactive information more accurately when performing message passing. Furthermore, we design a GNN structure called GAT-MLP, which can provide a new unified network framework for multimodal learning. The experimental results on two benchmark datasets show that our GraphCFC outperforms the state-of-the-art (SOTA) approaches. Copyright © 2022, The Authors. All rights reserved.

关键词： Emotion Recognition

来源：评论

学校读者我要写书评

暂无评论

InferEM: Inferring the Speaker’s Intention for Empathetic Dialogue Generation

arXiv

引用

arXiv 2022年

作者： Lv, Guoqing Li, Jiang Wang, Xiaoping Zeng, Zhigang The School of Artificial Intelligence and Automation The Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China The Hubei Key Laboratory of Brain-inspired Intelligent Systems Huazhong University of Science and Technology Wuhan430074 China

Current approaches to empathetic response generation typically encode the entire dialogue history directly and put the output into a decoder to generate friendly feedback. These methods focus on modelling contextual information but neglect capturing the direct intention of the speaker. We argue that the last utterance in the dialogue empirically conveys the intention of the speaker. Consequently, we propose a novel model named InferEM for empathetic response generation. We separately encode the last utterance and fuse it with the entire dialogue through the multi-head attention based intention fusion module to capture the speaker’s intention. Besides, we utilize previous utterances to predict the last utterance, which simulates human’s psychology to guess what the interlocutor may speak in advance. To balance the optimizing rates of the utterance prediction and response generation, a multitask learning strategy is designed for InferEM. Experimental results demonstrate the plausibility and validity of InferEM in improving empathetic expression. Copyright © 2022, The Authors. All rights reserved.

关键词： Encoding (symbols)

来源：评论

学校读者我要写书评

暂无评论

Lithium-ion battery state-of-charge estimation using a real-time moving horizon estimation algorithm

Lithium-ion battery state-of-charge estimation using a real-...

引用

2021 CAA Symposium on Fault Detection, Supervision, and Safety for Technical Processes, SAFEPROCESS 2021

作者： Yan, Jiayu Li, Song Wan, Yiming Huazhong University of Science and Technology Key Laboratory of Image Processing and Intelligent Control Ministry of Education Wuhan China 29th Research Institute of China Electronics Technology Group Corporation Chengdu China

ISBN: (纸本)9781665401159

For battery management systems, it is significant to reliably estimate state-of-charge (SOC) from limited measurements in real time. Based on a nonlinear SOC-dependent equivalent circuit model, we propose a real-time moving horizon estimation (MHE) algorithm for SOC estimation. For efficient computation, the sequential quadratic programming strategy is applied, and each quadratic programming (QP) iteration is solved via the structure-exploiting forward and backward recursions. To account for the limited computation time allowed within each sampling interval, the proposed algorithm does not fully solve the receding horizon optimization problem over each sliding window, but performs fixed number of QP iterations. The simulation results show that compared to the existing fully solved MHE applied to SOC estimation, the proposed real-time MHE algorithm significantly saves computation time at the cost of a slight loss of estimation performance. © 2021 IEEE.

关键词： Quadratic programming

来源：评论

学校读者我要写书评

暂无评论

Multimodal Representations Learning Based on Mutual Information Maximization and Minimization and Identity Embedding for Multimodal Sentiment Analysis

arXiv

引用

arXiv 2022年

作者： Zheng, Jiahao Zhang, Sen Wang, Xiaoping Zeng, Zhigang School of Artificial Intelligence and Automation The Key Laboratory of Image Processing Intelligent Control of Education Ministry of China Huazhong University of Science and Technology Wuhan430074 China

Multimodal sentiment analysis (MSA) is a fundamental complex research problem due to the heterogeneity gap between different modalities and the ambiguity of human emotional expression. Although there have been many successful attempts to construct multimodal representations for MSA, there are still two challenges to be addressed: 1) A more robust multimodal representation needs to be constructed to bridge the heterogeneity gap and cope with the complex multimodal interactions, and 2) the contextual dynamics must be modeled effectively throughout the information flow. In this work, we propose a multimodal representation model based on Mutual information Maximization and Minimization and Identity Embedding (MMMIE). We combine mutual information maximization between modal pairs, and mutual information minimization between input data and corresponding features to mine the modal-invariant and task-related information. Furthermore, Identity Embedding is proposed to prompt the downstream network to perceive the contextual information. Experimental results on two public datasets demonstrate the effectiveness of the proposed model. Copyright © 2022, The Authors. All rights reserved.

关键词： Sentiment analysis

来源：评论

学校读者我要写书评

暂无评论

GNet: 3D Object Detection from Point Cloud with Geometry-Aware Network

GNet: 3D Object Detection from Point Cloud with Geometry-Awa...

引用

IEEE International Conference on Cyborg and Bionic Systems (CBS)

作者： Hao Ruan Bingrong Xu Junbin Gao Lianguang Liu Junting Lv Yin Sheng Zhigang Zeng School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Wuhan China School of Automation Wuhan University of Technology Wuhan China

3D object detection based on point clouds in real-world applications has been a challenging task because the raw point cloud may be sparse or occluded. It may be caused by bad weather or limited sensor resolution, leading to decreasing detection performance. To this end, a novel highperformance Geometry-aware Network (GNet) is proposed and used to accurately detect 3D objects from sparse point clouds. Different from previous work that only regresses the offset of 3D bounding boxes numerically between ground truth (GT) and prediction, GNet considers the geometric information of 3D bounding boxes and combines the two effectively to achieve a better regression performance. In particular, Point Nets blocks learned voxel-wise features and the proposals are generated by the 3D voxel convolution neural network (voxel CNN). By utilizing the prior knowledge and the geometric properties of the 3D bounding boxes, the proposed novel OS-loss can improve detection performance and accelerate speed of inference. Furthermore, GNet takes advantage of prior geometry properties rather than only regressing the offset numerically. These speed up the convergence of the regression network. Finally, our proposed GNet was evaluated on the KITTI dataset for 3D objects and Bird’s Eye View (BEV) detection aspects. The results demonstrate that GNet can improve object detection performance for sparse point clouds.

关键词： Point cloud compression Location awareness Geometry Three-dimensional displays Neural networks Object detection Proposals

来源：评论

学校读者我要写书评

暂无评论

GA2MIF: Graph and Attention Based Two-Stage Multi-Source Information Fusion for Conversational Emotion Detection

arXiv

引用

arXiv 2022年

作者： Li, Jiang Wang, Xiaoping Lv, Guoqing Zeng, Zhigang School of Artificial Intelligence and Automation the Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China Huazhong University of Science and Technology Wuhan430074 China

Multimodal Emotion Recognition in Conversation (ERC) plays an influential role in the field of human-computer interaction and conversational robotics since it can motivate machines to provide empathetic services. Multimodal data modeling is an up-and-coming research area in recent years, which is inspired by human capability to integrate multiple senses. Several graph-based approaches claim to capture interactive information between modalities, but the heterogeneity of multimodal data makes these methods prohibit optimal solutions. In this work, we introduce a multimodal fusion approach named Graph and Attention based Two-stage Multi-source Information Fusion (GA2MIF) for emotion detection in conversation. Our proposed method circumvents the problem of taking heterogeneous graph as input to the model while eliminating complex redundant connections in the construction of graph. GA2MIF focuses on contextual modeling and cross-modal modeling through leveraging Multi-head Directed Graph ATtention networks (MDGATs) and Multi-head Pairwise Cross-modal ATtention networks (MPCATs), respectively. Extensive experiments on two public datasets (i.e., IEMOCAP and MELD) demonstrate that the proposed GA2MIF has the capacity to validly capture intra-modal long-range contextual information and inter-modal complementary information, as well as outperforms the prevalent State-Of-The-Art (SOTA) models by a remarkable margin. Copyright © 2022, The Authors. All rights reserved.

关键词： Directed graphs

来源：评论

学校读者我要写书评

暂无评论

Energy Management Strategies for PEMFC-Lithium Battery Hybrid Power Systems Based on Pt Degradation

Energy Management Strategies for PEMFC-Lithium Battery Hybri...

引用

Chinese control Conference (CCC)

作者： Ziang Guo Beijia Li Linghong Zeng Jun Fu Chuang Sheng Xi Li School of Artificial Intelligence and Automation Key Laboratory of Image Processing and Intelligent Control of Education Ministry Huazhong University of Science and Technology Wuhan Hubei China Shenzhen Huazhong University of Science and Technology Research Institute Shenzhen China

Proton Exchange Membrane Fuel Cells(PEMFCs) are prone to decreased lifespan due to the degradation of the plat-inum(Pt) catalyst during operation. In this study, we have established a one-dimensional model to investigate the effects of different voltage conditions on Pt degradation. High potential is found to be the most significant factor affecting the degradation. Prolonged exposure to high potentials will significantly reduce the PEMFC's lifespan, and frequent voltage changes will exac-erbate the problem. To mitigate this issue, we have designed three energy management strategies with different limitations and simulated their performance in the operating scenario of a fuel-cell hybrid electric vehicle(FCHEV). The results demonstrate that strategies restricting high potential occurrences and voltage variations can effectively alleviate Pt degradation.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：