检索结果-内蒙古大学图书馆

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Changlong Jiang Yang Xiao Cunlin Wu Mingyang Zhang Jinghong Zheng Zhiguo Cao Joey Tianyi Zhou Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan China Alibaba Group Centre for Frontier AI Research Agency for Science Technology and Research (A*STAR) Singapore Institute of High Performance Computing Agency for Science Technology and Research (A*STAR) Singapore

3D interacting hand pose estimation from a single RGB image is a challenging task, due to serious self-occlusion and inter-occlusion towards hands, confusing similar appearance patterns between 2 hands, ill-posed joint position mapping from 2D to 3D, etc.. To address these, we propose to extend A2J-the state-of-the-art depth-based 3D single hand pose estimation method-to RGB domain under interacting hand condition. Our key idea is to equip A2J with strong local-global aware ability to well capture interacting hands' local fine details and global articulated clues among joints jointly. To this end, A2J is evolved under Transformer's non-local encoding-decoding framework to build A2J- Transformer. It holds 3 main advantages over A2J. First, self-attention across local anchor points is built to make them global spatial context aware to better capture joints' articulation clues for resisting occlusion. Secondly, each anchor point is regarded as learnable query with adaptive feature learning for facilitating pattern fitting capacity, instead of having the same local representation with the others. Last but not least, anchor point locates in 3D space instead of 2D as in A2J, to leverage 3D pose prediction. Experiments on challenging InterHand 2.6M demonstrate that, A2J-Transformer can achieve state-of-the-art model-free performance (3.38mm MPJPE advancement in 2-hand case) and can also be applied to depth domain with strong generalization. The code is avaliable at https://***/ChanglongJiangGit/A2J-Transformer.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Robust Imagined Speech Production from Electrocorticography with Adaptive Frequency Enhancement

Robust Imagined Speech Production from Electrocorticography ...

引用

International Joint Conference on Neural Networks (IJCNN)

作者： Xu Xu Chong Fu Junxin Chen Gwanggil Jeon David Camacho School of Computer Science and Engineering Northeastern University Shenyang China School of Software Dalian University of Technology Dalian China Key Laboratory of Intelligent Computing in Medical Image Ministry of Education Northeastern University Shenyang China Engineering Research Center of Security Technology of Complex Network System Ministry of Education Shenyang China College of Information Technology Incheon National University Incheon Korea Department of Computer Systems Engineering Universidad Politécnica de Madrid Madrid Spain

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

Imagined speech production with electrocorticography (ECoG) plays a crucial role in brain-computer interface system. A challenging issue is the great variation underlying the frequency bands of the ECoG signals’ encode information, which makes current methods difficult to generate imagined speech with stable quality among different persons. To this end, we propose a robust model to generate high-quality imagined speech from ECoG. A frequency enhancement branch is first designed to adaptively modulate the frequency information, whose product is fed into the following multi-scale channel attention module for robust feature extraction and fusion. By incorporating both the mel-spectrum and audio as training constraints, a multi-constraint decoder branch is finally constructed for imagined speech production. The performance of our model is evaluated on a high-quality dateset, i.e, Single Word Production Dutch-iBIDS. It yields Pearson correlation scores that are all above 0.8, and the standard deviationsare are all below 0.2 in different volunteers. Experimental results demonstrate that our model is effective and robust for ECoG based imagined speech production, and has advantages over peer methods.

关键词： Training Adaptation models Frequency modulation Correlation Neuroscience Production Speech enhancement

来源：评论

学校读者我要写书评

暂无评论

On the Performance Trade-off of Distributed Integrated Sensing and Communication Networks

arXiv

引用

arXiv 2023年

作者： Li, Xuran Guo, Shuaishuai Li, Tuo Zou, Xiaofeng Li, Dengwang Shandong Key Laboratory of Medical Physics and Image Processing School of Physics and Electronics Shandong Normal University Jinan250061 China School of Control Science and Engineering Shandong University Jinan250061 China Shandong Provincial Key Laboratory of Wireless Communication Technologies China Shandong Yunhai Guochuang Cloud Computing Equipment Industry Innovation Co. Ltd. China

In this letter, we analyze the performance tradeoff in distributed integrated sensing and communication (ISAC) networks. Specifically, with the aid of stochastic geometry theory, we derive the probability of detection of that of the coverage given user number. Based on the analytical derivations, we provide a quantitative description of the performance limits and the performance trade-off between sensing and communication in a distributed ISAC network under the given transmit power and bandwidth budget. Extensive simulations are conducted and the numerical results validate the accuracy of our derivations. Copyright © 2023, The Authors. All rights reserved.

关键词： Economic and social effects

来源：评论

学校读者我要写书评

暂无评论

Incremental Semi-Supervised Graph Learning Nmf with Block-Diagonal

SSRN

引用

SSRN 2023年

作者： Lv, Xue Leng, Chengcai Cheng, Irene Basu, Anup Jiao, Licheng School of Mathematics Northwest University Xi’an710127 China Department of Computing Science University of Alberta EdmontonABT6G 2E8 Canada The Key Laboratory of Intelligent Perception and Image Understanding of Education Ministry of China School of Artificial Intelligence Xidian University Xi’an710071 China

Non-negative matrix factorization (NMF), as a good data dimensionality reduction method, is widely used in the field of image recognition. Incremental non-negative matrix factorization (INMF) as an improvement solves the problem of low efficiency caused by repeated running of data samples during online learning. However, in the traditional INMF algorithm, the newly added training samples do not contain label information. In an actual application scenario, there may be some samples being marked in both the initial sample and the new training sample. To fully utilize the small amount of label information carried by the dataset, we propose a semi-supervised NMF model for batch incremental data, namely incremental semi-supervised graph learning NMF with block-diagonal (ISGDNMF). The model is divided into three cases according to the degree of label-carrying for the new batch data: all label-carrying, no label-carrying and partial label-carrying. The label information is also used to add a diagonal structure to the coefficient matrix, which makes it possible to have a stronger discriminatory ability and be able to distinguish different classes of the images more easily. In addition, graph regularization information is added in order to maintain the spatial geometric structure of the data. Experiments on five image datasets illustrate that our algorithm has superior performance relative to seven other NMF-based algorithms. © 2023, The Authors. All rights reserved.

关键词： Non-negative matrix factorization

来源：评论

学校读者我要写书评

暂无评论

Real-time Multi-person Eyeblink Detection in the Wild for Untrimmed Video

arXiv

引用

arXiv 2023年

作者： Zeng, Wenzheng Xiao, Yang Wei, Sicheng Gan, Jinfang Zhang, Xintao Cao, Zhiguo Fang, Zhiwen Zhou, Joey Tianyi Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China School of Biomedical Engineering Southern Medical University Guangzhou510515 China Department of Rehabilitation Medicine Zhujiang Hospital Southern Medical University Guangzhou510280 China Singapore Singapore

Real-time eyeblink detection in the wild can widely serve for fatigue detection, face anti-spoofing, emotion analysis, etc. The existing research efforts generally focus on single-person cases towards trimmed video. However, multi-person scenario within untrimmed videos is also important for practical applications, which has not been well concerned yet. To address this, we shed light on this research field for the first time with essential contributions on dataset, theory, and practices. In particular, a large-scale dataset termed MPEblink that involves 686 untrimmed videos with 8748 eyeblink events is proposed under multi-person conditions. The samples are captured from unconstrained films to reveal "in the wild" characteristics. Meanwhile, a real-time multi-person eyeblink detection method is also proposed. Being different from the existing counterparts, our proposition runs in a one-stage spatio-temporal way with end-to-end learning capacity. Specifically, it simultaneously addresses the sub-tasks of face detection, face tracking, and human instance-level eyeblink detection. This paradigm holds 2 main advantages: (1) eyeblink features can be facilitated via the face's global context (e.g., head pose and illumination condition) with joint optimization and interaction, and (2) addressing these sub-tasks in parallel instead of sequential manner can save time remarkably to meet the real-time running requirement. Experiments on MPEblink verify the essential challenges of real-time multi-person eyeblink detection in the wild for untrimmed video. Our method also outperforms existing approaches by large margins and with a high inference speed. Copyright © 2023, The Authors. All rights reserved.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

A novel global feature-oriented relational triple extraction model based on table filling

arXiv

引用

arXiv 2021年

作者： Ren, Feiliang Zhang, Longhui Yin, Shujuan Zhao, Xiaofeng Liu, Shilei Li, Bochao Liu, Yaduo School of Computer Science and Engineering Key Laboratory of Medical Image Computing Ministry of Education Northeastern University Shenyang110169 China

Table filling based relational triple extraction methods are attracting growing research interests due to their promising performance and their abilities on extracting triples from complex sentences. However, this kind of methods are far from their full potential because most of them only focus on using local features but ignore the global associations of relations and of token pairs, which increases the possibility of overlooking some important information during triple extraction. To overcome this deficiency, we propose a global feature-oriented triple extraction model that makes full use of the mentioned two kinds of global associations. Specifically, we first generate a table feature for each relation. Then two kinds of global associations are mined from the generated table features. Next, the mined global associations are integrated into the table feature of each relation. This "generate-mine-integrate" process is performed multiple times so that the table feature of each relation is refined step by step. Finally, each relation's table is filled based on its refined table feature, and all triples linked to this relation are extracted based on its filled table. We evaluate the proposed model on three benchmark datasets. Experimental results show our model is effective and it achieves state-of-the-art results on all of these datasets. The source code of our work is available at: https://***/neukg/GRTE. © 2021, CC BY-NC-SA.

关键词： Extraction

来源：评论

学校读者我要写书评

暂无评论

Crsanet: Class Representations Self-Attention Network for the Segmentation of Thyroid Nodules

SSRN

引用

SSRN 2023年

作者： Sun, Shiyao Fu, Chong Xu, Sen Wen, Yingyou Ma, Tao School of Computer Science and Engineering Northeastern University Shenyang110819 China Key Laboratory of Intelligent Computing in Medical Image Ministry of Education Northeastern University Shenyang110819 China Engineering Research Center of Security Technology of Complex Network System Ministry of Education China General Hospital of Northern Theatre Command Shenyang110016 China Medical Imaging Research Department Neusoft Research of Intelligent Healthcare Technology Co. Ltd. Shenyang China Dopamine Group Ltd. Auckland1542 New Zealand

Segmenting accurate thyroid nodules in medical ultrasound images is always non-trivial due to the large variation in size, shape and texture of nodules, and also the presence of surrounding tissues and organs with similar intensity values. Existing algorithms solve this by designing multi-scale spatial context modeling modules and introducing the emerging self-attention based paradigm, while failing to learn the class-wise relational context around nodules. To this end, we propose a novel coarse-to-fine framework, namely, CRSANet, which leverages both class-wise relational context and spatial multi-scale context for comprehensive context perception. Specifically, we first introduce the concept of Class Representations, which describe the overall representation of thyroid nodules in ultrasound images from a categorical perspective. Secondly, we propose a backbone-free dual-branch Class Representation Self-Attention Module (CRSA) to refine the coarse segmentation results from segmentation backbones. Concretely, Fine Class Region (FCR) branch is proposed to impose consistency between pixels and their corresponding Class Representations to correct the wrongly classified pixels. Meanwhile, Class Contextual Representation (CCR) branch is introduced to enhance the ability of pixel representations with the corresponding Class Representations. We evaluate the effectiveness and generality of CRSANet using three types of backbone networks. In the experiments, our proposed U-CRSANet achieves a mIoU of 78.86% and 81.35%, an accuracy of 97.11% and 98.63%, a Dice value of 74.26% and 87.57%, respectively, which outperforms most state-of-the-art methods on the public DDTI and TN-SCUI datasets. © 2023, The Authors. All rights reserved.

关键词： Pixels

来源：评论

学校读者我要写书评

暂无评论

Memory Analysis for Memristors and Memristive Recurrent Neural Networks

引用

IEEE/CAA Journal of Automatica Sinica 2020年第1期7卷 96-105页

作者： Gang Bao Yide Zhang Zhigang Zeng Key Laboratory of Cascaded Hydropower Stations Operation and Control Electrical Engineering and New EnergyChina Three Gorges UniversityYichang 443002and Hubei Key Laboratory of Applied Mathematics(Hubei University)Wuhan 430074China Department of Medical Engineering California Institute of TechnologyPasadenaCalifornia 91125 USA School of Artificial Intelligence and Automation Huazhong University of Science and Technologyand also with the Key Laboratory of Image Processing and Intelligent Control of Education Ministry of ChinaWuhan 430074China

Traditional recurrent neural networks are composed of capacitors, inductors, resistors, and operational *** neural networks are constructed by replacing resistors with memristors. This paper focuses on the memory analysis,i.e. the initial value computation, of memristors. Firstly, we present the memory analysis for a single memristor based on memristors’ mathematical models with linear and nonlinear ***, we present the memory analysis for two memristors in series and parallel. Thirdly, we point out the difference between traditional neural networks and those that are memristive. Based on the current and voltage relationship of memristors, we use mathematical analysis and SPICE simulations to demonstrate the validity of our methods.

关键词： Dopant drift memory memristive neural networks memristor

来源：评论

学校读者我要写书评

暂无评论

Modeling Fine-Grained Relations in Dynamic Space-Time Graphs for Video-Based Facial Expression Recognition

引用

IEEE Transactions on Affective computing 2025年

作者： Huang, Changqin Jiang, Fan Han, Zhongmei Huang, Xiaodi Wang, Shijin Zhu, Yanlai Jiang, Yunliang Hu, Bin Zhejiang Normal University Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province Zhejiang Jinhua321004 China Charles Sturt University School of Computing Mathematics and Engineering AlburyNSW2640 Australia State Key Laboratory of Cognitive Intelligence Anhui Hefei230088 China Hangzhou Hikvision Digital Technology Co. Ltd Education Business Department Hangzhou310051 China Zhejiang Normal University School of Computer Science and Technology Jinhua321004 China Beijing Institute of Technology School of Medical Technology Beijing10081 China

Facial expressions in videos inherently mirror the dynamic nature of real-world facial events. Consequently, facial expression recognition (FER) should employ a dynamic graph-based representation to effectively capture the relational structure of facial expressions rather than relying on conventional grid or sequence methods. However, existing graph-based approaches have their limitations. Frame-level graph methods provide a coarse representation of the facial graph across time and space, while landmark-based graph methods need to introduce additional facial landmarks, resulting in a static graph structure. To address these challenges, we propose spatial-temporal relation-aware dynamic graph convolutional networks (ST-RDGCN). This fine-grained relation modeling approach enables the dynamic modeling of evolving facial expressions in videos through dynamic space-time graphs, eliminating the need for facial landmarks. ST-RDGCN encompasses three graph construction paradigms: dynamic independent space graph, dynamic joint space-time graph, and dynamic cross space-time graph. Furthermore, we propose a relation-aware space-time graph convolution (RSTG-Conv) operator to learn informative spatiotemporal correlations in dynamic space-time graphs. In extensive experimental evaluations, our ST-RDGCN demonstrates state-of-the-art performance on the five popular video-based FER datasets, achieving overall accuracy scores of 99.69%, 91.67%, 56.51%, 69.37%, and 49.03% on the CK+, Oulu-CASIA, AFEW, DFEW, and FERV39 k datasets, respectively. In particular, our ST-RDGCN outperforms the current best method by 3.6% in UAR on the most challenging FERV39 k dataset. Furthermore, our analysis reveals that the dynamic cross space-time graph scheme is the most effective among the three dynamic graph construction schemes. © 2010-2012 IEEE.

关键词： Graphic methods

来源：评论

学校读者我要写书评

暂无评论

MMBDE: A Two-stage Hybrid Feature Selection Method From Microarray Data

MMBDE: A Two-stage Hybrid Feature Selection Method From Micr...

引用

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Weidong Xie Yuhuan Chi Linjie Wang Kun Yu Wei Li Computer Science and Engineering Northeastern University Shenyang China College of Medicine and Bioinformation Engineering Northeastern University Shenyang China Key Laboratory of Intelligent Computing in Medical Image Northeastern University Shenyang China

ISBN: (纸本)9781665429825

The discovery of diagnostically significant genes from microarray data is essential for disease diagnosis and drug research. However, the difficulty of analyzing microarray data comes from its high dimensionality and small sample size. Feature selection can effectively remove irrelevant and redundant features, reduce data dimensionality, and improve the accuracy of classifiers. This paper proposes a two-stage hybrid feature selection method MMBDE based on the improved min-Redundancy and Max-Relevance (mRMR) and the improved Binary Differential Evolution (BDE) algorithm. The improved mRMR is used to reduce the feature dimensionality at a coarse-scale significantly. In contrast, the improved BDE is used to refine the feature dimensionality at fine-scale further and select the best features. The experimental results show that MMBDE successfully reduces the dimensionality of microarray gene expression data, obtains high classification accuracy, and extracts effective features closely related to diseases from microarray gene expression data. The relevant datasets and codes can be obtained from https://***/xwdshiwo/MMBDE.

关键词： Drugs Quantization (signal) Codes Conferences Feature extraction Gene expression medical diagnosis

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：