检索结果-内蒙古大学图书馆

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Guanwen Feng Yilin Zhang Yunan Li An Liu Qiguang Miao School of Computer Science and Technology Xidian University Xi’an China Xi’an Key Laboratory of Big Data and Intelligent Vision Xidian University Xi’an China Key Laboratory of Collaborative Intelligence Systems Ministry of Education Xidian University Xi’an China

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

In the field of sign language generation, Transformer-based models have been widely studied, but their quadratic computational complexity poses challenges. State Space Models (SSMs), like Mamba, offer a promising alternative with efficient long-range interaction modeling and linear complexity. In this study, we propose a two-stage generative framework for sign language generation, called Sign-Mamba, based on the state selection mechanism of SSM. In the first stage, we designed a Mamba-based encoder-decoder architecture, where the encoder captures the latent space representation and a symmetric decoder reconstructs it back into sign language skeletal points. In the second stage, the sign language latent space predicted by the Mamba-based latent predictor is used as a condition to guide the reconstruction network in generating more precise skeletal point sequences. We conducted comprehensive experiments on the PHOENIX and How2Sign datasets, and the results indicate that Sign-Mamba demonstrates competitive performance in sign language generation tasks. Project page: https://***/Sign-Mamba/

关键词： Sign language Computational modeling Semantics Computer architecture Signal processing Transformers Acoustics Decoding Speech processing Computational complexity

来源：评论

学校读者我要写书评

暂无评论

Gaussian-Face: Talking Head Generation with Hybrid Density via 3D Gaussian Splatting

Gaussian-Face: Talking Head Generation with Hybrid Density v...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Guanwen Feng Yilin Zhang Yunan Li Siyu Jin Qiguang Miao School of Computer Science and Technology Xidian University Xi’an China Xi’an Key Laboratory of Big Data and Intelligent Vision Xidian University Xi’an China Key Laboratory of Collaborative Intelligence Systems Ministry of Education Xidian University Xi’an China

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

In recent years, audio-driven neural radiance field (NeRF)-based talking head generation techniques have achieved impressive results. However, these methods still have some limitations, such as unsynchronized lip movements and visual jitter. Recently, 3D Gaussian splatting has gradually replaced NeRF. Compared to NeRF, 3D Gaussian offers notable advantages, including higher efficiency and better reconstruction quality. Based on this, we propose Gaussian-Face, an audio-driven Gaussian-based facial avatar. With just a few minutes of monocular video and audio, a high-fidelity, driveable facial avatar can be reconstructed within hours. To achieve this, we first use FLAME to obtain the 3D representation of the face and then design a Lip Motion Translator to map audio to 3D lip representations. To model higher-quality facial details, we propose a hybrid density modeling method that balances rendering speed and quality, enabling our approach to render high-fidelity facial avatars at more than 160 FPS. Project page: https://***/Gaussian-Face/

关键词： Visualization Three-dimensional displays Lips Avatars Fires Rendering (computer graphics) Neural radiance field Synchronization Speech processing Faces

来源：评论

学校读者我要写书评

暂无评论

KAN-Face: Efficient Resource Usage and Precision Lip-Sync in Talking Head Generation

KAN-Face: Efficient Resource Usage and Precision Lip-Sync in...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Guanwen Feng Siyu Jin Zhihao Qian Yunan Li Qiguang Miao School of Computer Science and Technology Xidian University Xi’an China Xi’an Key Laboratory of Big Data and Intelligent Vision Xidian University Xi’an China Key Laboratory of Collaborative Intelligence Systems Ministry of Education Xidian University Xi’an China

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Despite significant progress in NeRF-based talking head generation, problems like poor lip synchronization and inefficient resource usage remain. To solve these, we propose KANFace, a lightweight framework. In preprocessing, we introduce a Lip-Sync Enhancement Module that uses Wav2Lip to extract high-resolution audio features and map them to an explicit intermediate representation, ensuring precise lip movement alignment with the speaker’s identity. These predicted lip-sync features are combined with fundamental audio-extracted lip features and injected into the rendering module to improve synchronization. For rendering, we introduce FastKAN to map spatial points to color values. As a variant of KAN, FastKAN’s sensitivity to 3D scenes and efficient structure enable precise, fast color prediction. Our framework reduces resource consumption while enhancing lip-sync accuracy and facial reconstruction, making it ideal for talking head generation tasks in resource-limited settings. Project: https://***/KAN-Face/

关键词： Accuracy Three-dimensional displays Lips Color Signal processing Rendering (computer graphics) Feature extraction Synchronization Speech processing Faces

来源：评论

学校读者我要写书评

暂无评论

Gradient neural network models for approximate Tucker decomposition of time-dependent tensors

引用

Neurocomputing 2025年 640卷

作者： Che, Maolin Wei, Yimin Yan, Hong State Key Laboratory of Public Big Data and School of Mathematics and Statistics Guizhou University Guiyang550025 China Center for Intelligent Multidimensional Data Analysis Hong Science Park Shatin Hong Kong School of Mathematical Sciences and Key Laboratory of Mathematics for Nonlinear Sciences Fudan University Shanghai200433 China Department of Electrical Engineering and Center for Intelligent Multidimensional Data Analysis City University of Hong Kong 83 Tat Chee Avenue Kowloon Hong Kong

In this paper, we introduce a gradient neural network model for approximating the Tucker decomposition of time-dependent tensors with a specified multilinear rank bound. The behavior of this model is governed by a system of ordinary differential equations. First, based on the Karush–Kuhn–Tucker (KKT) conditions of the optimization problem for the approximate Tucker decomposition of a constant tensor, a gradient neural network model is proposed, demonstrating local stability according to Lyapunov stability theory. Next, we design a gradient neural network model specifically tailored for time-dependent tensors. Finally, using the Taylor-type difference rules, we discretize the proposed neural network models, ensuring zero stability for the implementation of digital hardware. We illustrate the effectiveness and characteristics of our approach through numerical examples. © 2025 Elsevier B.V.

关键词： Lyapunov methods

来源：评论

学校读者我要写书评

暂无评论

big-Moe: Bypassing Isolated Gating For Generalized Multimodal Face Anti-Spoofing

Big-Moe: Bypassing Isolated Gating For Generalized Multimoda...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Yingjie Ma Zitong Yu Xun Lin Weicheng Xie Linlin Shen College of Computer Science and Software Engineering Shenzhen University Great Bay University National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Guangdong Provincial Key Laboratory of Intelligent Information Processing

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

In the domain of facial recognition security, multimodal Face Anti-Spoofing (FAS) is essential for countering presentation attacks. However, existing technologies encounter challenges due to modality biases and imbalances, as well as domain shifts. Our research introduces a Mixture of Experts (MoE) model to address these issues effectively. We identified three limitations in traditional MoE approaches to multimodal FAS: (1) Coarse-grained experts’ inability to capture nuanced spoofing indicators; (2) Gated networks’ susceptibility to input noise affecting decision-making; (3) MoE’s sensitivity to prompt tokens leading to overfitting with conventional learning methods. To mitigate these, we propose the Bypass Isolated Gating MoE (big-MoE) framework, featuring: (1) Fine-grained experts for enhanced detection of subtle spoofing cues; (2) An isolation gating mechanism to counteract input noise; (3) A novel differential convolutional prompt bypass enriching the gating network with critical local features, thereby improving perceptual capabilities. Extensive experiments on four benchmark datasets demonstrate significant generalization performance improvement in multimodal FAS task. The code is released at https://***/murInJ/big-MoE.

关键词： Convolutional codes Sensitivity Convolution Face recognition Noise Logic gates Feature extraction Security Speech processing Overfitting

来源：评论

学校读者我要写书评

暂无评论

KAC-Unet: A Medical Image Segmentation With the Adaptive Group Strategy and Kolmogorov-Arnold Network

引用

IEEE Transactions on Instrumentation and Measurement 2025年 74卷

作者： Lin, Shiying Hu, Rong Li, Zuoyong Lin, Qinghua Zeng, Kun Wu, Xiang Fujian University of Technology Fujian Provincial Key Laboratory of Big Data Mining and Applications School of Computer Science and Mathematics Fuzhou350118 China Minjiang University Fujian Provincial Key Laboratory of Information Processing and Intelligent Control School of Computer and Big Data Fuzhou350121 China Fuzhou University Affiliated Provincial Hospital Provincial Clinical Medical College Fujian Medical University Department of Urology Fuzhou350001 China

In the field of deep learning-based medical image segmentation, convolutional neural networks (CNNs) extract image features by combining linear convolutional layers with nonlinear activation functions. However, excessive stacking of linear layers in the network limits the model’s ability to capture fine-grained details. In addition, the feature distribution imbalance caused by the traditional fixed grouping strategy (FGS) can affect the deep model’s capacity to perceive the overall structure of the image. To address these challenges, we propose a medical image segmentation framework, called Kolmogorov-Arnold Network with the adaptive group strategy and contextual Transformer based on Unet (KAC-Unet). First, we propose the adaptive group strategy (AGS) to balance the grouping of different input channels, alleviating the performance degradation caused by differences in group information. Then, we propose the Shift Tokenized Kolmogorov-Arnold Network (KAN) Block to capture complex features in medical images through flexible nonlinear transformations and shift operations. Extensive experiments are conducted on three medical image segmentation datasets. The results demonstrate the effectiveness and superiority of our proposed method compared with state-of-the-art algorithms. © 1963-2012 IEEE.

关键词： Convolutional neural networks

来源：评论

学校读者我要写书评

暂无评论

Learning with Open-world Noisy data via Class-independent Margin in Dual Representation Space

arXiv

引用

arXiv 2025年

作者： Pan, Linchao Gao, Can Zhou, Jie Wang, Jinbao College of Computer Science and Software Engineering Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China

Learning with Noisy Labels (LNL) aims to improve the model generalization when facing data with noisy labels, and existing methods generally assume that noisy labels come from known classes, called closed-set noise. However, in real-world scenarios, noisy labels from similar unknown classes, i.e., open-set noise, may occur during the training and inference stage. Such open-world noisy labels may significantly impact the performance of LNL methods. In this study, we propose a novel dual-space joint learning method to robustly handle the open-world noise. To mitigate model overfitting on closed-set and open-set noises, a dual representation space is constructed by two networks. One is a projection network that learns shared representations in the prototype space, while the other is a One-Vs-All (OVA) network that makes predictions using unique semantic representations in the class-independent space. Then, bi-level contrastive learning and consistency regularization are introduced in two spaces to enhance the detection capability for data with unknown classes. To benefit from the memorization effects across different types of samples, class-independent margin criteria are designed for sample identification, which selects clean samples, weights closed-set noise, and filters open-set noise effectively. Extensive experiments demonstrate that our method outperforms the state-of-the-art methods and achieves an average accuracy improvement of 4.55% and an AUROC improvement of 6.17% on CIFAR80N. Copyright © 2025, The Authors. All rights reserved.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

Asynchronous PID Control for T-S Fuzzy Systems Over Gilbert-Elliott Channels Utilizing Detected Channel Modes

引用

IEEE Transactions on Fuzzy Systems 2025年第5期33卷 1555-1567页

作者： Wang, Yezheng Wang, Zidong Zou, Lei Ge, Quanbo Dong, Hongli Nanjing University of Information Science and Technology School of Automation Nanjing210044 China Shandong University of Science and Technology College of Electrical Engineering and Automation Qingdao266590 China Brunel University London Department of Computer Science UxbridgeUB8 3PH United Kingdom Donghua University College of Information Science and Technology Shanghai201620 China Ministry of Education Engineering Research Center of Digitalized Textile and Fashion Technology Shanghai201620 China Nanjing University of Information Science and Technology Jiangsu Provincial University Key Laboratory of Big Data Analysis and Intelligent Systems Nanjing210044 China Nanjing210044 China Northeast Petroleum University State Key Laboratory of Continental Shale Oil Daqing163318 China Northeast Petroleum University Artificial Intelligence Energy Research Institute Daqing163318 China Northeast Petroleum University Heilongjiang Provincial Key Laboratory of Networking and Intelligent Control Daqing163318 China

This article is concerned with the H∞ proportional-integral-derivative (PID) control problem for Takagi-Sugeno fuzzy systems over lossy networks that are characterized by the Gilbert-Eillott model. The communication quality is reflected by the presence of two channel modes (i.e., "bad" mode and "good" mode), which switch randomly according to a Markov process. In the "bad" mode, packet dropouts are governed by a stochastic variable sequence. Considering the inaccessibility of channel modes, a mode detector is utilized to estimate the communication situation. The relationship between the actual channel mode and the estimated mode is depicted in terms of certain conditional probabilities. Moreover, a comprehensive model is constructed to represent the probability uncertainties arising from statistical errors in channel mode switching, packet dropouts, and mode detection processes. Subsequently, a robust asynchronous PID controller, based on the detected channel mode, is proposed. Sufficient conditions are then derived to ensure the mean-square stability of the closed-loop system while maintaining the desired H∞performance. Finally, the efficacy of the proposed design approach is demonstrated through a simulation example. © 1993-2012 IEEE.

关键词： Markov processes

来源：评论

学校读者我要写书评

暂无评论

Medical Image Segmentation Based on 3d Pdc with Swin Transformer

SSRN

引用

SSRN 2025年

作者： Fan, Lin Ding, Xiaojia Wang, Zhongmin Wang, Hai Zhang, Rong School of Computer Science and Technology Xi’an University of Posts and Telecommunications Shaanxi Xi’an710121 China Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing Shaanxi Xi’an710121 China Xi’an Key Laboratory of Big Data and Intelligent Computing Shaanxi Xi’an710121 China The School of Information Science and Technology Northwest University Shaanxi Xi’an710121 China

3D medical image segmentation is vital for disease diagnosis and effective treatment strategies. Despite the advancements in Convolutional Neural Networks (CNN), their fixed receptive fields constrain global context modeling, leading to suboptimal performance, particularly with complex shapes and multi-scale variations. Transformer enhances the global modeling capability through self-attention mechanism. However, challenges persist in capturing fine-grained local features and extracting edge features. To overcome these issues, In this study, a dual-path encoder is proposed, which consists of a 3D PDC and a Swin Transformer and is combined with a CNN for the decoder. The 3D PDC module extracts local features by calculating the differences between neighboring pixels. To improve the ability of capturing edge structures, three 3D PDC variants (3D CPDC, 3D APDC, and 3D RPDC) are proposed to optimize the processing ability of complex edges, multi-directional edges, and multi-scale structures, respectively. After performance evaluation, the selected CARV combinations (3D CPDC, 3D APDC, 3D RPDC, and 3D ordinary convolution) achieve a compromise between high segmentation accuracy and low computational cost. The Swin Transformer encoder captures global context using a hierarchical shift-window mechanism, while the CNN decoder fuses features progressively to produce precise pixel-level segmentation. The proposed method exceeds the performance of existing state-of-the-art techniques, as shown by experiments conducted on the BTCV, FLARE21, and AMOS22 datasets. © 2025, The Authors. All rights reserved.

关键词： Image segmentation

来源：评论

学校读者我要写书评

暂无评论

EXISTENCE AND UNIQUENESS OF SOLUTIONS FOR UNCERTAIN NONLINEAR SWITCHED SYSTEMS WITH V-N JUMPS

引用

UPB Scientific Bulletin, Series A: Applied Mathematics and Physics 2025年第1期87卷 129-140页

作者： Jia, Zhifu Li, Cunlin School of Mathematics and Physics Suqian University Suqian223800 China [Ningxia Key Laboratory of intelligent information and Big Data Processing Governance and Social Management Research Center of Northwest Ethnic Regions North Minzu University Yinchuan China

In this paper, an uncertain nonlinear switched system with V-n jumps, characterized by its sensitivity to subjective uncertainties, is modeled using uncertain differential equations with V-n jumps. To account for the discontinuous jump behavior in each subsystem, a V-n jumps process associated with an uncertain Z-n jumps variable, defined by a jump uncertainty distribution, is introduced. Under the assumptions of linear growth and Lipschitz conditions, an existence and uniqueness theorem for the solutions of uncertain nonlinear switched systems with V-n jumps is established and rigorously proven. An illustrative example is provided to demonstrate the effectiveness and applicability of the theoretical results. © 2025, Politechnica University of Bucharest. All rights reserved.

关键词： Uncertain systems

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：