检索结果-内蒙古大学图书馆

DEGSTalk: Decomposed Per-Embedding Gaussian Fields for Hair-Preserving Talking Face Synthesis

学校读者我要写书评

暂无评论

DEGSTalk: Decomposed Per-Embedding Gaussian Fields for Hair-...

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Kaijun Deng Dezhi Zheng Jindong Xie Jinbao Wang Weicheng Xie Linlin Shen Siyang Song Computer Vision Institute School of Computer Science and Software Engineering Shenzhen University National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Guangdong Provincial Key Laboratory of Intelligent Information Processing Department of Computer Science University of Exeter

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Accurately synthesizing talking face videos and capturing fine facial features for individuals with long hair presents a significant challenge. To tackle these challenges in existing methods, we propose a decomposed per-embedding Gaussian fields (DEGSTalk), a 3D Gaussian Splatting (3DGS)-based talking face synthesis method for generating realistic talking faces with long hairs. Our DEGSTalk employs Deformable Pre-Embedding Gaussian Fields, which dynamically adjust pre-embedding Gaussian primitives using implicit expression coefficients. This enables precise capture of dynamic facial regions and subtle expressions. Additionally, we propose a Dynamic Hair-Preserving Portrait Rendering technique to enhance the realism of long hair motions in the synthesized videos. Results show that DEGSTalk achieves improved realism and synthesis quality compared to existing approaches, particularly in handling complex facial dynamics and hair preservation. Our code is available at https://***/CVI-SZU/DEGSTalk.

关键词： Hair Training Three-dimensional displays Dynamics Signal processing Rendering (computer graphics) Noise measurement Speech processing Faces Videos

Optimized Breast Lesion Segmentation in Ultrasound Videos Across Varied Resource-Scant Environments 17th

学校读者我要写书评

暂无评论

Optimized Breast Lesion Segmentation in Ultrasound Videos A...

17th Asian Conference on computer vision, ACCV 2024

作者： Li, Yunhao Chen, Zibin Yan, Junming Ding, Ziyu Li, Jie Huang, Teng Pei, Xiaoqing Zhang, Zheng Wang, Qiong Pang, Yan Institute of Artificial Intelligence Guangzhou University Guangzhou China Cancer Center Sun Yat-sen University Guangzhou China Moxibustion and Rehabilitation Guangzhou University of Chinese Medicine Guangzhou China Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Beijing China

ISBN: (纸本)9789819609659

Medical video segmentation plays a crucial role in clinical diagnosis and therapeutic procedures by enabling dynamic tracking of breast lesions across frames in ultrasound videos, thereby improving segmentation accuracy. However, the existing methods struggle to strike a balance between segmentation accuracy and inference speed, which impedes their real-time deployment in resource-limited medical environments. To overcome these challenges, we introduce a rapid breast lesion segmentation framework named RbS. RbS employs the Stem module and RbSBlock to enhance representations through intra-frame analysis of ultrasound videos. Moreover, we have developed two versions of RbS: RbS-S boasts enhanced segmentation accuracy, while RbS-L ensures faster inference speeds. Experimental evidence indicates that RbS surpasses current leading models in both segmentation efficiency and prediction accuracy, particularly on resource-limited devices. Our contribution significantly propels the progress of developing efficient medical video segmentation frameworks suitable for various medical platforms. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Image segmentation

Joint Design of Radar Receive Filter and Unimodular ISAC Waveform with Sidelobe Level Control

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Kecheng Liu, Ya-Feng Wang, Zhongbin Yuan, Weijie Keskin, Musa Furkan Wymeersch, Henk Xia, Shuqiang School of System Design and Intelligent Manufacturing The Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen518055 China State Key Laboratory of Scientific and Engineering Computing Institute of Computational Mathematics and Scientific/Engineering Computing Academy of Mathematics and Systems Science Chinese Academy of Sciences Beijing100190 China Department of Electrical Engineering Chalmers University of Technology Gothenburg41296 Sweden ZTE Corporation The State Key Laboratory of Mobile Network and Mobile Multimedia Technology Shenzhen518055 China

Integrated sensing and communication (ISAC) has been considered a key feature of next-generation wireless networks. This paper investigates the joint design of the radar receive filter and dual-functional transmit waveform for the multiple-input multiple-output (MIMO) ISAC system. While optimizing the mean square error (MSE) of the radar receive spatial response and maximizing the achievable rate at the communication receiver, besides the constraints of full-power radar receiving filter and unimodular transmit sequence, we control the maximum range sidelobe level, which is often overlooked in existing ISAC waveform design literature, for better radar imaging performance. To solve the formulated optimization problem with convex and nonconvex constraints, we propose an inexact augmented Lagrangian method (ALM) algorithm. For each subproblem in the proposed inexact ALM algorithm, we custom-design a block successive upper-bound minimization (BSUM) scheme with closed-form solutions for all blocks of variable to enhance the computational efficiency. Convergence analysis shows that the proposed algorithm is guaranteed to provide a stationary and feasible solution. Extensive simulations are performed to investigate the impact of different system parameters on communication and radar imaging performance. Comparison with the existing works shows the superiority of the proposed algorithm. © 2025, CC BY-NC-SA.

关键词： Mean square error

Learning-based Detection of GPS Spoofing Attack for Quadrotors

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wang, Pengyu Yang, Zhaohua Li, Jialu Shi, Ling Department of Electronic and Computer Engineering Hong Kong University of Science and Technology Hong Kong Shenzhen Key Laboratory of Robotics Perception and Intelligence The Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

Safety-critical cyber-physical systems (CPS), such as quadrotor UAVs, are particularly prone to cyber attacks, which can result in significant consequences if not detected promptly and accurately. During outdoor operations, the nonlinear dynamics of UAV systems, combined with non-Gaussian noise, pose challenges to the effectiveness of conventional statistical and machine learning methods. To overcome these limitations, we present QUADFormer, an advanced attack detection framework for quadrotor UAVs leveraging a transformer-based architecture. This framework features a residue generator that produces sequences sensitive to anomalies, which are then analyzed by the transformer to capture statistical patterns for detection and classification. Furthermore, an alert mechanism ensures UAVs can operate safely even when under attack. Extensive simulations and experimental evaluations highlight that QUADFormer outperforms existing state-of-the-art techniques in detection accuracy. (Video1) Copyright © 2025, The Authors. All rights reserved.

关键词： Unmanned aerial vehicles (UAV)

Optimal Actuator Attacks on Autonomous Vehicles Using Reinforcement Learning

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wang, Pengyu Li, Jialu Shi, Ling Department of Electronic and Computer Engineering Hong Kong University of Science and Technology Hong Kong Shenzhen Key Laboratory of Robotics Perception and Intelligence The Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

With the increasing prevalence of autonomous vehicles (AVs), their vulnerability to various types of attacks has grown, presenting significant security challenges. In this paper, we propose a reinforcement learning (RL)-based approach for designing optimal stealthy integrity attacks on AV actuators. We also analyze the limitations of state-of-the-art RL-based secure controllers developed to counter such attacks. Through extensive simulation experiments, we demonstrate the effectiveness and efficiency of our proposed method. Copyright © 2025, The Authors. All rights reserved.

关键词： Adversarial machine learning

CardiacMamba: A Multimodal RGB-RF Fusion Framework with State Space Models for Remote Physiological Measurement

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wu, Zheng Xie, Yiping Zhao, Bo He, Jiguang Luo, Fei Deng, Ning Yu, Zitong School of Computing and Information Technology Great Bay University Dongguan523000 China Dongguan Key Laboratory for Intelligence and Information Technology Dongguan523000 China Computer Vision Institute School of Computer Science & Software Engineering Shenzhen University Shenzhen518060 China

Heart rate (HR) estimation via remote photoplethysmography (rPPG) offers a non-invasive solution for health monitoring. However, traditional single-modality approaches (RGB or Radio Frequency (RF)) face challenges in balancing robustness and accuracy due to lighting variations, motion artifacts, and skin tone bias. In this paper, we propose CardiacMamba, a multimodal RGB-RF fusion framework that leverages the complementary strengths of both modalities. It introduces the Temporal Difference Mamba Module (TDMM) to capture dynamic changes in RF signals using timing differences between frames, enhancing the extraction of local and global features. Additionally, CardiacMamba employs a Bidirectional SSM for cross-modal alignment and a Channel-wise Fast Fourier Transform (CFFT) to effectively capture and refine the frequency domain characteristics of RGB and RF signals, ultimately improving heart rate estimation accuracy and periodicity detection. Extensive experiments on the EquiPleth dataset demonstrate state-of-the-art performance, achieving marked improvements in accuracy and robustness. CardiacMamba significantly mitigates skin tone bias, reducing performance disparities across demographic groups, and maintains resilience under missing-modality scenarios. By addressing critical challenges in fairness, adaptability, and precision, the framework advances rPPG technology toward reliable real-world deployment in healthcare. The codes are available at: https://***/WuZheng42/CardiacMamba. Copyright © 2025, The Authors. All rights reserved.

关键词： Fast Fourier transforms

Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transforms

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Liu, Jingjing Wang, Zhiyong Fan, Xinyu Dadashzadeh, Amirhossein Liu, Honghai Mirmehdi, Majid School of Computer Science University of Bristol United Kingdom State Key Laboratory of Robotics and Systems Harbin Institute of Technology Shenzhen China School of Aerospace Engineering Xiamen University China

Existing 3D human pose estimation methods often suffer in performance, when applied to cross-scenario inference, due to domain shifts in characteristics such as camera viewpoint, position, posture, and body size. Among these factors, camera viewpoints and locations have been shown to contribute significantly to the domain gap by influencing the global positions of human poses. To address this, we propose a novel framework that explicitly conducts global transformations between pose positions in the camera coordinate systems of source and target domains. We start with a Pseudo-Label Generation Module that is applied to the 2D poses of the target dataset to generate pseudo-3D poses. Then, a Global Transformation Module leverages a human-centered coordinate system as a novel bridging mechanism to seamlessly align the positional orientations of poses across disparate domains, ensuring consistent spatial referencing. To further enhance generalization, a Pose Augmentor is incorporated to address variations in human posture and body size. This process is iterative, allowing refined pseudo-labels to progressively improve guidance for domain adaptation. Our method is evaluated on various cross-dataset benchmarks, including Human3.6M, MPI-INF-3DHP, and 3DPW. The proposed method outperforms state-of-the-art approaches and even outperforms the target-trained model. Copyright © 2025, The Authors. All rights reserved.

关键词： Three dimensional computer graphics

GNN-Assisted BiG-AMP: Joint Channel Estimation and Data Detection for Massive MIMO Receiver

学校读者我要写书评

暂无评论

IEEE Transactions on Wireless Communications 2025年

作者： Liu, Zishen Wu, Nan He, Dongxuan Yuan, Weijie Li, Yonghui Quek, Tony Q. S. School of Information and Electronics Beijing Institute of Technology Beijing100081 China School of System Design and Intelligent Manufacturing Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen518055 China School of Electrical and Information Engineering The University of Sydney SydneyNSW2008 Australia Singapore University of Technology and Design 487372 Singapore Department of Electronic Engineering Kyung Hee University Yongin17104 Korea Republic of

In this paper, we develop a graph neural network (GNN)-assisted bilinear inference approach to enhance the receiver performance of the MIMO system through message passing-based joint channel estimation and data detection (JCD). Specifically, based on the bilinear generalized approximate message passing (BiG-AMP) framework and conditional correlation of signal, we propose a GNN-assisted BiG-AMP (GNN-BiGAMP) approach, which integrates a GNN module into the data-detection-loop to compensate the inaccurate marginal likelihood approximation. By leveraging the coupling between the channel and received symbols, a bilinear GNN-assisted BiG-AMP (BiGNN-BiGAMP) JCD receiver is further proposed. This method incorporates two GNNs with similar graph representation into the bilinear posterior estimation loops, which not only compensates for approximation errors but also alleviates performance loss due to premature variance convergence, thereby enhancing the receiver performance significantly. To fully exploit the supervised information from channel estimation and data detection, we propose a multitask learning based training scheme, which coordinates GNNs with different tasks in two loops. Simulation results show that our proposed GNN-assisted JCD receivers significantly outperform other JCD counterparts in terms of both channel estimation and data detection. © 2025 IEEE. All rights reserved.

关键词： Graph neural networks

High-Fidelity Editable Portrait Synthesis with 3D GAN Inversion

学校读者我要写书评

暂无评论

High-Fidelity Editable Portrait Synthesis with 3D GAN Invers...

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Jindong Xie Jiachen Liu Yupei Lin Jinbao Wang Xianxu Hou Linlin Shen Computer Vision Institute School of Computer Science and Software Engineering Shenzhen University National Engineering Laboratory for Big Data System Computing Technology Shenzhen University School of Information Engineering Guangdong University of Technology Guangzhou China Guangdong Provincial Key Laboratory of Intelligent Information Processing School of AI and Advanced Computing Xi’an Jiaotong-Liverpool University

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

The 3D generative adversarial network (GAN) inversion converts an image into 3D representation to attain high-fidelity reconstruction and facilitate realistic image manipulation within the 3D latent space. However, previous approaches face challenges regarding the trade-off between the reconstruction ability and editability. That is, reversing a real-world image to a low-dimensional latent code would inevitably lead to information loss, and achieving a near-perfect reconstruction using high-rate triplane representation often limits the ability to manipulate the image freely in the latent space. To address these issues, we propose a novel latent conditioning encoder-based framework with the alignment between the low-dimensional latent and high-dimensional triplane. A non-semantic guided editing strategy bridges the intrinsic relation between the latent condition and triplane generation, making it possible to edit the high-dimensional representation by latent manipulation. As a result, our method can achieve high-fidelity reconstruction and editing simultaneously by directly controlling the latent code. Experimental results demonstrate that our approach excels in reconstruction and editing quality compared to previous 3D inversion methods. Furthermore, our method can also edit even real faces with large poses and out-of-domain cases.

关键词： Bridges Three-dimensional displays Codes Signal processing Generative adversarial networks Vectors Acoustics Speech processing Image reconstruction Faces