检索结果-内蒙古大学图书馆

2025 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2025

作者： Zheng, Yuanming Yao, Jiaxuan Deng, Xiangyu Yang, Yuhong Liao, Ruiqi Tu, Weiping Lin, Cedar National Engineering Research Center for Multimedia Software School of Computer Science Wuhan University Wuhan China Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan China Guangdong OPPO Mobile Telecommunications Corp. Guangdong China

ISBN: (纸本)9798350368741

Spatial audio quality evaluation is essential for applications like virtual and augmented reality, where accurate sound reproduction enhances user immersion. While subjective listening tests are the gold standard, they are costly and time-consuming. To address this, we propose HAPG-SAQAM, an objective metric for assessing timbre quality, spatial quality, and overall quality of binaural audio, guided by human auditory perception. Our contributions include: (1) the Multi-scale Auditory Guided Feature Extraction (MAGFE) module, incorporating gammatone frequency cepstral coefficients for better alignment with human perception;(2) Perceptual Weighted Loss (PWL), optimizing the weighting of timbre quality (TQ) and spatial quality (SQ) loss based on subjective test data;and (3) data augmentation techniques to enhance robustness by amplifying perceptual distortions. Experimental results show HAPG-SAQAM improves correlation with subjective scores by 10%, with ablation studies confirming the contributions of its components to enhanced spatial and overall audio quality. © 2025 IEEE.

关键词： auditory perception spatial audio Speech and audio quality assessment subjective experiment timbre quality

来源：评论

学校读者我要写书评

暂无评论

AMTrans:Auto-Correlation Multi-Head Attention Transformer for Infrared Spectral Deconvolution

引用

清华大学学报自然科学版（英文版） 2025年第3期30卷 1329-1341页

作者： Lei Gao Liyuan Cui Shuwen Chen Lizhen Deng Xiaokang Wang Xiaohong Yan Hu Zhu College of Electronic and Optical Engineering & College of Flexible Electronics(Future Technology) Nanjing University of Posts and TelecommunicationsNanjing 210003China Jiangsu Province Key Lab on Image Processing and Image Communication Nanjing University of Posts and TelecommunicationsNanjing 210003China National Engineering Research Center of Communication and Network Technology Nanjing University of Posts and TelecommunicationsNanjing 210003China School of Computer Science and Technology Hainan UniversityHaikou 570228China

Infrared spectroscopy analysis has found widespread applications in various fields due to advancements in technology and industry *** improve the quality and reliability of infrared spectroscopy signals,deconvolution is a crucial preprocessing *** by the transformer model,we propose an Auto-correlation Multi-head attention Transformer(AMTrans)for infrared spectrum sequence *** auto-correlation attention model improves the scaled dot-product attention in the *** utilizes attention mechanism for feature extraction and implements attention computation using the auto-correlation *** auto-correlation attention model is used to exploit the inherent sequence nature of spectral data and to effectively recovery spectra by capturing auto-correlation patterns in the *** proposed model is trained using supervised learning and demonstrates promising results in infrared spectroscopic *** comparing the experiments with other deconvolution techniques,the experimental results show that the method has excellent deconvolution performance and can effectively recover the texture details of the infrared spectrum.

关键词： spectroscopy spectral deconvolution transformer auto-correlation mechanism

来源：评论

学校读者我要写书评

暂无评论

communication-Efficient Distributed Learning in Massive IoT: A Graph-Based Perspective

Communication-Efficient Distributed Learning in Massive IoT:...

引用

IEEE Conference on Wireless communications and networking

作者： Lindong Zhao Jingyue Tang Mingzhe Chen Liang Zhou Weihua Zhuang Key Lab of Broadband Wireless Communication and Sensor Network Technology Ministry of Education Nanjing University of Posts and Telecommunications Nanjing China Department of Electrical and Computer Engineering University of Waterloo Waterloo Canada

ISBN: (数字)9798350368369

ISBN: (纸本)9798350368376

Various distributed learning approaches emerge for enabling ubiquitous intelligence in Internet of Things (IoT) without sacrificing data privacy. To improve communication efficiency in frequent knowledge exchange over resource-constrained IoT, different techniques for client selection have been proposed. However, the intractable scalability issues remain to be addressed in massive IoT, since highly-coupled co-channel interference adds exponential complexity to combinatorial client selection. In this work, we develop a client selection framework highly-scalable to large-scale networks with thousands of devices, which exploits the inherent graph structure derived from knowledge exchange and co-channel interference. Specifically, we first model a client selection problem for jointly optimizing learning performance and system cost under volatile network conditions. The formulated problem is encoded into a node classification problem by a directed graph. Subsequently, a general yet simple solver is designed based on graph neural networks, which selects clients by classifying node status with recursive neighborhood aggregation of node representations. Finally, extensive experimental results demonstrate that the proposed approach can perform on par with state-of-the-art methods, while scaling to networks whose size is orders of magnitude larger than they can handle.

关键词： Performance evaluation Knowledge engineering computer aided instruction Costs Distance learning Scalability Graph neural networks Data models Internet of Things Interchannel interference

来源：评论

学校读者我要写书评

暂无评论

HAPG-SAQAM: Human Auditory Perception Guided Spatial Audio Quality Assessment Metric

HAPG-SAQAM: Human Auditory Perception Guided Spatial Audio Q...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Yuanming Zheng Jiaxuan Yao Xiangyu Deng Yuhong Yang Ruiqi Liao Weiping Tu Cedar Lin National Engineering Research Center for Multimedia Software School of Computer Science Wuhan University Wuhan China Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan China Guangdong OPPO Mobile Telecommunications Corp. China

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Spatial audio quality evaluation is essential for applications like virtual and augmented reality, where accurate sound reproduction enhances user immersion. While subjective listening tests are the gold standard, they are costly and time-consuming. To address this, we propose HAPG-SAQAM, an objective metric for assessing timbre quality, spatial quality, and overall quality of binaural audio, guided by human auditory perception. Our contributions include: (1) the Multi-scale Auditory Guided Feature Extraction (MAGFE) module, incorporating gammatone frequency cepstral coefficients for better alignment with human perception; (2) Perceptual Weighted Loss (PWL), optimizing the weighting of timbre quality (TQ) and spatial quality (SQ) loss based on subjective test data; and (3) data augmentation techniques to enhance robustness by amplifying perceptual distortions. Experimental results show HAPG-SAQAM improves correlation with subjective scores by 10%, with ablation studies confirming the contributions of its components to enhanced spatial and overall audio quality.

关键词： Measurement Accuracy Spatial audio Performance gain Feature extraction Robustness Quality assessment Timbre Speech processing Optimization

来源：评论

学校读者我要写书评

暂无评论

Cross-Modal Haptic Generation for Emergency Rescue in Internet of Robotic Things

引用

IEEE Internet of Things Journal 2025年

作者： Liu, Hengfa Wei, Xin Gao, Yun Zhou, Liang Qian, Yi Nanjing University of Posts and Telecommunications School of Communications and Information Engineering Key Lab of Broadband Wireless Communication and Sensor Network Technology Ministry of Education Nanjing210003 China University of Nebraska-Lincoln Department of Electrical and Computer Engineering OmahaNE68588 United States

Robots equipped with multi-modal sensing capabilities play an important role in the Internet of Robotic Things (IoRT), especially in emergency rescue. However, existing rescue robots pose challenges for human operators in achieving precise manipulation due to the absence of haptic signals. Additionally, limited and fluctuating bandwidth in emergency rescue renders current cross-modal haptic generation schemes ineffective. To overcome this dilemma, we propose a novel cross-modal haptic generation scheme that enhances scalability across diverse network conditions by leveraging correlations among audio-visual-haptic modalities. Specifically, we first propose an edge-device collaboration-based architecture that dynamically extracts semantics from audio-visual signals, tailored to the current network conditions, for haptic generation. This is achieved by predicting the network state at the edge and performing multi-modal encoding and fusion at the device. Next, we design a scalable cross-modal haptic generation scheme that implements the optimal generation strategy based on received audio-visual semantics of different granularities, ensuring real-time acquisition of coarse-grained or fine-grained haptic feedback. Finally, numerical experimental results conducted on a multi-modal dataset and a simulated emergency environment indicate that the proposed scheme reliably generates haptic signals in emergency rescue. © 2025 IEEE.

关键词： Robots

来源：评论

学校读者我要写书评

暂无评论

Brain-Conditional Multimodal Synthesis: A Survey and Taxonomy

IEEE Transactions on Artificial Intelligence

引用

IEEE Transactions on Artificial Intelligence 2025年第5期6卷 1080-1099页

作者： Mai, Weijian Zhang, Jian Fang, Pengfei Zhang, Zhijun South China University of Technology School of Automation Science and Engineering Guangzhou510640 China Southeast University School of Computer Science and Engineering Nanjing210096 China South China University of Technology Key Library of Autonomous Systems and Network Control Ministry of Education The School of Automation Science and Engineering Guangzhou510640 China Institute for Super Robotics Huangpu Guangzhou510555 China Nanchang University Jiangxi Thousand Talents Plan Nanchang330031 China Jishou University College of Computer Science and Engineering Jishou416000 China Guangdong Artificial Intelligence and Digital Economy Laboratory Pazhou Lab Guangzhou510335 China Shaanxi University of Technology Shaanxi Provincial Key Laboratory of Industrial Automation School of Mechanical Engineering Hanzhong723001 China Changsha Normal University School of Information Science and Engineering Changsha410100 China Guangdong University of Petrochemical Technology School of Automation Science and Engineering Institute of Artificial Intelligence and Automation Maoming525000 China

In the era of artificial intelligence generated content (AIGC), conditional multimodal synthesis technologies (e.g., text-to-image) are dynamically reshaping the natural content. Brain signals, serving as potential reflections of how the brain interprets external information, exhibit a distinctive one-to-many correspondence with various external modalities. This correspondence makes brain signals emerge as a promising guiding condition for multimodal synthesis (e.g., image, text, and audio), which is crucial for developing practical brain–computer interface systems and unraveling complex mechanisms underlying human perception. This survey comprehensively examines the emerging field of brain-conditional multimodal synthesis, termed AIGC-brain, to delineate the current landscape and future directions. To begin, related neuroimaging datasets and generative models are introduced as the foundation of AIGC-brain decoding and analysis. Next, we present a comprehensive taxonomy according to AIGC-brain methodologies, followed by task-specific representative work and implementation details to facilitate in-depth comparison and analysis. Quality assessments are then introduced for both qualitative and quantitative evaluation. Finally, this survey explores insights gained, outlining current challenges and prospects of AIGC-brain. As a pioneering survey, this article paves the way for future advances in AIGC-brain research. © 2020 IEEE.

关键词： Taxonomies

来源：评论

学校读者我要写书评

暂无评论

Semantic-Aware Pseudo-labeling for Unsupervised Meta-Learning

引用

IEEE Transactions on Pattern Analysis and Machine Intelligence 2025年 PP卷 PP页

作者： Ouyang, Tianran Dong, Xingping Ye, Mang Du, Bo Shao, Ling Shen, Jianbing Wuhan University School of Computer Science National Engineering Research Center for Multimedia Software Institute of Artificial Intelligence Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan430072 China University of Chinese Academy of Sciences UCAS-Terminus AI Lab Beijing China University of Macau State Key Laboratory of Internet of Things for Smart City Department of Computer and Information Science China

In unsupervised meta-learning, the clustering-based pseudo-labeling approach is an attractive framework, since it is model-agnostic, allowing it to synergize with supervised algorithms to learn from unlabeled data. However, the pseudo-labels suffer from clustering noise and semantic chaos problems, further impacting the effectiveness of meta-learning. In this paper, we analyze and optimize the pseudo-labeling process, including encoding and clustering, aiming to generate semantic- like pseudo-labels to narrow the gap between unsupervised and supervised meta-learning. Firstly, during the encoding, we observe that the embedding space of existing methods lacks clustering-friendly properties, which is the primary reason for clustering noise. To address this issue, we minimize the inter-to-intra-class similarity ratio to generate clustering-friendly embedding features and validate our approach through comprehensive experiments. Then, during the clustering, we find that the semantic quality of pseudo-labels is not adequately controlled, resulting in semantic chaos of pseudo-labels. We propose a semantic-stability index to measure the semantic quality of pseudo-labels quantitatively. Based on this index, we propose the Semantic-aware Pseudo-label Reassignment mechanism to generate semantic- like pseudo-labels for all samples. Our approach is model-agnostic and can easily be integrated into existing supervised methods. To demonstrate its generalization ability, we integrate it into two representative algorithms: MAML and EP. The results on three main few-shot benchmarks clearly show that the proposed method achieves significant improvement compared to state-of-the-art models. Notably, our approach also outperforms the corresponding supervised method in three tasks. The source code will be made publicly available. ©1979-2012 IEEE.

关键词： Latent semantic analysis

来源：评论

学校读者我要写书评

暂无评论

ScanDTM: A Novel Dual-Temporal Modulation Scanpath Prediction Model for Omnidirectional Images

引用

IEEE Transactions on Circuits and Systems for Video Technology 2025年

作者： Zhu, Dandan Zhang, Kaiwei Min, Xiongkuo Zhai, Guangtao Yang, Xiaokang East China Normal University School of Computer Science and Technology Shanghai200333 China Shanghai Jiao Tong University Institute of Image Communication and Network Engineering Shanghai200240 China Shanghai Jiao Tong University MoE Key Lab of Artificial Intelligence AI Institute Shanghai200240 China

Scanpath prediction for omnidirectional images aims to effectively simulate the human visual perception mechanism to generate dynamic realistic fixation trajectories. However, the majority of scanpath prediction methods for omnidirectional images are still in their infancy as they fail to accurately capture the time-dependency of viewing behavior and suffer from sub-optimal performance along with limited generalization capability. A desirable solution should achieve a better trade-off between prediction performance and generalization ability. To this end, we propose a novel dual-temporal modulation scanpath prediction (ScanDTM) model for omnidirectional images. Such a model is designed to effectively capture long-range time-dependencies between various fixation regions across both internal and external time dimensions, thereby generating more realistic scanpaths. In particular, we design a Dual Graph Convolutional network (Dual-GCN) module comprising a semantic-level GCN and an image-level GCN. This module servers as a robust visual encoder that captures spatial relationships among various object regions within an image and fully utilizes similar images as complementary information to capture similarity relations across relevant images. Notably, the proposed Dual-GCN focuses on modeling temporal correlations from both local and global perspectives within the internal time dimension. Furthermore, drawing inspiration from the promising generalization capabilities of diffusion models across various generative tasks, we introduce a novel diffusion-guided saliency module. This module formulates the prediction issue as a conditional generative process for the saliency map, utilizing extracted semantic-level and image-level visual features as conditions. With the well-designed diffusion-guided saliency module, our proposed ScanDTM model acting as an external temporal modulator, we can progressively refine the generated scanpath from the noisy map. We conduct extensive expe

关键词： Prediction models

来源：评论

学校读者我要写书评

暂无评论

A rejection sampling algorithm for off-centered discrete Gaussian distributions over the integers

引用

Science China(Information Sciences) 2019年第3期62卷 196-198页

作者： Yusong DU Baodian WEI Huang ZHANG School of Data and Computer Science Sun Yat-sen University Guangdong Key Laboratory of Information Security Technology Chongqing Key Lab of Computer Network and Communication Technology

Dear editor,Discrete Gaussian sampling, that is, sampling from a discrete Gaussian distribution DΛ,σ,cwith parameter σ> 0 and center c∈R~n over an ndimensional lattice Λ, has been considered by the cryptography research community as one of the fundamental building blocks of lattice-based cryptography [1, 2]. The simplest lattice is the one-

关键词： A rejection sampling algorithm for off-centered discrete Gaussian distributions over the integers

来源：评论

学校读者我要写书评

暂无评论

UniUIR: Considering Underwater Image Restoration as An All-in-One Learner

arXiv

引用

arXiv 2025年

作者： Zhang, Xu Zhang, Huan Wang, Guoli Zhang, Qian Zhang, Lefei Du, Bo The Institute of Artificial Intelligence School of Computer Science Wuhan University Wuhan430072 China The Hubei Luojia Laboratory Wuhan China The National Engineering Research Center for Multimedia Software Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan University Wuhan430072 China The School of Information Engineering Guangdong University of Technology Guangzhou510006 China The Horizon Robotics Beijing100083 China

Existing underwater image restoration (UIR) methods generally only handle color distortion or jointly address color and haze issues, but they often overlook the more complex degradations that can occur in underwater scenes. To address this limitation, we propose a Universal Underwater Image Restoration method, termed as UniUIR, considering the complex scenario of real-world underwater mixed distortions as an all-in-one manner. To decouple degradation-specific issues and explore the inter-correlations among various degradations in UIR task, we designed the Mamba Mixture-of-Experts module. This module enables each expert to identify distinct types of degradation and collaboratively extract task-specific priors while maintaining global feature representation based on linear complexity. Building upon this foundation, to enhance degradation representation and address the task conflicts that arise when handling multiple types of degradation, we introduce the spatial-frequency prior generator. This module extracts degradation prior information in both spatial and frequency domains, and adaptively selects the most appropriate task-specific prompts based on image content, thereby improving the accuracy of image restoration. Finally, to more effectively address complex, region-dependent distortions in UIR task, we incorporate depth information derived from a large-scale pre-trained depth prediction model, thereby enabling the network to perceive and leverage depth variations across different image regions to handle localized degradation. Extensive experiments demonstrate that UniUIR can produce more attractive results across qualitative and quantitative comparisons, and shows strong generalization than state-of-the-art methods. Copyright © 2025, The Authors. All rights reserved.

关键词： Image reconstruction

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：