检索结果-内蒙古大学图书馆

Robust Imagined Speech Production from Electrocorticography with Adaptive Frequency Enhancement

学校读者我要写书评

暂无评论

Robust Imagined Speech Production from Electrocorticography ...

International Joint Conference on Neural Networks (IJCNN)

作者： Xu Xu Chong Fu Junxin Chen Gwanggil Jeon David Camacho School of Computer Science and Engineering Northeastern University Shenyang China School of Software Dalian University of Technology Dalian China Key Laboratory of Intelligent Computing in Medical Image Ministry of Education Northeastern University Shenyang China Engineering Research Center of Security Technology of Complex Network System Ministry of Education Shenyang China College of Information Technology Incheon National University Incheon Korea Department of Computer Systems Engineering Universidad Politécnica de Madrid Madrid Spain

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

Imagined speech production with electrocorticography (ECoG) plays a crucial role in brain-computer interface system. A challenging issue is the great variation underlying the frequency bands of the ECoG signals’ encode information, which makes current methods difficult to generate imagined speech with stable quality among different persons. To this end, we propose a robust model to generate high-quality imagined speech from ECoG. A frequency enhancement branch is first designed to adaptively modulate the frequency information, whose product is fed into the following multi-scale channel attention module for robust feature extraction and fusion. By incorporating both the mel-spectrum and audio as training constraints, a multi-constraint decoder branch is finally constructed for imagined speech production. The performance of our model is evaluated on a high-quality dateset, i.e, Single Word Production Dutch-iBIDS. It yields Pearson correlation scores that are all above 0.8, and the standard deviationsare are all below 0.2 in different volunteers. Experimental results demonstrate that our model is effective and robust for ECoG based imagined speech production, and has advantages over peer methods.

关键词： Training Adaptation models Frequency modulation Correlation Neuroscience Production Speech enhancement

Deformation And Penetration Hybrid Detection-Net For Parcels Inspection In Industrial Supply Chain

学校读者我要写书评

暂无评论

Deformation And Penetration Hybrid Detection-Net For Parcels...

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Zhi Chen Cuifeng Du Xiujie Huang Zelong Lin Yuyu Zhou Quanlong Guan Zhefu Li Shuanghuan Lv Xiaofeng Wu Xiaotian Zhuang College of Information Science and Technology Jinan University Guangzhou China Guangdong Institute of Smart Education Jinan University Guangzhou China Cetc Potevio Science&Technology Co. Ltd Guangzhou China Guangdong Key Laboratory of Data Security and Privacy Preserving Guangzhou China School of Intelligent Systems Science and Engineering Jinan University Zhuhai China Guangzhou Polytechnic of Sports Guangzhou China Beijing JD Zhenshi Information Technology Co. Ltd Beijing China

The express delivery industry has become integral to modern social life, but supply chain parcels, especially those made of corrugated cardboard, are at risk of damage during transportation. Although corrugated cardboard boxes offer some impact resistance, they can still experience deformation and penetration damage. To address this issue, we propose a hybrid model called Parcels-DNet. Parcels-DNet adopts a lightweight feature extraction backbone network, enabling deployment in resource-constrained scenarios like mobile or embedded devices. Additionally, our experimental results demonstrate that Parcels-DNet effectively captures the features of parcel deformation and penetration damage. This improves the safety and efficiency of express supply chain parcel transportation, offering greater convenience and economic benefits for the logistics industry.

关键词：

ANIMC: A soft approach for auto-weighted noisy and incomplete multi-view clustering

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Fang, Xiang Hu, Yuchong Zhou, Pan Wu, Dapeng Oliver Hubei Engineering Research Center on Big Data Security School of Cyber Science and Engineering Huazhong University of Science and Technology Wuhan430074 China School of Computer Science and Technology Huazhong University of Science and Technology Wuhan430074 China School of Computer Science and Technology Key Laboratory of Information Storage System Ministry of Education of China Huazhong University of Science and Technology Wuhan430074 China Department of Electrical and Computer Engineering University of Florida GainesvilleFL32611 United States

Multi-view clustering has wide real-world applications because it can process data from multiple sources. However, these data often contain missing instances and noises, which are ignored by most multi-view clustering methods. Missing instances may make these methods difficult to use directly, and noises will lead to unreliable clustering results. In this paper, we propose a novel Auto-weighted Noisy and Incomplete Multi-view Clustering approach (ANIMC) via a soft auto-weighted strategy and a doubly soft regular regression model. Firstly, by designing adaptive semi-regularized nonnegative matrix factorization (adaptive semi-RNMF), the soft auto-weighted strategy assigns a proper weight to each view and adds a soft boundary to balance the influence of noises and incompleteness. Secondly, by proposing θ-norm, the doubly soft regularized regression model adjusts the sparsity of our model by choosing different θ. Compared with previous methods, ANIMC has three unique advantages: 1) it is a soft algorithm to adjust our approach in different scenarios, thereby improving its generalization ability;2) it automatically learns a proper weight for each view, thereby reducing the influence of noises;3) it performs doubly soft regularized regression that aligns the same instances in different views, thereby decreasing the impact of missing instances. Extensive experimental results demonstrate its superior advantages over other state-of-the-art methods. Impact Statement-As an effective method to process data from multiple sources, multi-view clustering has attracted more and more attention. However, most previous works ignore missing instances and noises in original multi-view data, which limits the applications of these works. By a soft approach, our proposed ANIMC can effectively reduce the negative influence of missing instances and noises. Moreover, ANIMC outperforms the stateof- the-art works by about 20% in representative cases. With satisfactory performance on multiple rea

关键词： Regression analysis

Rate-Splitting for Cell-Free Massive MIMO: Performance Analysis and Generative AI Approach

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zheng, Jiakang Zhang, Jiayi Du, Hongyang Zhang, Ruichen Niyato, Dusit Dobre, Octavia A. Ai, Bo The School of Electronic and Information Engineering Beijing Jiaotong University Beijing100044 China The Frontiers Science Center for Smart High-speed Railway System Beijing Jiaotong University Beijing100044 China The Department of Electrical and Electronic Engineering University of Hong Kong Pok Fu Lam Hong Kong The College of Computing and Data Science Nanyang Technological University Singapore Faculty of Engineering and Applied Science Memorial University Canada The State Key Laboratory of Rail Traffic Control and Safety Beijing Jiaotong University Beijing100044 China The Frontiers Science Center for Smart High-speed Railway System China Henan Joint International Research Laboratory of Intelligent Networking and Data Analysis Zhengzhou University Zhengzhou450001 China Research Center of Networks and Communications Peng Cheng Laboratory Shenzhen China

Cell-free (CF) massive multiple-input multiple-output (MIMO) provides a ubiquitous coverage to user equipments (UEs) but it is also susceptible to interference. Rate-splitting (RS) effectively extracts data by decoding interference, yet its effectiveness is limited by the weakest UE. In this paper, we investigate an RS-based CF massive MIMO system, which combines strengths and mitigates weaknesses of both approaches. Considering imperfect channel state information (CSI) resulting from both pilot contamination and noise, we derive a closed-form expression for the sum spectral efficiency (SE) of the RS-based CF massive MIMO system under a spatially correlated Rician channel. Moreover, we propose low-complexity heuristic algorithms based on statistical CSI for power-splitting of common messages and power-control of private messages, and genetic algorithm is adopted as a solution for upper bound performance. Furthermore, we formulate a joint optimization problem, aiming to maximize the sum SE of the RS-based CF massive MIMO system by optimizing the power-splitting factor and power-control coefficient. Importantly, we improve a generative AI (GAI) algorithm to address this complex and non-convexity problem by using a diffusion model to obtain solutions. Simulation results demonstrate its effectiveness and practicality in mitigating interference, especially in dynamic environments. Copyright © 2024, The Authors. All rights reserved.

关键词： Genetic algorithms

PDEGAN: A Panoramic Style Transfer Based on Generative Adversarial Networks

学校读者我要写书评

暂无评论

Journal of Network Intelligence

Journal of Network Intelligence 2024年第4期9卷 2112-2121页

作者： Wang, Qinghua Long, Xinling Huang, Jingwei Chen, Yang Yang, Lirong Zhang, Fuquan College of Computer and Big Data Minjiang University Fuzhou350108 China Fuzhou Technology Innovation Center of intelligent Manufacturing information System Minjiang University Fuzhou350108 China Fujian Province University Fuzhou350300 China College of Computer and Control Engineering Minjiang University Fuzhou350108 China College of Computer and Big Data Fuzhou University Fuzhou China School of Mechanical and Automotive Engineering Fujian University of Technology Fuzhou China College of foreign languages Dalian Jiaotong University Dalian116028 China Digital Media Art Key Laboratory of Sichuan Province Sichuan Conservatory of Music Chengdu610021 China

Panoramic image plays an extremely important role in the application of 3D, but in some special scenarios, the depth information is also needed as an auxiliary, but to obtain the panoramic depth information needs a high cost, it is extremely difficult to obtain. Therefore, this paper proposes a panoramic depth estimation method called PDEGAN (Panoramic Depth Estimation Generative Adversarial Network). This method first enhances the style migration, transfers the input panoramic image to a style closer to the panoramic depth image domain, and then combines the conversion results with the original panoramic image as the input data for further depth estimation training. By using the style closer to the depth estimation, the texture, color and other characteristics of the image can be adjusted, so as to better highlight the depth information of the object in the image, so that the generator network is more focused on performing the image translation task, reduce the impact of style differences on the image translation task, and improve the generalization ability of the model. At the same time, the model will also use multi-scale feature fusion, combined with the attention mechanism, to better capture the depth information of different scales, viewing angles and channels. Not only that, but also by introducing depth gradient loss, surface normal loss to improve the accuracy and stability of depth estimation. To this end, we also made a set of related datasets for the related experiments of PDEGAN, and named it PDE Images. Finally, it is shown that the method proposed in this paper has more accurate estimation results than the traditional Pix2Pix image conversion model. © 2024, Taiwan Ubiquitous Information CO LTD. All rights reserved.

关键词： Generative adversarial networks

Hybrid RAG-empowered Multi-modal LLM for Secure data Management in Internet of Medical Things: A Diffusion-based Contract Approach

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Su, Cheng Wen, Jinbo Kang, Jiawen Wang, Yonghua Su, Yuanjia Pan, Hudan Zhong, Zishao Hossain, M. Shamim School of Automation The GuangdongHongKong-Macao Joint Laboratory for Smart Discrete Manufacturing Guangdong University of Technology Guangzhou510006 China College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics Nanjing210016 China School of Automation The Guangdong Basic Research Center of Excellence for Ecological Security and Green Development Key Laboratory for City Cluster Environmental Safety Green Development The Ministry of Education Guangdong University of Technology Guangzhou510006 China School of Automation The Key Laboratory of Intelligent Detection and IoT in Manufacturing Ministry of Education Guangdong University of Technology Guangzhou510006 China School of Automation Key Laboratory of Intelligent Information Processing and System Integration of IoT Ministry of Education Guangdong University of Technology Guangzhou510006 China Guangzhou University of Traditional Chinese Medicine State Key Laboratory of Traditional Chinese Medicine Syndrome The Second Affiliated Hospital of Guangzhou University of Chinese Medicine Chinese Medicine Guangdong Laboratory Hengqin 519000 China Second Affiliated Hospital of Guangzhou University of Chinese Medicine Chinese Medicine Guangdong Laboratory Hengqin 519000 China Department of Software Engineering College of Computer and Information Sciences King Saud University Riyadh12372 Saudi Arabia

Secure data management and effective data sharing have become paramount in the rapidly evolving healthcare landscape, especially with the growing integration of the Internet of Medical Things (IoMT). The rise of generative artificial intelligence has further elevated Multi-modal Large Language Models (MLLMs) as essential tools for managing and optimizing healthcare data in IoMT. MLLMs can support multi-modal inputs and generate diverse types of content by leveraging large-scale training on vast amounts of multi-modal data. However, critical challenges persist in developing medical MLLMs, including security and freshness issues of healthcare data, affecting the output quality of MLLMs. To this end, in this paper, we propose a hybrid Retrieval-Augmented Generation (RAG)-empowered medical MLLM framework for healthcare data management. This framework leverages a hierarchical cross-chain architecture to facilitate secure data training. Moreover, it enhances the output quality of MLLMs through hybrid RAG, which employs multi-modal metrics to filter various unimodal RAG results and incorporates these retrieval results as additional inputs to MLLMs. Additionally, we employ age of information to indirectly evaluate the data freshness impact of MLLMs and utilize contract theory to incentivize healthcare data holders to share their fresh data, mitigating information asymmetry during data sharing. Finally, we utilize a generative diffusion model-based deep reinforcement learning algorithm to identify the optimal contract for efficient data sharing. Numerical results demonstrate the effectiveness of the proposed schemes, which achieve secure and efficient healthcare data management. Copyright © 2024, The Authors. All rights reserved.

关键词： Information management

Low-Light Enhancement Effect on Classification and Detection: An Empirical Study

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wu, Xu Lai, Zhihui Jie, Zhou Gao, Can Hou, Xianxu Zhang, Ya-Nan Shen, Linlin The Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518060 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518060 China School of AI and Advanced Computing Xi’an Jiaotong-Liverpool University China The National Engineering Laboratory for Big Data System Computing Technology Shenzhen University SZU Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Shenzhen518060 China

Low-light images are commonly encountered in real-world scenarios, and numerous low-light image enhancement (LLIE) methods have been proposed to improve the visibility of these images. The primary goal of LLIE is to generate clearer images that are more visually pleasing to humans. However, the impact of LLIE methods in high-level vision tasks, such as image classification and object detection, which rely on high-quality image datasets, is not well explored. To explore the impact, we comprehensively evaluate LLIE methods on these high-level vision tasks by utilizing an empirical investigation comprising image classification and object detection experiments. The evaluation reveals a dichotomy: While Low-Light Image Enhancement (LLIE) methods enhance human visual interpretation, their effect on computer vision tasks is inconsistent and can sometimes be harmful. Our findings suggest a disconnect between image enhancement for human visual perception and for machine analysis, indicating a need for LLIE methods tailored to support high-level vision tasks effectively. This insight is crucial for the development of LLIE techniques that align with the needs of both human and machine vision. Copyright © 2024, The Authors. All rights reserved.

关键词： Machine vision

Local Partial Zero-Forcing Combining for Cell-Free Massive MIMO systems

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zhang, Jiayi Zhang, Jing Björnson, Emil Ai, Bo The School of Electronic and Information Engineering Beijing Jiaotong University Beijing100044 China The Frontiers Science Center for Smart High-Speed Railway System Beijing Jiaotong University Beijing100044 China The Department of Electrical Engineering Linköping University Linköping Sweden The Department of Computer Science KTH Royal Institute of Technology Kista Sweden The State Key Laboratory of Rail Traffic Control and Safety Beijing Jiaotong University Beijing100044 China The Frontiers Science Center for Smart High-Speed Railway System Henan Joint International Research Laboratory of Intelligent Networking and Data Analysis Zhengzhou University Zhengzhou450001 China Research Center of Networks and Communications Peng Cheng Laboratory Shenzhen China

Cell-free massive multiple-input multiple-output (MIMO) provides more uniform spectral efficiency (SE) for users (UEs) than cellular technology. The main challenge to achieve the benefits of cell-free massive MIMO is to realize signal processing in a scalable way. In this paper, we consider scalable full-pilot zero-forcing (FZF), partial FZF (PFZF), protective weak PFZF (PWPFZF), and local regularized ZF (LRZF) combining by exploiting channel statistics. We derive closed-form expressions of the uplink SE for FZF, PFZF, and PWPFZF combining with large-scale fading decoding over independent Rayleigh fading channels, taking channel estimation errors and pilot contamination into account. Moreover, we investigate the impact of the number of pilot sequences, antennas per AP, and APs on the performance. Numerical results show that LRZF provides the highest SE. However, PWPFZF is preferable when the number of pilot sequences is large and the number of antennas per AP is small. The reason is that PWPFZF has lower computational complexity and the SE expression can be computed in closed-form. Furthermore, we investigate the performance of PWPFZF combining with fractional power control and the numerical results show that it improves the performance of weak UEs and realizes uniformly good service for all UEs in a scalable fashion. Copyright © 2022, The Authors. All rights reserved.

关键词： Power control

Correlation-aware Cross-modal Attention Network for Fashion Compatibility Modeling in UGC systems

学校读者我要写书评

暂无评论

ACM Transactions on Multimedia Computing, Communications, and Applications 1000年

作者： Kai Cui Shenghao Liu Wei Feng Xianjun Deng Liangbin Gao Minmin Cheng Hongwei Lu Laurence T. Yang Hubei Key Laboratory of Distributed System Security Hubei Engineering Research Center on Big Data Security School of Cyber Science and Engineering Huazhong University of Science and Technology China China Nuclear Power Operation Technology Corporation Ltd. China

Empowered by the continuous integration of social multimedia and artificial intelligence, the application scenarios of information retrieval (IR) progressively tend to be diversified and personalized. Currently, User-Generated Content (UGC) systems have great potential to handle the interactions between large-scale users and massive media contents. As an emerging multimedia IR, Fashion Compatibility Modeling (FCM) aims to predict the matching degree of each given outfit and provide complementary item recommendation for user queries. Although existing studies attempt to explore the FCM task from a multimodal perspective with promising progress, they still fail to fully leverage the interactions between multimodal information or ignore the item-item contextual connectivities of intra-outfit. In this paper, a novel fashion compatibility modeling scheme is proposed based on Correlation-aware Cross-modal Attention Network. To better tackle these issues, our work mainly focuses on enhancing comprehensive multimodal representations of fashion items by integrating the cross-modal collaborative contents and uncovering the contextual correlations. Since the multimodal information of fashion items can deliver various semantic clues from multiple aspects, a modality-driven collaborative learning module is presented to explicitly model the interactions of modal consistency and complementarity via a co-attention mechanism. Considering the rich connections among numerous items in each outfit as contextual cues, a correlation-aware information aggregation module is further designed to adaptively capture significant intra-correlations of item-item for characterizing the content-aware outfit representations. Experiments conducted on two real-world fashion datasets demonstrate the superiority of our approach over state-of-the-art methods.

关键词： User-Generated Contents fashion intelligent analysis complementary compatibility modeling multimodal representation learning correlation-aware integration strategy