Continuous emotion recognition is to predict emotion states through affective information and more focus on the continuous variation of emotion. Fusion of electroencephalography (EEG) and facial expressions videos has...
详细信息
Continuous emotion recognition is to predict emotion states through affective information and more focus on the continuous variation of emotion. Fusion of electroencephalography (EEG) and facial expressions videos has been used in this field, while there are with some limitations in current researches, such as hand-engineered features, simple approaches to integration. Hence, a new continuous emotion recognition model is proposed based on the fusion of EEG and facial expressions videos named residual multimodal Transformer (RMMT). Firstly, the Resnet50 and temporal convolutional network (TCN) are utilised to extract spatiotemporal features from videos, and the TCN is also applied to process the computed EEG frequency power to acquire spatiotemporal features of EEG. Then, a multimodal Transformer is used to fuse the spatiotemporal features from the two modalities. Furthermore, a residual connection is introduced to fuse shallow features with deep features which is verified to be effective for continuous emotion recognition through experiments. Inspired by knowledge distillation, the authors incorporate feature-level loss into the loss function to further enhance the network performance. Experimental results show that the RMMT reaches a superior performance over other methods for the MAHNOB-HCI dataset. Ablation studies on the residual connection and loss function in the RMMT demonstrate that both of them is functional.
As modern communication technology advances apace,the digital communication signals identification plays an important role in cognitive radio networks,the communication monitoring and management *** has become a promi...
详细信息
As modern communication technology advances apace,the digital communication signals identification plays an important role in cognitive radio networks,the communication monitoring and management *** has become a promising solution to this problem due to its powerful modeling capability,which has become a consensus in academia and ***,because of the data-dependence and inexplicability of AI models and the openness of electromagnetic space,the physical layer digital communication signals identification model is threatened by adversarial *** examples pose a common threat to AI models,where well-designed and slight perturbations added to input data can cause wrong ***,the security of AI models for the digital communication signals identification is the premise of its efficient and credible *** this paper,we first launch adversarial attacks on the end-to-end AI model for automatic modulation classifi-cation,and then we explain and present three defense mechanisms based on the adversarial *** we present more detailed adversarial indicators to evaluate attack and defense ***,a demonstration verification system is developed to show that the adversarial attack is a real threat to the digital communication signals identification model,which should be paid more attention in future research.
In order to improve the mental health level of college students, a data mining based mental health education strategy for college students is proposed. Firstly, analyse the characteristics of data mining and its poten...
详细信息
Interrupted Sampling Repeater Jamming (ISRJ) can produce several false targets through intermittent sampling and forwarding of the intercepted signals. The paper proposes an interference identification and suppression...
详细信息
The advancements in medical imaging techniques have brought exponential increase in the quantity and complexity of data which often require human expertise for interpretation and decision making. However, in real-worl...
详细信息
Graph neural network(GNN) is a promising method to analyze graphs. Most existing GNNs adopt the class-balanced assumption, which cannot deal with class-imbalanced graphs well. The oversampling technique is effective i...
详细信息
Graph neural network(GNN) is a promising method to analyze graphs. Most existing GNNs adopt the class-balanced assumption, which cannot deal with class-imbalanced graphs well. The oversampling technique is effective in alleviating class-imbalanced problems. However, most graph oversampling methods generate synthetic minority nodes and their edges after applying GNNs. They ignore the problem that the representations of the original and synthetic minority nodes are dominated by majority nodes caused by aggregating neighbor information through GNN before oversampling. In this paper, we propose a novel graph oversampling framework, termed distribution alignment-based oversampling for node classification in classimbalanced graphs(named Graph-DAO). Our framework generates synthetic minority nodes before GNN to avoid the dominance of majority nodes caused by message passing in GNNs. Additionally, we introduce a distribution alignment method based on the sum-product network to learn more information about minority nodes. To our best knowledge, it is the first to use the sum-product network to solve the class-imbalanced problem in node classification. A large number of experiments on four real datasets show that our method achieves the optimal results on the node classification task for class-imbalanced graphs.
This research paper presents a novel algorithmic approach for character recognition and contextual analysis of temple inscriptions, specifically focusing on Tamil ancient script. The methodology combines advanced prep...
详细信息
This research paper presents a novel algorithmic approach for character recognition and contextual analysis of temple inscriptions, specifically focusing on Tamil ancient script. The methodology combines advanced preprocessing techniques, deep learning models, and contextual analysis to address the challenges posed by noisy images, script variations, and historical context understanding. We compiled a dataset of 100 high-resolution images of temple inscriptions from various regions and periods. The preprocessing phase involves Noise Reduction, Contrast Enhancement, Orientation Correction, and Adaptive Binarization algorithms to enhance the quality of the inscription images. The character recognition stage employs Convolutional Neural Networks with Transfer Learning, further enhanced by the Multi-head Attention mechanism in Vision Transformers (ViT). The character segmentation algorithm used was the Stroke Width Transform. Transfer Learning was incorporated to adapt the pre-trained ViT model to our specific task. This approach significantly improves the model’s ability to recognize characters from diverse scripts and languages. The results demonstrate the effectiveness of the proposed methodology. The character recognition accuracy metrics include a precision of 97.25%, a recall of 95.05%, and an F1-score of 95.17%. Additionally, the model achieved a recognition rate of 98.92% for key terms related to historical events, deities, and rulers. It also demonstrated a 94% recognition rate for context-specific phrases and a 95% recognition rate for historical dates. Contextual analysis results indicate that the model successfully identifies specific terms, phrases, and historical references, contributing to a deeper understanding of the inscriptions. The model's ability to recognize characters from multiple scripts underscores its adaptability to diverse inscriptions. In conclusion, this research provides a comprehensive and efficient solution for character recognition and
作者:
Yin, YiyangYang, LiangHunan University
College of Computer Science and Electronic Engineering Changsha410082 China Jishou University
College of Computer Science and Electronic Engineering Hunan University School of Communication and Electronic Engineering China
This paper investigates the covert performance of an active reconfigurable intelligent surface (A-RIS)-assisted uplink non-orthogonal multiple access (NOMA) system with semi-grant-free (SGF) transmission in the presen...
详细信息
Integrated sensing and communication (ISAC) is a promising technique to increase spectral efficiency and support various emerging applications by sharing the spectrum and hardware between these functionalities. Howeve...
详细信息
Integrated sensing and communication (ISAC) is a promising technique to increase spectral efficiency and support various emerging applications by sharing the spectrum and hardware between these functionalities. However, the traditional ISAC schemes are highly dependent on the accurate mathematical model and suffer from the challenges of high complexity and poor performance in practical scenarios. Recently, artificial intelligence (AI) has emerged as a viable technique to address these issues due to its powerful learning capabilities, satisfactory generalization capability, fast inference speed, and high adaptability for dynamic environments, facilitating a system design shift from model-driven to data-driven. Intelligent ISAC, which integrates AI into ISAC, has been a hot topic that has attracted many researchers to investigate. In this paper, we provide a comprehensive overview of intelligent ISAC, including its motivation, typical applications, recent trends, and challenges. In particular, we first introduce the basic principle of ISAC, followed by its key techniques. Then, an overview of AI and a comparison between model-based and AI-based methods for ISAC are provided. Furthermore, the typical applications of AI in ISAC and the recent trends for AI-enabled ISAC are reviewed. Finally, the future research issues and challenges of intelligent ISAC are discussed.
This study illustrates a dual-band circular and pentagon antenna with dual-band configuration for the high return loss. When an antenna has a greater return loss, less power is reflected toward the transmitter, implyi...
详细信息
暂无评论