检索结果-内蒙古大学图书馆

International Joint Conference on Neural Networks (IJCNN)

作者： Qingao Wang Xingang Wang Jinxiao Yang Yurun Bi Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

Multimodal sentiment analysis(MSA) aims to synthesize multiple pieces of information, including textual, visual, and auditory information, to more accurately infer sentiment polarity. Due to the existence of complex and diverse affective causal relationships between different modalities, they interact with each other and constitute a multidimensional expression of human emotions. In the face of unbalanced data, i.e., when there are significant differences in the number of samples between different categories, the attention mechanism of the model tends to focus on spurious correlations in the training data, seriously impairing the model’s generalization ability and leading to bias, unbalanced prediction, and false correlation identification problems. To address the above problems, this study proposes a new multimodal fusion method based on the "within-sample sampling" and "cross-sample sampling" front door adjustment methods in causal inference strategies: the multi-head causal attention fusion method (MCAF). This method aims to capture potential causal relationships between different modalities through different attention heads, helping the model focus more on key causal features and avoid paying too much attention to false correlations in the training data. This helps improve the generalization performance of the model, make the decision-making process of the model more interpretable, and enhance the accuracy and robustness of the model for multimodal sentiment analysis tasks, making it more suitable for practical application scenarios.

关键词： Analytical models Sentiment analysis Visualization Correlation Neural networks Training data Predictive models

来源：评论

学校读者我要写书评

暂无评论

JTEA: Implementing Semi-Supervised Entity Alignment Using Joint Teaching Strategies

JTEA: Implementing Semi-Supervised Entity Alignment Using Jo...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Kai Lu Jing Zhao Lichao Ding Zenghao Hao Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Faculty of Computer Science and Technology Shandong Engineering Research Center of Big Data Applied Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

Entity alignment(EA) aims to identify equivalent entities in different knowledge graphs or data sources and establish correspondences between them. In recent years, embedding-based methods have made significant progress in the field of entity alignment, yet the shortage of adequate training data (i.e., seed entity pairs) continues to be a primary challenge. Traditional semi-supervised methods typically address this issue by generating potential mappings (i.e., pseudo-mappings) for unlabeled entities. However, these methods often suffer from the influence of erroneous potential mappings or overlook the uncertainty of potential mappings. Therefore, we propose a novel semi-supervised entity alignment method called JTEA. This method combines seed entity pairs with potential mappings through end-to-end joint training, providing strong guidance for model training. In constructing potential mappings, we propose a bidirectional matching strategy (BMS), which generates more detailed potential mappings by jointly adjusting decisions in different directions and uses a joint matching confidence score to characterize its uncertainty. Furthermore, we also introduce a method of matching diversity alignment selection, aiming to screen out more reliable entity alignments to further improve the performance and stability of the model. We conducted a large number of experiments on the benchmark dataset to fully validate the effectiveness of the JTEA method.

关键词： Training Uncertainty Soft sensors Noise Training data Knowledge graphs data models Stability analysis Reliability Thermal stability

来源：评论

学校读者我要写书评

暂无评论

Overcoming data Limitations and Cross-Modal Interaction Challenges in Medical Visual Question Answering

Overcoming Data Limitations and Cross-Modal Interaction Chal...

引用

International Joint Conference on Neural Networks (IJCNN)

作者： Yurun Bi Xingang Wang Qingao Wang Jinxiao Yang Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

Medical Visual Question Answering (Med-VQA) is a sophisticated multimodal technology within the medical domain that utilizes natural language processing and artificial intelligence techniques. It serves as a tool in the medical field to provide information and answers, aiming to correctly respond to medical questions related to specific professional medical images. The primary goal is to assist patients in understanding their physical condition and provide decision support for healthcare professionals. While Generalized Visual Question Answering has seen significant advancements, challenges persist in the medical domain. Firstly, medical data has inherent limitations, such as the scarcity of annotated medical datasets and the complexity of medical images (including factors like noise, artifacts, and low contrast). Secondly, in terms of cross-modal fusion, there exists an intricate relationship between medical images and textual information. The complexity of the relationship between medical images and medical text, as well as the incorporation of global contextual details, pose challenges. To address these issues, this paper proposes the Feature-Enhanced Network with Conditional Mixing. This innovative approach aims to overcome the scarcity and complexity of medical images without the need for additional datasets. Simultaneously, to tackle the challenge of cross-modal fusion and information interaction and to address the complex relationship between medical images and text, we propose the Cross-Adaptive Fusion Network. Experimental results conducted on the VQA-RAD dataset demonstrate noticeable improvements in accuracy compared to mainstream Med-VQA models.

关键词： Visualization Accuracy Noise Neural networks Medical services Question answering (information retrieval) data models

来源：评论

学校读者我要写书评

暂无评论

Opinion-Tree-guided Contrastive Learning for Aspect Sentiment Quadruple Prediction

Opinion-Tree-guided Contrastive Learning for Aspect Sentimen...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Zhijun Li Zhenyu Yang Yiwen Li Xiaoyang Li Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

In recent years, aspect sentiment quadruple prediction (ASQP) has become a popular task in the field of aspect-based sentiment analysis. When modeling comment statements, it is often necessary to consider structural information between sentiment labels. Existing approaches categorize these labels by encoding text and dependency tree structures separately and then incorporating their representations, but this approach fails to effectively capture the structural information between sentiment labels. To address this problem, we propose a method for ASQP called Opinion-Tree-guided Contrastive Learning (OTCL), which embeds structural information directly into the text instead of modeling it separately. Specifically, OTCL utilizes the opinion tree structure to guide the construction of positive samples of the input text during training. By associating the input text with its positive samples, the text encoder can learn to generate textual representations associated with the opinion tree structure. We validate the effectiveness of our method on two commonly used datasets.

关键词： Training Sentiment analysis Federated learning Contrastive learning Predictive models Encoding Task analysis

来源：评论

学校读者我要写书评

暂无评论

THE GEOMETRICAL-CONVEXITY OF A FUNCTION RELATED TO THE MINC-SATHRE RATIO

引用

UPB Scientific Bulletin, Series A: applied Mathematics and Physics 2024年第4期86卷 3-10页

作者： Mortici, Cristinel Postolache, Mihai Valahia University of Târgovişte Târgovişte Romania National University of Science & Technology Politehnica Bucharest Department of Mathematics and Informatics Bucharest060042 Romania Academy of Romanian Scientists 3 Ilfov Bucharest050044 Romania Gheorghe Mihoc-Caius Iacob Institute of Mathematical Statistics and Applied Mathematics of the Romanian Academy Bucharest050711 Romania The Key Laboratory of Intelligent Information and Big Data Processing of NingXia Province and Health Big Data Research Institute North Minzu University Yinchuan750021 China

In this paper we give a new proof for the fact that the function Γ (x)1 x−1 is geometrically convex. As an application, we give an improvement of Minc-Sathre inequality. © 2024, Politechnica University of Buchar... 详细信息

关键词： Choquet integral

来源：评论

学校读者我要写书评

暂无评论

A Systematic Review for Transformer-based Long-term Series Forecasting

arXiv

引用

arXiv 2023年

作者： Su, Liyilei Zuo, Xumin Li, Rui Wang, Xin Zhao, Heng Huang, Bingding College of Applied Sciences Shenzhen University Shenzhen518060 China Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging National-Regional Key Technology Engineering Laboratory for Medical Ultrasound School of Biomedical Engineering Shenzhen University Medical School Shenzhen518060 China College of Big Data and Internet Shenzhen Technology University Shenzhen518188 China

The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the most successful solution to extract the semantic correlations among the elements within a long sequence. Various variants have enabled transformer architecture to effectively handle long-term time series forecasting (LTSF) tasks. In this article, we first present a comprehensive overview of transformer architectures and their subsequent enhancements developed to address various LTSF tasks. Then, we summarize the publicly available LTSF datasets and relevant evaluation metrics. Furthermore, we provide valuable insights into the best practices and techniques for effectively training transformers in the context of time-series analysis. Lastly, we propose potential research directions in this rapidly evolving field. © 2023, CC BY.

关键词： Time series analysis

来源：评论

学校读者我要写书评

暂无评论

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models

arXiv

引用

arXiv 2023年

作者： Li, Ziniu Xu, Tian Zhang, Yushun Lin, Zhihang Yu, Yang Sun, Ruoyu Luo, Zhi-Quan School of Data Science The Chinese University of Hong Kong Shenzhen China Shenzhen Research Institute of Big Data China National Key Laboratory for Novel Software Technology Nanjing University China Polixir.ai China China Shenzhen International Center For Industrial and Applied Mathematics China

Reinforcement Learning from Human Feedback (RLHF) is key to aligning Large Language Models (LLMs), typically paired with the Proximal Policy Optimization (PPO) algorithm. While PPO is a powerful method designed for general reinforcement learning tasks, it is overly sophisticated for LLMs, leading to laborious hyper-parameter tuning and significant computation burdens. To make RLHF efficient, we present ReMax, which leverages 3 properties of RLHF: fast simulation, deterministic transitions, and trajectory-level rewards. These properties are not exploited in PPO, making it less suitable for RLHF. Building on the renowned REINFORCE algorithm, ReMax does not require training an additional value model as in PPO and is further enhanced with a new variance reduction technique. ReMax offers several benefits over PPO: it is simpler to implement, eliminates more than 4 hyper-parameters in PPO, reduces GPU memory usage, and shortens training time. ReMax can save about 46% GPU memory than PPO when training a 7B model and enables training on A800-80GB GPUs without the memory-saving offloading technique needed by PPO. Applying ReMax to a Mistral-7B model resulted in a 94.78% win rate on the AlpacaEval leaderboard and a 7.739 score on MT-bench, setting a new SOTA for open-source 7B models. These results show the effectiveness of ReMax while addressing the limitations of PPO in LLMs. © 2023, CC BY-NC-ND.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

CSLP: Collaborative Solution to Long-Tail Problem and Popularity Bias in Sequential Recommendation

CSLP: Collaborative Solution to Long-Tail Problem and Popula...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Yan Huang Zhenyu Yang Wenyue Hu Baojie Xu Zhibo Zhang The Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center (National Supercomputer Center in Jinan) Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

Sequential Recommender Systems (SRS), leveraging the temporal information from users' behaviors, have noticeably improved user experience against traditional systems. However, these behaviors often follow long-tail distribution, making the systems biased towards popular items (i.e., popularity bias). Moreover, popularity bias would amplify the neglect of long-tail recommendations, thereby sharpening the long-tail problem. Previous researches usually address these challenges independently, focusing on reducing the over-recommendation of popular items or enhancing the representation quality of tail items. Indeed, it is possible to incorporate their merits to achieve the best of both worlds. Thus, we propose a novel and unified framework, named Collaborative Solution to Long tailed problem and Popularity bias (CSLP), to tackle both the long-tail problem and popularity bias simultaneously. To achieve this, we first introduce a representation enhancement module featuring dual generators to enhance user and item representations, particularly for those in the tail. On the other hand, a debiasing module incorporating an Inverse Propensity Score (IPS) with a clipping strategy is introduced to further alleviate the popularity bias. Specifically, this clipping strategy demonstrates a clear decrease in the original IPS method's variance, effectively improving the recommendation for stability and accuracy. Experiments on three widely-used datasets show CSLP's effectiveness in solving both issues. CSLP surpasses all baselines (traditional, popularity bias, and long-tail problem) in overall performance, significantly enhancing recommendation accuracy for both tail users and items, and achieving a more balanced ratio of recommendations between popular and tail items. Code is available at https://***/Echohuangyan/CSLP.

关键词： Hands Heavily-tailed distribution Accuracy Collaboration Tail Linear programming Generators User experience IP networks Recommender systems

来源：评论

学校读者我要写书评

暂无评论

Multi-Label Text Classification for Judicial Texts via Dual Graph and Label Feature Fusion

Multi-Label Text Classification for Judicial Texts via Dual ...

引用

Smart World Congress (SWC), IEEE

作者： Qiliang Gu Qin Lu Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Industrial Network and Information System Security Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9798331520861

ISBN: (纸本)9798331520878

The legal judgement prediction (LJP) of judicial texts represents a multi-label text classification (MLTC) problem, which in turn involves three distinct tasks: the prediction of charges, legal articles, and terms of penalty. Nevertheless, extant multi-label text classification models tend to eschew the consideration of multiple correlations and semantic information between labels when predicting judicial texts, which may result in the loss of pertinent information. Furthermore, these models do not take full advantage of the local and overall information of the labels in the process of selecting appropriate labels for the text using the multi-head attention mechanism. To address these issues, we propose a new model, BGFLFF, which explores label correlation and semantics among the three tasks by employing Graph Convolutional Network (GCN) and multi-head attention mechanisms. In particular, we propose a Bi-Graph Fusion GCN (BGF-GCN), which fuses the co-occurrence matrix of labels with the cosine similarity matrix, thereby fully exploiting the multiple correlations between labels. Furthermore, prior to embedding the tags, the interpretations of the labels are obtained via Google in order to enhance the semantic information between the labels. To further reinforce the interconnections between labels and text and more effectively comprehend the interrelationships between the three tasks, we propose a Multi-Head Label Feature Fusion Attentional Mechanism (MH-LFFAtt), which assigns distinct weights to the pertinent label information in the text by fusing the local and overall features of the labels. The experimental results demonstrate that the F1 score exhibits an improvement of up to ${2. 2 8 \%}$ and a minimum of ${1. 2 9 \%}$ across the various tasks of the two datasets. This evidence substantiates the assertion that BGFLFF outperforms the existing baseline model.

关键词： Attention mechanisms Correlation Law Graph convolutional networks Fuses Text categorization Semantics Predictive models Multitasking Internet

来源：评论

学校读者我要写书评

暂无评论

Disentangling Interest and Conformity Representation to Mitigate Popularity Bias for Sequential Recommendation

Disentangling Interest and Conformity Representation to Miti...

引用

International Joint Conference on Neural Networks (IJCNN)

作者： Wenyue Hu Zhenyu Yang Yan Huang Zhibo Zhang Baojie Xu Key Laboratory of Computing Power Network and Information Security Ministry of EducationShandong Computer Science Center (National Supercomputer Center in Jinan) Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

The objective of sequential recommendation is to predict user preferences for items based on historical interaction sequences. This process often leads to a phenomenon known as popularity bias, where popular items are excessively recommended. Conformity, the tendency of users to follow popular items, is a significant factor contributing to this issue. Previous methods have not adequately disentangled conformity and interest, failing to accurately model users’ true intent. To address this, we propose a novel Disentangled Interest and Conformity Sequential Recommendation method (DICSRec) to mitigate the popularity bias. Specifically, we first design an Intent Encoding Module (IEM), which includes two independent encoders for conformity and interest to model their representations. To better disentangle these two factors, we design a disentangling task with proxy-based self-supervised learning and orthogonal regularization. Furthermore, to provide the Intent Encoding Module with more global information, we design a Global Conformity-aware Module (GCM), which supplies item popularity information and aids in enhancing user conformity representation. Lastly, recognizing the varying significance of user conformity and interest, we propose an adaptive Fusion Prediction Module (FPM) that adaptively aggregates user conformity and interest representations for final prediction. Experiments on four real-world datasets consistently demonstrate the superiority of our method over advanced sequential recommendation models. Code implementation is available at: https://***/lyra0611/DICSRec.

关键词： Adaptation models Codes Fuses Aggregates Neural networks Self-supervised learning Multitasking

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：