检索结果-内蒙古大学图书馆

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Ximing Li Silong Liang Changchun Li Pengfei Wang Fangming Gu College of Computer Science and Technology Jilin University China and Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China Computer Network Information Center Chinese Academy of Sciences China and University of Chinese Academy of Sciences Chinese Academy of Sciences China

ISBN: (纸本)9798331314385

Semi-supervised multi-label learning (SSMLL) refers to inducing classifiers using a small number of samples with multiple labels and many unlabeled samples. The prevalent solution of SSMLL involves forming pseudo-labels for unlabeled samples and inducing classifiers using both labeled and pseudo-labeled samples in a self-training manner. Unfortunately, with the commonly used binary type of loss and negative sampling, we have empirically found that learning with labeled and pseudo-labeled samples can result in the variance bias problem between the feature distributions of positive and negative samples for each label. To alleviate this problem, we aim to balance the variance bias between positive and negative samples from the perspective of the feature angle distribution for each label. Specifically, we extend the traditional binary angular margin loss to a balanced extension with feature angle distribution transformations under the Gaussian assumption, where the distributions are iteratively updated during classifier training. We also suggest an efficient prototype-based negative sampling method to maintain high-quality negative samples for each label. With this insight, we propose a novel SSMLL method, namely Semi-Supervised Multi-Label Learning with Balanced Binary Angular Margin loss (S2ML2-BBAM). To evaluate the effectiveness of S2ML2-BBAM, we compare it with existing competitors on benchmark datasets. The experimental results validate that S2ML2-BBAM can achieve very competitive performance.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Sfmfold: A Multi-Modal Contrast Learning Model for Rna Secondary Structure Prediction

SSRN

引用

SSRN 2025年

作者： Li, Ang Liu, Yuanning Zhang, Zhaoyang Li, Shuwang Dong, Hao Lv, Meng College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Software Jilin University Changchun130012 China College of Information Engineering Chang’an University Xi’an710064 China

The secondary structure of RNA can regulate the interaction between RNA and protein and perform various biological tasks through specific folding shapes, which plays an important role in revealing biomolecular mechanisms and developing new vaccines and therapeutic drugs. However, existing RNA secondary structure prediction methods based on thermodynamics and traditional neural network models usually lack the ability to model long-distance dependencies of RNA molecules and cannot handle complex non-nested structures in RNA molecules. In this paper, we propose a multi-modal contrastive learning method SFMFold based on state space model, which captures long-distance interactions in RNA sequences through RNA sequence representation learning part, and models the structure of RNA molecules through RNA structure representation learning part. Finally, the features of the two modalities are aligned and deeply fused to obtain the final RNA molecule prediction map. We test SFMFold on several datasets, and the experiments show that our proposed model shows excellent performance in cross-family prediction and long sequence prediction tasks. In addition, SFMFold can also effectively predict non-nested structures such as pseudoknot with better accuracy than the SOTA methods. © 2025, The Authors. All rights reserved.

关键词： Prediction models

来源：评论

学校读者我要写书评

暂无评论

Instance-adaptive zero-shot chain-of-thought prompting 24

Instance-adaptive zero-shot chain-of-thought prompting

引用

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Xiaosong Yuan Chen Shen Shaotian Yan Xiaofeng Zhang Liang Xie Wenxiao Wang Renchu Guan Ying Wang Jieping Ye College of Computer Science and Technology Jilin University and Key Laboratory of Symbolic Computation and Knowledge Engineering MoE Jilin University Alibaba Cloud Computing Shanghai Jiao Tong University College of Computer Science and Technology Zhejiang University of Technology College of Software Zhejiang University

ISBN: (纸本)9798331314385

Zero-shot Chain-of-Thought (CoT) prompting emerges as a simple and effective strategy for enhancing the performance of large language models (LLMs) in real-world reasoning tasks. Nonetheless, the efficacy of a singular, task-level prompt uniformly applied across the whole of instances is inherently limited since one prompt cannot be a good partner for all, a more appropriate approach should consider the interaction between the prompt and each instance meticulously. This work introduces an instance-adaptive prompting algorithm as an alternative zero-shot CoT reasoning scheme by adaptively differentiating good and bad prompts. Concretely, we first employ analysis on LLMs through the lens of information flow to detect the mechanism under zero-shot CoT reasoning, in which we discover that information flows from question to prompt and question to rationale jointly influence the reasoning results most. We notice that a better zero-shot CoT reasoning needs the prompt to obtain semantic information from the question, and then the rationale aggregates sufficient information from the question directly and via the prompt indirectly. On the contrary, lacking any of those would probably lead to a bad one. Stem from that, we further propose an instance-adaptive prompting strategy (IAP) for zero-shot CoT reasoning. Experiments conducted with LLaMA-2, LLaMA-3, and Qwen on math, logic, and commonsense reasoning tasks (e.g., GSM8k, MMLU, Causal Judgement) obtain consistent improvement, demonstrating that the instance-adaptive zero-shot CoT prompting performs better than other task-level methods with some curated prompts or sophisticated procedures, showing the significance of our findings in the zero-shot CoT reasoning mechanism.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Why Misinformation is Created? Detecting them by Integrating Intent Features

arXiv

引用

arXiv 2024年

作者： Wang, Bing Fu, Bo Li, Ximing Pei, Songwen Li, Changchun Wang, Shengsheng College of Computer Science and Technology Jilin University Changchun Jilin China Liaoning Normal University Liaoning Dalian China University of Shanghai for Science and Technology Shanghai China Key Laboratory of Symbolic Computation and Knowledge Engineering The Ministry of Education Jilin University China

Various social media platforms, e.g., Twitter and Reddit, allow people to disseminate a plethora of information more efficiently and conveniently. However, they are inevitably full of misinformation, causing damage to diverse aspects of our daily lives. To reduce the negative impact, timely identification of misinformation, namely Misinformation Detection (MD), has become an active research topic receiving widespread attention. As a complex phenomenon, the veracity of an article is influenced by various aspects. In this paper, we are inspired by the opposition of intents between misinformation and real information. Accordingly, we propose to reason the intent of articles and form the corresponding intent features to promote the veracity discrimination of article features. To achieve this, we build a hierarchy of a set of intents for both misinformation and real information by referring to the existing psychological theories, and we apply it to reason the intent of articles by progressively generating binary answers with an encoder-decoder structure. We form the corresponding intent features and integrate it with the token features to achieve more discriminative article features for MD. Upon these ideas, we suggest a novel MD method, namely Detecting Misinformation by Integrating Intent featuRes (Dm-inter). To evaluate the performance of Dm-inter, we conduct extensive experiments on benchmark MD datasets. The experimental results validate that Dm-inter can outperform the existing baseline MD methods. Copyright © 2024, The Authors. All rights reserved.

关键词： Data mining

来源：评论

学校读者我要写书评

暂无评论

Formal Reachability Analysis for Multi-Agent Reinforcement Learning Systems

Formal Reachability Analysis for Multi-Agent Reinforcement L...

引用

作者： Wang, Xiaoyan Peng, Jun Li, Shuqiu Li, Bing College of Computer Science and Technology Jilin University Changchun130012 China Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Jilin University Changchun130012 China

Reachability analysis is one of the most basic and challenging problems in verification. We investigate this problem in multi-agent reinforcement learning (MARL) system by transforming the reachability analysis to decision-making problem tackled by mixed integer linear programming (MILP) solver Gurobi. We define syntax and semantics for multi-role strategy logic (mrSL) which is used to describe the reachability specification. The logic mrSL is a variant of SL to express properties, which provide a holistic perspective to describe reachability properties instead of specifying a specific agent reaches a certain state in the MARL system. And the algorithms to translate reachability property into MILP constraints are provided. A tool called MAReachAnalysis is introduced, which uses Gurobi to solve the corresponding reachability problem and evaluate it on the predator-prey task of multi-agent deep deterministic policy gradient (MADDPG) example, discussion of the experimental results obtained on a range of test cases. © 2013 IEEE.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

END-TO-END ENTITY DETECTION WITH PROPOSER AND REGRESSOR

arXiv

引用

arXiv 2022年

作者： Wen, Xueru Zhou, Changjiang Tang, Haotian Liang, Luguang Jiang, Yu Qi, Hong College of Computer Science and Technology Jilin University Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Jilin University China

Named entity recognition is a traditional task in natural language processing. In particular, nested entity recognition receives extensive attention for the widespread existence of the nesting scenario. The latest research migrates the well-established paradigm of set prediction in object detection to cope with entity nesting. However, the manual creation of query vectors, which fail to adapt to the rich semantic information in the context, limits these approaches. An end-to-end entity detection approach with proposer and regressor is presented in this paper to tackle the issues. First, the proposer utilizes the feature pyramid network to generate high-quality entity proposals. Then, the regressor refines the proposals for generating the final prediction. The model adopts encoder-only architecture and thus obtains the advantages of the richness of query semantics, high precision of entity localization, and easiness of model training. Moreover, we introduce the novel spatially modulated attention and progressive refinement for further improvement. Extensive experiments demonstrate that our model achieves advanced performance in flat and nested NER, achieving a new state-of-the-art F1 score of 80.74 on the GENIA dataset and 72.38 on the WeiboNER dataset. Copyright © 2022, The Authors. All rights reserved.

关键词： Forecasting

来源：评论

学校读者我要写书评

暂无评论

Multi-Task Self-Supervised Learning for Medical Image Segmentation

Multi-Task Self-Supervised Learning for Medical Image Segmen...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Bo Wang Hang Zhao Xiongfei Li Mingjie Tian Bo Huang Feiyang Yang Intelligent Information Processing Laboratory Yanbian University Yanji China College of Computer Science and Technology Jilin University Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun China School of Artificial Intelligence Jilin University Changchun China

Although medical image segmentation has achieved remarkable results with supervised learning, obtaining labeled data remains challenging and costly. To counteract this, we present the MTSPSeg, a multi-task self-supervised learning framework. We establish the dynamic gradient learning rate (DGLR) strategy and the dynamic multi-task loss weight adjustment method (DWL) to relieve potential early convergence and diverse learning difficulties of self-supervised learning. Our method deeply integrates the prior knowledge inherent in medical images, facilitates collaborative learning among tasks, and delves further into the latent information within the images. Experimental results demonstrate that regardless of the proportion of labeled data, our method outperforms baseline models on the KiTS19 and LiTS datasets, achieving state-of-the-art performance on the KiTS19 dataset.

关键词：

来源：评论

学校读者我要写书评

暂无评论

TYPE-SUPERVISED SEQUENCE LABELING BASED ON THE HETEROGENEOUS STAR GRAPH FOR NAMED ENTITY RECOGNITION

arXiv

引用

arXiv 2022年

Named entity recognition is a fundamental task in natural language processing, identifying the span and category of entities in unstructured texts. The traditional sequence labeling methodology ignores the nested entities, i.e. entities included in other entity mentions. Many approaches attempt to address this scenario, most of which rely on complex structures or have high computation complexity. The representation learning of the heterogeneous star graph containing text nodes and type nodes is investigated in this paper. In addition, we revise the graph attention mechanism into a hybrid form to address its unreasonableness in specific topologies. The model performs the type-supervised sequence labeling after updating nodes in the graph. The annotation scheme is an extension of the single-layer sequence labeling and is able to cope with the vast majority of nested entities. Extensive experiments on public NER datasets reveal the effectiveness of our model in extracting both flat and nested entities. The method achieved state-of-the-art performance on both flat and nested datasets. The significant improvement in accuracy reflects the superiority of the multi-layer labeling strategy. Copyright © 2022, The Authors. All rights reserved.

关键词： Natural language processing systems

来源：评论

学校读者我要写书评

暂无评论

Discrepancy-Guided Reconstruction Learning for Image Forgery Detection

arXiv

引用

arXiv 2023年

作者： Shi, Zenan Chen, Haipeng Chen, Long Zhang, Dong College of Computer Science and Technology Jilin University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China Department of CSE The Hong Kong University of Science and Technology Hong Kong

In this paper, we propose a novel image forgery detection paradigm for boosting the model learning capacity on both forgery-sensitive and genuine compact visual patterns. Compared to the existing methods that only focus on the discrepant-specific patterns (e.g., noises, textures, and frequencies), our method has a greater generalization. Specifically, we first propose a Discrepancy-Guided Encoder (DisGE) to extract forgery-sensitive visual patterns. DisGE consists of two branches, where the mainstream backbone branch is used to extract general semantic features, and the accessorial discrepant external attention branch is used to extract explicit forgery cues. Besides, a Double-Head Reconstruction (DouHR) module is proposed to enhance genuine compact visual patterns in different granular spaces. Under DouHR, we further introduce a Discrepancy-Aggregation Detector (DisAD) to aggregate these genuine compact visual patterns, such that the forgery detection capability on unknown patterns can be improved. Extensive experimental results on four challenging datasets validate the effectiveness of our proposed method against state-of-the-art competitors. Copyright © 2023, The Authors. All rights reserved.

关键词： Textures

来源：评论

学校读者我要写书评

暂无评论

ON A NOVEL UCP RESULT AND ITS APPLICATION TO INVERSE CONDUCTIVE SCATTERING

arXiv

引用

arXiv 2024年

作者： Diao, Huaian Fei, Xiaoxu Liu, Hongyu School of Mathematics Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Jilin University Changchun130012 China School of Mathematics and Statistics Central South University Changsha410083 China Department of Mathematics City University of Hong Kong Kowloon Hong Kong

In this paper, we derive a novel Unique Continuation Principle (UCP) for a system of second-order elliptic PDEs and apply it to investigate inverse problems in conductive scattering. The UCP relaxes the typical assumptions imposed on the domain or boundary with certain interior transmission conditions. This is motivated by the study of the associated inverse scattering problem and enables us to establish several novel unique identifiability results for the determination of generalized conductive scatterers using a single far-field pattern, significantly extending the results in [15, 21]. A key technical advancement in our work is the combination of Complex Geometric Optics (CGO) techniques from [15, 21] with the Fourier expansion method to microlocally analyze corner singularities and their implications for inverse problems. We believe that the methods developed can have broader applications in other contexts. © 2024, CC BY.

关键词： Inverse problems

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：