检索结果-内蒙古大学图书馆

TYPE-SUPERVISED SEQUENCE LABELING BASED ON THE HETEROGENEOUS STAR GRAPH FOR NAMED ENTITY RECOGNITION

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wen, Xueru Zhou, Changjiang Tang, Haotian Liang, Luguang Jiang, Yu Qi, Hong College of Computer Science and Technology Jilin University Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Jilin University China

Named entity recognition is a fundamental task in natural language processing, identifying the span and category of entities in unstructured texts. The traditional sequence labeling methodology ignores the nested entities, i.e. entities included in other entity mentions. Many approaches attempt to address this scenario, most of which rely on complex structures or have high computation complexity. The representation learning of the heterogeneous star graph containing text nodes and type nodes is investigated in this paper. In addition, we revise the graph attention mechanism into a hybrid form to address its unreasonableness in specific topologies. The model performs the type-supervised sequence labeling after updating nodes in the graph. The annotation scheme is an extension of the single-layer sequence labeling and is able to cope with the vast majority of nested entities. Extensive experiments on public NER datasets reveal the effectiveness of our model in extracting both flat and nested entities. The method achieved state-of-the-art performance on both flat and nested datasets. The significant improvement in accuracy reflects the superiority of the multi-layer labeling strategy. Copyright © 2022, The Authors. All rights reserved.

关键词： Natural language processing systems

Discrepancy-Guided Reconstruction Learning for Image Forgery Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Shi, Zenan Chen, Haipeng Chen, Long Zhang, Dong College of Computer Science and Technology Jilin University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China Department of CSE The Hong Kong University of Science and Technology Hong Kong

In this paper, we propose a novel image forgery detection paradigm for boosting the model learning capacity on both forgery-sensitive and genuine compact visual patterns. Compared to the existing methods that only focus on the discrepant-specific patterns (e.g., noises, textures, and frequencies), our method has a greater generalization. Specifically, we first propose a Discrepancy-Guided Encoder (DisGE) to extract forgery-sensitive visual patterns. DisGE consists of two branches, where the mainstream backbone branch is used to extract general semantic features, and the accessorial discrepant external attention branch is used to extract explicit forgery cues. Besides, a Double-Head Reconstruction (DouHR) module is proposed to enhance genuine compact visual patterns in different granular spaces. Under DouHR, we further introduce a Discrepancy-Aggregation Detector (DisAD) to aggregate these genuine compact visual patterns, such that the forgery detection capability on unknown patterns can be improved. Extensive experimental results on four challenging datasets validate the effectiveness of our proposed method against state-of-the-art competitors. Copyright © 2023, The Authors. All rights reserved.

关键词： Textures

DeepSelective: Feature Gating and Representation Matching for Interpretable Clinical Prediction

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Ruochi Yang, Qian Wang, Xiaoyang Wu, Haoran Zhou, Qiong Wang, Yu Li, Kewei Wang, Yueying Fan, Yusi Zhang, Jiale Huang, Lan Liu, Chang Zhou, Fengfeng College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China Beijing Life Science Academy Beijing102209 China Syneron Technology Guangzhou510700 China

The rapid accumulation of Electronic Health Records (EHRs) has transformed healthcare by providing valuable data that enhance clinical predictions and diagnoses. While conventional machine learning models have proven effective, they often lack robust representation learning and depend heavily on expert-crafted features. Although deep learning offers powerful solutions, it is often criticized for its lack of interpretability. To address these challenges, we propose DeepSelective, a novel end to end deep learning framework for predicting patient prognosis using EHR data, with a strong emphasis on enhancing model interpretability. DeepSelective combines data compression techniques with an innovative feature selection approach, integrating custom-designed modules that work together to improve both accuracy and interpretability. Our experiments demonstrate that DeepSelective not only enhances predictive accuracy but also significantly improves interpretability, making it a valuable tool for clinical decision-making. The source code is freely available at http://***/supp/*** . © 2025, CC BY-NC-ND.

关键词： Electronic health record

END-TO-END ENTITY DETECTION WITH PROPOSER AND REGRESSOR

学校读者我要写书评

暂无评论

arXiv 2022年

Named entity recognition is a traditional task in natural language processing. In particular, nested entity recognition receives extensive attention for the widespread existence of the nesting scenario. The latest research migrates the well-established paradigm of set prediction in object detection to cope with entity nesting. However, the manual creation of query vectors, which fail to adapt to the rich semantic information in the context, limits these approaches. An end-to-end entity detection approach with proposer and regressor is presented in this paper to tackle the issues. First, the proposer utilizes the feature pyramid network to generate high-quality entity proposals. Then, the regressor refines the proposals for generating the final prediction. The model adopts encoder-only architecture and thus obtains the advantages of the richness of query semantics, high precision of entity localization, and easiness of model training. Moreover, we introduce the novel spatially modulated attention and progressive refinement for further improvement. Extensive experiments demonstrate that our model achieves advanced performance in flat and nested NER, achieving a new state-of-the-art F1 score of 80.74 on the GENIA dataset and 72.38 on the WeiboNER dataset. Copyright © 2022, The Authors. All rights reserved.

关键词： Forecasting

Sfmfold: A Multi-Modal Contrast Learning Model for Rna Secondary Structure Prediction

学校读者我要写书评

暂无评论

SSRN

SSRN 2025年

作者： Li, Ang Liu, Yuanning Zhang, Zhaoyang Li, Shuwang Dong, Hao Lv, Meng College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Software Jilin University Changchun130012 China College of Information Engineering Chang’an University Xi’an710064 China

The secondary structure of RNA can regulate the interaction between RNA and protein and perform various biological tasks through specific folding shapes, which plays an important role in revealing biomolecular mechanisms and developing new vaccines and therapeutic drugs. However, existing RNA secondary structure prediction methods based on thermodynamics and traditional neural network models usually lack the ability to model long-distance dependencies of RNA molecules and cannot handle complex non-nested structures in RNA molecules. In this paper, we propose a multi-modal contrastive learning method SFMFold based on state space model, which captures long-distance interactions in RNA sequences through RNA sequence representation learning part, and models the structure of RNA molecules through RNA structure representation learning part. Finally, the features of the two modalities are aligned and deeply fused to obtain the final RNA molecule prediction map. We test SFMFold on several datasets, and the experiments show that our proposed model shows excellent performance in cross-family prediction and long sequence prediction tasks. In addition, SFMFold can also effectively predict non-nested structures such as pseudoknot with better accuracy than the SOTA methods. © 2025, The Authors. All rights reserved.

关键词： Prediction models

ON A NOVEL UCP RESULT AND ITS APPLICATION TO INVERSE CONDUCTIVE SCATTERING

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Diao, Huaian Fei, Xiaoxu Liu, Hongyu School of Mathematics Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Jilin University Changchun130012 China School of Mathematics and Statistics Central South University Changsha410083 China Department of Mathematics City University of Hong Kong Kowloon Hong Kong

In this paper, we derive a novel Unique Continuation Principle (UCP) for a system of second-order elliptic PDEs and apply it to investigate inverse problems in conductive scattering. The UCP relaxes the typical assumptions imposed on the domain or boundary with certain interior transmission conditions. This is motivated by the study of the associated inverse scattering problem and enables us to establish several novel unique identifiability results for the determination of generalized conductive scatterers using a single far-field pattern, significantly extending the results in [15, 21]. A key technical advancement in our work is the combination of Complex Geometric Optics (CGO) techniques from [15, 21] with the Fourier expansion method to microlocally analyze corner singularities and their implications for inverse problems. We believe that the methods developed can have broader applications in other contexts. © 2024, CC BY.

关键词： Inverse problems

Multi-Task Self-Supervised Learning for Medical Image Segmentation

学校读者我要写书评

暂无评论

Multi-Task Self-Supervised Learning for Medical Image Segmen...

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Bo Wang Hang Zhao Xiongfei Li Mingjie Tian Bo Huang Feiyang Yang Intelligent Information Processing Laboratory Yanbian University Yanji China College of Computer Science and Technology Jilin University Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun China School of Artificial Intelligence Jilin University Changchun China

Although medical image segmentation has achieved remarkable results with supervised learning, obtaining labeled data remains challenging and costly. To counteract this, we present the MTSPSeg, a multi-task self-supervised learning framework. We establish the dynamic gradient learning rate (DGLR) strategy and the dynamic multi-task loss weight adjustment method (DWL) to relieve potential early convergence and diverse learning difficulties of self-supervised learning. Our method deeply integrates the prior knowledge inherent in medical images, facilitates collaborative learning among tasks, and delves further into the latent information within the images. Experimental results demonstrate that regardless of the proportion of labeled data, our method outperforms baseline models on the KiTS19 and LiTS datasets, achieving state-of-the-art performance on the KiTS19 dataset.

关键词：

Efficient Heuristics for Learning Scalable Bayesian Network Classifier from Labeled and Unlabeled Data

学校读者我要写书评

暂无评论

SSRN

SSRN 2023年

作者： Wang, Limin Wang, Junjie Guo, Lu Li, Qilong Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Software Jilin University Changchun130012 China College of Instrumentation and Electrical Engineering Jilin University Changchun130012 China

Naive Bayes (NB) is one of the top ten machine learning algorithms whereas its attribute independence assumption rarely holds in practice. A feasible and efficient approach to improving NB is relaxing the assumption by adding augmented edges to the restricted topology of NB. In this paper we prove theoretically that the generalized topology may be a suboptimal solution to model multivariate probability distributions if its fitness to data cannot be measured. Thus we propose to apply log-likelihood function as the scoring function, then introduce an efficient heuristic search strategy to explore high-dependence relationships, and for each iteration the learned topology will be improved to fit data better. The proposed algorithm, called log-likelihood Bayesian classifier (LLBC), can respectively learn two submodels from labeled training set and individual unlabeled testing instance, and then make them work jointly for classification in the framework of ensemble learning. Our extensive experimental evaluations on 36 UCI benchmark datasets reveal that, LLBC demonstrates excellent classification performance and provides a competitive approach to learn from labeled and unlabeled data. © 2023, The Authors. All rights reserved.

关键词： Classification (of information)

Mask2Edge: Masking dependencies and dynamically capturing pixel differences in edge detection

学校读者我要写书评

暂无评论

Expert Systems with Applications 2025年 286卷

作者： Zhou, Jianhang Zhao, Hongwei Qu, Daikun Xing, Long College of Computer Science and Technology Jilin University Jilin Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Jilin Changchun130012 China Army Artillery and Air Defense Academy Sergeant School Liaoning Shenyang110000 China

Edge detection plays an important role in computer vision tasks. Deep learning-based edge detectors commonly rely on encoding the long and short-term dependencies of pixel values to mine contextual information. They strongly focus on all positions in the image, ignoring the potential issue of over-encoding. Furthermore, most of these models have not attempted to leverage the inherent properties of edges. In this paper, we introduce a query-based edge detector named Mask2Edge, which is capable of masking dependencies and dynamically capturing pixel differences. Specifically, we first devise a masking strategy based on the sparsity of edges to alleviate the over-encoding issue. We propose a Region-guided Masked Attention, which adapts to edge detection and is capable of constraining cross-attention with appropriate masking intensity to extract relatively complete local features. Subsequently, we design a structure to capture the pixel differences that can help identify edges. We introduce dynamic convolutions into edge detection and refine the application scope and generation method of attention weights to effectively perceive changes in pixel gradients. Extensive experiments demonstrate the superiority of Mask2Edge compared with state-of-the-art methods. The source code is available at https://***/zhoujh2020/Mask2Edge. © 2025 Elsevier Ltd

关键词： Edge detection