检索结果-内蒙古大学图书馆

3DSEAVNet: 3D-Squeeze-and-Excitation Networks for Audio-Visual Saliency Prediction

学校读者我要写书评

暂无评论

3DSEAVNet: 3D-Squeeze-and-Excitation Networks for Audio-Visu...

International Joint Conference on Neural Networks (IJCNN)

作者： Silong Liang Chunxiao Li Naying Cui Minghui Sun Hao Xue College of Software Engineering JiLin University Changchun China College of Computer Science and Technology JiLin University Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education JiLin University Changchun China

Video saliency prediction is an important task in the field of computer vision. Most of the existing video saliency prediction methods only focus on image information, and the audio information is often ignored. This leads to an incomplete perception mode, which makes it difficult to achieve optimal performance. SENet is an excellent attention mechanism-based network. It significantly enhances the performance of 2D convolutional networks. However, whether the 3D convolutional network can be applied to this attention mechanism network remains to be studied. In order to solve the above problems, we propose a saliency prediction network for audio-visual fusion to extract and predict various information in videos. At the same time, we improve the traditional SENet to make it applicable in 3D convolutional neural networks and discuss its role. Compared with the state-of-the-art methods, our model has strong competitiveness in multiple data sets.

关键词：

TYPE-SUPERVISED SEQUENCE LABELING BASED ON THE HETEROGENEOUS STAR GRAPH FOR NAMED ENTITY RECOGNITION

学校读者我要写书评

暂无评论

arXiv 2022年

Named entity recognition is a fundamental task in natural language processing, identifying the span and category of entities in unstructured texts. The traditional sequence labeling methodology ignores the nested entities, i.e. entities included in other entity mentions. Many approaches attempt to address this scenario, most of which rely on complex structures or have high computation complexity. The representation learning of the heterogeneous star graph containing text nodes and type nodes is investigated in this paper. In addition, we revise the graph attention mechanism into a hybrid form to address its unreasonableness in specific topologies. The model performs the type-supervised sequence labeling after updating nodes in the graph. The annotation scheme is an extension of the single-layer sequence labeling and is able to cope with the vast majority of nested entities. Extensive experiments on public NER datasets reveal the effectiveness of our model in extracting both flat and nested entities. The method achieved state-of-the-art performance on both flat and nested datasets. The significant improvement in accuracy reflects the superiority of the multi-layer labeling strategy. Copyright © 2022, The Authors. All rights reserved.

关键词： Natural language processing systems

RFR-WWANet: Weighted Window Attention-Based Recovery Feature Resolution Network for Unsupervised Image Registration

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Ma, Mingrui Wang, Tao Wang, Weijie Song, Lei Liu, Guixia College of Computer Science and Technology Jilin University Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Changchun China Department of Information Engineering and Computer Science University of Trento Trento Italy

The Swin transformer has recently attracted attention in medical image analysis due to its computational efficiency and long-range modeling capability. Owing to these properties, the Swin Transformer is suitable for establishing more distant relationships between corresponding voxels in different positions in complex abdominal image registration tasks. However, the registration models based on transformers combine multiple voxels into a single semantic token. This merging process limits the transformers to model and generate coarse-grained spatial information. To address this issue, we propose Recovery Feature Resolution Network (RFRNet), which allows the transformer to contribute fine-grained spatial information and rich semantic correspondences to higher resolution levels. Furthermore, shifted window partitioning operations are inflexible, indicating that they cannot perceive the semantic information over uncertain distances and automatically bridge the global connections between windows. Therefore, we present a Weighted Window Attention (WWA) to build global interactions between windows automatically. It is implemented after the regular and cyclic shift window partitioning operations within the Swin transformer block. The proposed unsupervised deformable image registration model, named RFR-WWANet, detects the long-range correlations, and facilitates meaningful semantic relevance of anatomical structures. Qualitative and quantitative results show that RFR-WWANet achieves significant improvements over the current state-of-the-art methods. Ablation experiments demonstrate the effectiveness of the RFRNet and WWA designs. Our code is available at https://***/MingR-Ma/RFR-WWANet. Copyright © 2023, The Authors. All rights reserved.

关键词： Semantics

DeepSelective: Feature Gating and Representation Matching for Interpretable Clinical Prediction

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Ruochi Yang, Qian Wang, Xiaoyang Wu, Haoran Zhou, Qiong Wang, Yu Li, Kewei Wang, Yueying Fan, Yusi Zhang, Jiale Huang, Lan Liu, Chang Zhou, Fengfeng College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China Beijing Life Science Academy Beijing102209 China Syneron Technology Guangzhou510700 China

The rapid accumulation of Electronic Health Records (EHRs) has transformed healthcare by providing valuable data that enhance clinical predictions and diagnoses. While conventional machine learning models have proven effective, they often lack robust representation learning and depend heavily on expert-crafted features. Although deep learning offers powerful solutions, it is often criticized for its lack of interpretability. To address these challenges, we propose DeepSelective, a novel end to end deep learning framework for predicting patient prognosis using EHR data, with a strong emphasis on enhancing model interpretability. DeepSelective combines data compression techniques with an innovative feature selection approach, integrating custom-designed modules that work together to improve both accuracy and interpretability. Our experiments demonstrate that DeepSelective not only enhances predictive accuracy but also significantly improves interpretability, making it a valuable tool for clinical decision-making. The source code is freely available at http://***/supp/*** . © 2025, CC BY-NC-ND.

关键词： Electronic health record

ON A NOVEL UCP RESULT AND ITS APPLICATION TO INVERSE CONDUCTIVE SCATTERING

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Diao, Huaian Fei, Xiaoxu Liu, Hongyu School of Mathematics Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Jilin University Changchun130012 China School of Mathematics and Statistics Central South University Changsha410083 China Department of Mathematics City University of Hong Kong Kowloon Hong Kong

In this paper, we derive a novel Unique Continuation Principle (UCP) for a system of second-order elliptic PDEs and apply it to investigate inverse problems in conductive scattering. The UCP relaxes the typical assumptions imposed on the domain or boundary with certain interior transmission conditions. This is motivated by the study of the associated inverse scattering problem and enables us to establish several novel unique identifiability results for the determination of generalized conductive scatterers using a single far-field pattern, significantly extending the results in [15, 21]. A key technical advancement in our work is the combination of Complex Geometric Optics (CGO) techniques from [15, 21] with the Fourier expansion method to microlocally analyze corner singularities and their implications for inverse problems. We believe that the methods developed can have broader applications in other contexts. © 2024, CC BY.

关键词： Inverse problems

Learning Group-Disentangled Representation for Interpretable Thoracic Pathologic Prediction

学校读者我要写书评

暂无评论

Learning Group-Disentangled Representation for Interpretable...

2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022

作者： Li, Hao Wu, Yirui Hu, Hexuan Lu, Hu Lai, Yong Wan, Shaohua Hohai University Key Laboratory of Water Big Data Technology of Ministry of Water Resources China College of Computer and Information Hohai University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China School of Computer Science and Communication Engineering Jiangsu University China Shenzhen Institute for Advanced Study University of Electronic Science and Technology of China China

ISBN: (纸本)9781665468190

Deep learning methods have shown significant performance in medical image analysis tasks. However, they generally act like 'black box' without explanations in both feature extraction and decision processes, leading to lack of clinical insights and high risk assessments. To aid deep learning in envisioning diseases with visual clues, we propose Representation Group-Disentangling Network (RGD-Net), which can completely disentangle feature space of input X-ray images into several independent feature groups, each corresponding to a specific disease. Taking several semantically related and labeled X-ray images as input, RGD-Net firstly extracts completely group-disentangled representations of diseases through Group-Disentangle Module, which applies group-swap and linking operations to construct latent space by enforcing semantic consistency of attributes. To prevent learning degenerate representations defined as shortcut problem, we further introduce adversarial constricts on mapping from features to diseases, thus avoiding model collapse with former free-form disentanglement. Experiments on chestxray-14 and ChestXpert datasets demonstrate that RGD-Net are effective in predicting diseases with remarkable advantages, which leverage potential factors contributing to different diseases, thus enhancing interpretability in working patterns of deep learning methods. © 2022 IEEE.

关键词： Forecasting

Mask2Edge: Masking dependencies and dynamically capturing pixel differences in edge detection

学校读者我要写书评

暂无评论

Expert Systems with Applications 2025年 286卷

作者： Zhou, Jianhang Zhao, Hongwei Qu, Daikun Xing, Long College of Computer Science and Technology Jilin University Jilin Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Jilin Changchun130012 China Army Artillery and Air Defense Academy Sergeant School Liaoning Shenyang110000 China

Edge detection plays an important role in computer vision tasks. Deep learning-based edge detectors commonly rely on encoding the long and short-term dependencies of pixel values to mine contextual information. They strongly focus on all positions in the image, ignoring the potential issue of over-encoding. Furthermore, most of these models have not attempted to leverage the inherent properties of edges. In this paper, we introduce a query-based edge detector named Mask2Edge, which is capable of masking dependencies and dynamically capturing pixel differences. Specifically, we first devise a masking strategy based on the sparsity of edges to alleviate the over-encoding issue. We propose a Region-guided Masked Attention, which adapts to edge detection and is capable of constraining cross-attention with appropriate masking intensity to extract relatively complete local features. Subsequently, we design a structure to capture the pixel differences that can help identify edges. We introduce dynamic convolutions into edge detection and refine the application scope and generation method of attention weights to effectively perceive changes in pixel gradients. Extensive experiments demonstrate the superiority of Mask2Edge compared with state-of-the-art methods. The source code is available at https://***/zhoujh2020/Mask2Edge. © 2025 Elsevier Ltd

关键词： Edge detection

DK-STN: A Domain knowledge Embedded Spatio-Temporal Network Model for MJO Forecast

学校读者我要写书评

暂无评论

SSRN

SSRN 2023年

作者： Li, Hongliang Zhang, Nong Xu, Zhewen Li, Xiang Liu, Changzheng Zhao, Chongbo Wu, Jie College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Changchun130012 China China Meteorological Administration Key Laboratory for Climate Prediction Studies National Climate Center Beijing100081 China

Understanding and predicting the Madden-Julian Oscillation (MJO) is fundamental for precipitation forecasting and disaster prevention. To date, long-term and accurate MJO prediction has remained a challenge for researchers. Conventional MJO prediction methods using Numerical Weather Prediction (NWP) are resource-intensive, time-consuming, and highly unstable. While existing Artificial Neural Network (ANN) methods save resources and speed forecasting, their accuracy never reaches the 28 days predicted by the state-of-the-art NWP method, i.e., the ECMWF, since neural networks cannot handle climate data effectively. In this paper, we present a Domain knowledge Embedded Spatio-Temporal Network (DK-STN), a stable neural network model for accurate and efficient MJO forecasting. It combines the benefits of NWP and ANN methods and successfully improves the forecast accuracy of ANN methods while maintaining a high level of efficiency and stability. We begin with a spatial-temporal network (STN) and embed domain knowledge in it using two key methods: (i) applying a domain knowledge enhancement method and (ii) integrating a domain knowledge processing method into network training. We evaluated DK-STN with the 5th generation of ECMWF reanalysis (ERA5) data and compared it with ECMWF. Given 7 days of climate data as input, DK-STN can generate reliable forecasts for the following 28 days in 1-2 seconds, with an error of only 2-3 days in different seasons. DK-STN significantly exceeds ECMWF in that its forecast accuracy is equivalent to ECMWF's, while its efficiency and stability are significantly superior. © 2023, The Authors. All rights reserved.

关键词： Weather forecasting

Hybrid features and semantic reinforcement network for image forgery detection

学校读者我要写书评

暂无评论

Hybrid features and semantic reinforcement network for image...

作者： Chen, Haipeng Chang, Chaoqun Shi, Zenan Lyu, Yingda College of Computer Science and Technology Jilin University Changchun130012 China College of Software Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China Public Computer Education and Research Center Jilin University Changchun130012 China

Image forgery detection focuses more on tampering regions than image content of semantic segmentation, it is revealed that wealthier features need to be learned. Moreover, insufficient semantic information causes low efficiency of forgery detection. To address these issues, we propose a hybrid features and semantic reinforcement network (HFSRNet) for image forgery detection, which is an encoding and decoding based network. Specifically, long-short term memory with resampling features has been applied to capture traces from the image patches for finding manipulating artifacts. Consolidated features extracted from rotating residual units are further leveraged to amplify the discrepancy between un-tampered and tampered regions. We then hybridize features from them through a concatenation to further incorporate spatial co-occurrence of these two modalities. In addition, for achieving the semantic consistency between two same level features associated by across layers, semantic reinforcement is implemented on the decoding stage. HFSRNet is an end-to-end architecture that handles multiple types of image forgery including copy-move, splicing, removal. Experiments on three standard image manipulation datasets (NIST16, COVERAGE and CASIA) demonstrate that HFSRNet obtains state-of-the-art performance compared to existing models and baselines. © 2021, The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.

关键词： Semantics