检索结果-内蒙古大学图书馆

Causal-Inspired Multitask Learning for Video-Based Human Pose Estimation

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Chen, Haipeng Wu, Sifan Wang, Zhigang Yin, Yifang Jiao, Yingying Lyu, Yingda Liu, Zhenguang College of Computer Science and Technology Jilin University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China College of Computer Science and Technology Zhejiang Gongshang University China A*STAR Singapore Public Computer Education and Research Center Jilin University China The State Key Laboratory of Blockchain and Data Security Zhejiang University China Institute of Blockchain and Data Security China

Video-based human pose estimation has long been a fundamental yet challenging problem in computer vision. Previous studies focus on spatio-temporal modeling through the enhancement of architecture design and optimization strategies. However, they overlook the causal relationships in the joints, leading to models that may be overly tailored and thus estimate poorly to challenging scenes. Therefore, adequate causal reasoning capability, coupled with good interpretability of model, are both indispensable and prerequisite for achieving reliable results. In this paper, we pioneer a causal perspective on pose estimation and introduce a causal-inspired multitask learning framework, consisting of two stages. In the first stage, we try to endow the model with causal spatio-temporal modeling ability by introducing two self-supervision auxiliary tasks. Specifically, these auxiliary tasks enable the network to infer challenging keypoints based on observed keypoint information, thereby imbuing causal reasoning capabilities into the model and making it robust to challenging scenes. In the second stage, we argue that not all feature tokens contribute equally to pose estimation. Prioritizing causal (keypoint-relevant) tokens is crucial to achieve reliable results, which could improve the interpretability of the model. To this end, we propose a Token Causal Importance Selection module to identify the causal tokens and non-causal tokens (e.g., background and objects). Additionally, non-causal tokens could provide potentially beneficial cues but may be redundant. We further introduce a non-causal tokens clustering module to merge the similar non-causal tokens. Extensive experiments show that our method outperforms state-of-the-art methods on three large-scale benchmark datasets. Copyright © 2025, The Authors. All rights reserved.

关键词： Self-supervised learning

Complementary knowledge Compilation Using the Hyper Extension Rule

学校读者我要写书评

暂无评论

Chinese Journal of Electronics 2019年第2期28卷 259-265页

作者： NIU Dangdang LIU Lei LYU Shuai XU Yue College of Computer Science and Technology Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Jilin University

We introduce the concept of Complementary formula(COMF), which is a new and non-equivalent way for knowledge compilation(KC). Based on the Hyper extension rule(HER) which is an expansion of Extension rule(ER), we design a compilation algorithm which can formula compile each Conjunctive normal form(CNF)formula to complementary Fully complementary connected diagram(c-FCCD), named as C2C(CNF formula to cFCCD). Theoretically, c-FCCD is a kind of complementary formulae of the input formulae and can support all queries and partial transformations in KC map. Experimentally,C2C is competitive with the EPCCL compilers KCER,C2E, UKCHER, DKCHER and IKCHER.

关键词： knowledge compilation Extension rule Hyper extension rule Compilation language Each pair contains complementary literals(EPCCL) theory

Multimodal Medical Image Feature Representation and Fusion for AD Early Diagnosis

学校读者我要写书评

暂无评论

Multimodal Medical Image Feature Representation and Fusion f...

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Jing Qu Ying Qu Xueliang Bai Lanxin Xu Han Wang Guixia Liu College of Computer Science and Technology Jilin University Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun China College of Science North China University of Science and Technology Tangshan China School of Information Science and Technology Institute of Computational Biology Northeast Normal University Changchun China

ISBN: (数字)9798350386226

ISBN: (纸本)9798350386233

Alzheimer's disease (AD) is progressive and gets worse with time. Early detection is an effective treatment for the disease, which can timely implement effective interventions. The multi-modal medical image contains more comprehensive and abundant information about the disease, which can reflect the different aspects of AD and reduce the potential bias in single-modal diagnosis. However, an effective and reliable solution is still lacking, which can integrate multimodal neuroimaging effectively for the precision diagnosis and treatment of AD. In this work, we proposed a feature representation and fusion model of MRI and PET scans based on a multiscale convolution network and cross-attention for AD early diagnosis, named camAD. Compared with the existing models, camAD performs better with fewer pre-processing steps. Using the Alzheimer’s disease neuroimaging initiative (ADNI) datasets, we demonstrated that integrating multi-modality data outperforms single-modality models in accuracy, specificity, sensitivity, AUC, and F1 scores. Our models exhibited significantly good accuracy and generality in four classification tasks, which provided a promising way to understand the underlying mechanisms of the disorder's progression.

关键词： Neuroimaging Accuracy Sensitivity Convolution Magnetic resonance imaging Feature extraction Data models Reliability Alzheimer's disease Medical diagnostic imaging

Data-Efficient CLIP-Powered Dual-Branch Networks for Source-Free Unsupervised Domain Adaptation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Yongguang Cao, Yueqi Li, Jindong Wang, Qi Wang, Shengsheng College of Software Jilin University Changchun130012 China College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China School of Artificial Intelligence Jilin University Changchun130012 China Engineering Research Center of Knowledge-Driven Human-Machine Intelligence Ministry of Education Jilin University Changchun130012 China

Source-free Unsupervised Domain Adaptation (SF-UDA) aims to transfer a model’s performance from a labeled source domain to an unlabeled target domain without direct access to source samples, addressing critical data privacy concerns. However, most existing SF-UDA approaches assume the availability of abundant source domain samples, which is often impractical due to the high cost of data annotation. To address the dual challenges of limited source data and privacy concerns, we introduce a data-efficient, CLIP-powered dual-branch network (CDBN). This architecture consists of a cross-domain feature transfer branch and a target-specific feature learning branch, leveraging high-confidence target domain samples to transfer text features of source domain categories while learning target-specific soft prompts. By fusing the outputs of both branches, our approach not only effectively transfers source domain category semantic information to the target domain but also reduces the negative impacts of noise and domain gaps during target training. Furthermore, we propose an unsupervised optimization strategy driven by accurate classification and diversity, preserving the classification capability learned from the source domain while generating more confident and diverse predictions in the target domain. CDBN achieves near state-of-the-art performance with far fewer source domain samples than existing methods across 31 transfer tasks on seven datasets. © 2024, CC BY.

关键词： Adversarial machine learning

AMPCliff: quantitative definition and benchmarking of activity cliffs in antimicrobial peptides

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Kewei Wu, Yuqian Li, Yinheng Guo, Yutong Wang, Yan Liang, Yiyang Fan, Yusi Huang, Lan Zhang, Ruochi Zhou, Fengfeng College of Computer Science and Technology Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Jilin Changchun130012 China School of Software Jilin University Jilin Changchun130012 China School of Life Sciences Jilin University Jilin Changchun130012 China Department of Computer Science Columbia University 116th and Broadway New York CityNY10027 United States School of Artificial Intelligence Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Jilin Changchun130012 China School of Biology and Engineering Guizhou Medical University Guizhou Guiyang550025 China School of Computer Engineering Changchun University of Engineering Jilin Changchun130103 China Changchun Wenli High School Jilin Changchun130062 China

Since the mechanism of action of drug molecules in the human body is difficult to reproduce in the in vitro environment, it becomes difficult to reveal the causes of the activity cliff phenomenon of drug molecules. We found out the AC of small molecules has been extensively investigated but limited knowledge is accumulated about the AC phenomenon in peptides with canonical amino acids. Understanding the mechanism of AC in canonical amino acids might help understand the one in drug molecules. This study introduces a quantitative definition and benchmarking framework AMPCliff for the AC phenomenon in antimicrobial peptides (AMPs) composed by canonical amino acids. A comprehensive analysis of the existing AMP dataset reveals a significant prevalence of AC within AMPs. AMPCliff quantifies the activities of AMPs by the MIC, and defines 0.9 as the minimum threshold for the normalized BLOSUM62 similarity score between a pair of aligned peptides with at least two-fold MIC changes. This study establishes a benchmark dataset of paired AMPs in Staphylococcus aureus from the publicly available AMP dataset GRAMPA, and conducts a rigorous procedure to evaluate various AMP AC prediction models, including nine machine learning, four deep learning algorithms, four masked language models, and four generative language models. Our analysis reveals that these models are capable of detecting AMP AC events and the pre-trained protein language model ESM2 demonstrates superior performance across the evaluations. The predictive performance of AMP activity cliffs remains to be further improved, considering that ESM2 with 33 layers only achieves the Spearman correlation coefficient 0.4669 for the regression task of the MIC values on the benchmark dataset. Source code and additional resources are available at https://***/supp/or https://***/Kewei2023/AMPCliff-generation. © 2024, CC BY-NC-SA.

关键词： Deep learning

Heterogeneous Graph Reinforcement Learning for Dependency-aware Multi-task Allocation in Spatial Crowdsourcing

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhao, Yong Zhu, Zhengqiu Gao, Chen Wang, En Huang, Jincai Wang, Fei-Yue College of Systems Engineering National University of Defense Technology Hunan Province Changsha410073 China BNRist Tsinghua University Beijing100084 China College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing100190 China

Spatial Crowdsourcing (SC) is gaining traction in both academia and industry, with tasks on SC platforms becoming increasingly complex and requiring collaboration among workers with diverse skills. Recent research works address complex tasks by dividing them into subtasks with dependencies and assigning them to suitable workers. However, the dependencies among subtasks and their heterogeneous skill requirements, as well as the need for efficient utilization of workers’ limited work time in the multi-task allocation mode, pose challenges in achieving an optimal task allocation scheme. Therefore, this paper formally investigates the problem of Dependency-aware Multi-task Allocation (DMA) and presents a well-designed framework to solve it, known as Heterogeneous Graph Reinforcement Learning-based Task Allocation (HGRL-TA). To address the challenges associated with representing and embedding diverse problem instances to ensure robust generalization, we propose a multi-relation graph model and a Compound-path-based Heterogeneous Graph Attention Network (CHANet) for effectively representing and capturing intricate relations among tasks and workers, as well as providing embedding of problem state. The task allocation decision is determined sequentially by a policy network, which undergoes simultaneous training with CHANet using the proximal policy optimization algorithm. Extensive experiment results demonstrate the effectiveness and generality of the proposed HGRL-TA in solving the DMA problem, leading to average profits that is 21.78% higher than those achieved using the metaheuristic methods. © 2024, CC BY-NC-ND.

关键词： Reinforcement learning

Building a Private Cloud Based on Microservices for Computer Science laboratory in Universities 7

学校读者我要写书评

暂无评论

Building a Private Cloud Based on Microservices for Computer...

7th International Conference on Information Science and Control engineering, ICISCE 2020

作者： Liu, Hao Wang, Zhe Huang, Lan Wang, Kangping Jilin University School of Computer Science and Technology Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering Jilin University Changchun China

ISBN: (纸本)9781728164069

Computer science labs in universities have different demands in cloud computing compared with typical IT companies. They differ greatly in software requirements and resource utilization. As an instance, we propose building a private cloud based on microservices with Docker and Kubernetes in our laboratory to match our labs' typical *** private cloud proposed in this paper is composed of multiple components such as authentication, service gateway, distributed storage, knowledge management, code management, etc. Furthermore, some typical research software systems are deployed as microservices in the private cloud. To satisfy complex software environment requirements, a multi version microservice is implemented. In our microservices platform, users can submit their own microservices and manage these microservices' life cycle through a web interface. In addition, the platform will automatically start and stop low frequency services to improve resource utilization rate. We use laboratory resources to conduct experiments and build a platform. With deploying the platform in our laboratory, it shows that the platform meets most of typical demands in research work and improves research efficiency. © 2020 IEEE.

关键词： Laboratories

Variational Wasserstein Barycenters with c-Cyclical Monotonicity Regularization

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Chi, Jinjin Yang, Zhiyao Li, Ximing Ouyang, Jihong Guan, Renchu College of Computer Science and Technology Jilin University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education China

Wasserstein barycenter, built on the theory of Optimal Transport (OT), provides a powerful framework to aggregate probability distributions, and it has increasingly attracted great attention within the machine learning community. However, it is often intractable to precisely compute, especially for high dimensional and continuous settings. To alleviate this problem, we develop a novel regularization by using the fact that c-cyclical monotonicity is often necessary and sufficient conditions for optimality in OT problems, and incorporate it into the dual formulation of Wasserstein barycenters. For efficient computations, we adopt a variational distribution as the approximation of the true continuous barycenter, so as to frame the Wasserstein barycenters problem as an optimization problem with respect to variational parameters. Upon those ideas, we propose a novel end-to-end continuous approximation method, namely Variational Wasserstein Barycenters with c-Cyclical Monotonicity Regularization (VWB-CMR), given sample access to the input distributions. We show theoretical convergence analysis and demonstrate the superior performance of VWB-CMR on synthetic data and real applications of subset posterior aggregation. Copyright © 2021, The Authors. All rights reserved.

关键词： Probability distributions

Medical Scene Graphs and Reasoning

学校读者我要写书评

暂无评论

Medical Scene Graphs and Reasoning

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Chuxue Cao Yiming He Yuzhen Chen Chunli Song Hao Ling Renchu Guan Xiaoyue Feng The Key Laboratory for Symbolic Computation and Knowledge Engineering of the Ministry of Education College of Software Jilin University Changchun China The Second Hospital of Jilin University Changchun China The Key Laboratory for Symbolic Computation and Knowledge Engineering of the Ministry of Education College of Computer Science and Technology Jilin University Changchun China

ISBN: (纸本)9781665429825

Medical scene graph contributes to cognitive tasks such as question answering. An automatic medical scene graph generator can annotate medical images with scene graphs conveniently. An end-to-end model is proposed, which contains an automatic medical scene graph generator based on medical images and surgery records. The novel model can extract symptom information of the images from surgery records via name entity recognition then convert it into scene graphs. The content and format of the scene graph are pre-defined according to the features of the images. A medical scene graph (MSG) dataset is also produced. The dataset contains 116 scene graphs where each graph includes 6 to 30 entities. Experiments show that our model performs well on making scene graphs of CT coronary angiography. Significantly, the scene graphs have the type, state, location, and index of arteries. To verify the practicability of the MSG dataset, We construct an intelligent model that can generate key diagnostic results. In addition, our medical scene graph generator can be applied to other medical areas to annotate different kinds of medical images intelligently. And the MSG dataset can directly be used in other cognitive visual tasks.

关键词： Visualization Computed tomography Angiography Surgery Medical services Generators Task analysis