检索结果-内蒙古大学图书馆

SpatioTemporal Learning for Human Pose Estimation in Sparsely-Labeled Videos

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Jiao, Yingying Wang, Zhigang Wu, Sifan Fan, Shaojing Liu, Zhenguang Xu, Zhuoyue Wu, Zheqi College of Computer Science and Technology Jilin University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China College of Computer Science and Technology Zhejiang Gongshang University China School of Computing National University of Singapore Singapore The State Key Laboratory of Blockchain and Data Security Zhejiang University China Institute of Blockchain and Data Security China

Human pose estimation in videos remains a challenge, largely due to the reliance on extensive manual annotation of large datasets, which is expensive and labor-intensive. Furthermore, existing approaches often struggle to capture long-range temporal dependencies and overlook the complementary relationship between temporal pose heatmaps and visual features. To address these limitations, we introduce STDPose, a novel framework that enhances human pose estimation by learning spatiotemporal dynamics in sparsely-labeled videos. STDPose incorporates two key innovations: 1) A novel Dynamic-Aware Mask to capture long-range motion context, allowing for a nuanced understanding of pose changes. 2) A system for encoding and aggregating spatiotemporal representations and motion dynamics to effectively model spatiotemporal relationships, improving the accuracy and robustness of pose estimation. STDPose establishes a new performance benchmark for both video pose propagation (i.e., propagating pose annotations from labeled frames to unlabeled frames) and pose estimation tasks, across three large-scale evaluation datasets. Additionally, utilizing pseudo-labels generated by pose propagation, STDPose achieves competitive performance with only 26.7% labeled data. Copyright © 2025, The Authors. All rights reserved.

关键词： Large datasets

2D-3D Feature Co-Embedding Network with Sparse Annotation for 3D Medical Image Segmentation

学校读者我要写书评

暂无评论

2D-3D Feature Co-Embedding Network with Sparse Annotation fo...

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Mingzhu Zhu Shuyu Guo Ziwei Wang Jianhang Jiao Tian Bai College of Computer Science and Technology Jilin University Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun China College of Software Jilin University Changchun China Department of Orthopedics The Second Norman Bethune Hospital of Jilin University Changchun China

ISBN: (数字)9798350386226

ISBN: (纸本)9798350386233

Supervised methods on 3D medical image segmentation need large amounts of annotated data, but annotating is time-consuming. Also, existing 3D segmentation methods capture more global structural information but overlook local detailed features, which negatively impacts the segmentation of small tissues. In this paper, we propose a novel weakly-supervised 2D-3D Feature Co-Embedding Network (2D-3D CoENet) that includes 2D and 3D encoding layers, simultaneously extracting 2D local detailed and 3D global structural features. To reduce annotation costs, we use fewer labeled slices as ground truth and pseudo-labels are generated by 2D-3D CoENet for other slices. Additionally, multi-view learning is introduced to capture more 2D local detailed information, and a Multi-view Semantic Consistency loss (MSC loss) is proposed to constrain features from multiple perspectives. To further enhance the local detailed texture features, we propose an Edge Enhancement Module (EEM) in the 3D segmentation network to enhance the edge detail features. Our experimental results on the SKI10 dataset and OAI ZIB dataset demonstrate that our method outperforms the SOTA weakly-supervised segmentation methods. Moreover, our approach achieves results that are comparable to the fully-supervised upper bound results.

关键词： Image segmentation Three-dimensional displays Costs Upper bound Annotations Image edge detection Semantics Feature extraction Encoding Biomedical imaging

Learning Generalizable Agents via Saliency-Guided Features Decorrelation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Huang, Sili Sun, Yanchao Hu, Jifeng Guo, Siyuan Chen, Hechang Chang, Yi Sun, Lichao Yang, Bo Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education China School of Artificial Intelligence Jilin University China Department of Computer Science University of Maryland College Park United States Lehigh University BethlehemPA United States

In visual-based Reinforcement Learning (RL), agents often struggle to generalize well to environmental variations in the state space that were not observed during training. The variations can arise in both task-irrelevant features, such as background noise, and task-relevant features, such as robot configurations, that are related to the optimal decisions. To achieve generalization in both situations, agents are required to accurately understand the impact of changed features on the decisions, i.e., establishing the true associations between changed features and decisions in the policy model. However, due to the inherent correlations among features in the state space, the associations between features and decisions become entangled, making it difficult for the policy to distinguish them. To this end, we propose Saliency-Guided Features Decorrelation (SGFD) to eliminate these correlations through sample reweighting. Concretely, SGFD consists of two core techniques: Random Fourier Functions (RFF) and the saliency map. RFF is utilized to estimate the complex non-linear correlations in high-dimensional images, while the saliency map is designed to identify the changed features. Under the guidance of the saliency map, SGFD employs sample reweighting to minimize the estimated correlations related to changed features, thereby achieving decorrelation in visual RL tasks. Our experimental results demonstrate that SGFD can generalize well on a wide range of test environments and significantly outperforms state-of-the-art methods in handling both task-irrelevant variations and task-relevant variations. Copyright © 2023, The Authors. All rights reserved.

关键词： Reinforcement learning

Structure- and Logic-Aware Heterogeneous Graph Learning for Recommendation

学校读者我要写书评

暂无评论

Structure- and Logic-Aware Heterogeneous Graph Learning for ...

International Conference on Data engineering

作者： Anchen Li Bo Yang Huan Huo Farookh Khadeer Hussain Guandong Xu College of Computer Science and Technology Jilin University Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education China Aalto University Espoo Finland School of Computer Science University of Technology Sydney Sydney Australia Education University of Hong Kong Hong Kong China

ISBN: (数字)9798350317152

ISBN: (纸本)9798350317169

Recently, there has been a surge in recommendations based on heterogeneous information networks (HINs), attributed to their ability to integrate complex and rich semantics. Despite this advancement, most HIN-based recommenders overlook two critical aspects. First, they often fail to consider HIN's heterophily nature, hindering the capture of non-local structures in HINs. Second, most methods lack the capability for logical reasoning. In this paper, we propose a novel structure- and logic-aware heterogeneous graph learning framework for recommender systems (SLHRec). Our SLHRec contains a structure-aware module and a logic-aware module. The former uses network geometry to construct non-local neighborhoods for nodes in HINs, and then introduces a graph neural network to integrate constructed neighbors for modeling the heterophily of HINs. The logic-aware module uses the Markov logic network (MLN) to infuse logic rules into heterogeneous graph learning, thereby boosting logic reasoning in recommendations. Furthermore, we utilize contrastive learning to model cooperative signals between modules, enabling them to complement each other. In the prediction stage, both modules contribute to generating recommendations. Compared with several strong recommender baselines, our SLHRec achieves superior performance on four real-world datasets.

关键词： Geometry Semantics Contrastive learning Data engineering Boosting Cognition Graph neural networks

HVIS: A Human-like Vision and Inference System for Human Motion Prediction

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Lyu, Kedi Chen, Haipeng Liu, Zhenguang Yin, Yifang Lin, Yukang Jiao, Yingying College of Computer Science and Technology Jilin University Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun China The State Key Laboratory of Blockchain and Data Security Zhejiang University Hangzhou China Institute of Blockchain and Data Security Hangzhou China A*STAR Singapore Tsinghua Shenzhen International Graduate School Nanshan District Shenzhen China

Grasping the intricacies of human motion, which involve perceiving spatio-temporal dependence and multi-scale effects, is essential for predicting human motion. While humans inherently possess the requisite skills to navigate this issue, it proves to be markedly more challenging for machines to emulate. To bridge the gap, we propose the Human-like Vision and Inference System (HVIS) for human motion prediction, which is designed to emulate human observation and forecast future movements. HVIS comprises two components: the human-like vision encode (HVE) module and the human-like motion inference (HMI) module. The HVE module mimics and refines the human visual process, incorporating a retina-analog component that captures spatiotemporal information separately to avoid unnecessary crosstalk. Additionally, a visual cortex-analogy component is designed to hierarchically extract and treat complex motion features, focusing on both global and local features of human poses. The HMI is employed to simulate the multi-stage learning model of the human brain. The spontaneous learning network simulates the neuronal fracture generation process for the adversarial generation of future motions. Subsequently, the deliberate learning network is optimized for hard-to-train joints to prevent misleading learning. Experimental results demonstrate that our method achieves new state-of-the-art performance, significantly outperforming existing methods by 19.8% on Human3.6M, 15.7% on CMU Mocap, and 11.1% on G3D. © 2025, CC BY.

关键词： Motion estimation

COVID-19 knowledge Graph for Drug and Vaccine Development

学校读者我要写书评

暂无评论

COVID-19 Knowledge Graph for Drug and Vaccine Development

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Lan Huang Hongrui Guan Yanchun Liang Renchu Guan Xiaoyue Feng The Key Laboratory for Symbolic Computation and Knowledge Engineering of the Ministry of Education College of Computer Science and Technology Jilin University Changchun China Zhuhai Sub Laboratory Key Laboratory of Symbolic Computation and Knowledge Engineering of the Ministry of Education Zhuhai College of Science and Technology Zhuhai China

ISBN: (纸本)9781665429825

The worldwide spread of COVID-19 has made a severe impact on human health and life. It has shown rapid propagation, long in vitro survival, and a long incubation period. More seriously, COVID-19 is more susceptible to variation, as it is an RNA virus. Mutations of COVID-19 have been reported in multiple countries worldwide, which makes drug and vaccine development a significant challenge. To search for potential drugs and vaccines and reveal the atlas of COVID-19 evolution, we extract information from massive unstructured data and construct a COVID-19 knowledge graph using the COVID-19 data. Based on machine learning approaches, we infer and predict novel coronavirus pneumonia-related diseases, drug action targets, etc. to speculate on new and more effective treatment methods. In addition, to study transcriptome of SARS-CoV-2, new ideas can be provided to biomedical experts with flexible responses to viral variation. An in-depth analysis of the COVID-19 pathomechanism at the pharmaceutical, genetic, and protein levels provides effective means and tools for novel coronavirus pneumonia vaccines, drug development, and therapeutic program design.

关键词： COVID-19 Drugs Proteins Protein engineering Pulmonary diseases RNA Machine learning

A Multi-objective Optimization Approach for Secure Communications Based on Collaborative Beamforming in UAV Networks

学校读者我要写书评

暂无评论

A Multi-objective Optimization Approach for Secure Communica...

IEEE Conference on Wireless Communications and Networking

作者： Xinrong Guo Fang Mei Geng Sun Tingting Zheng College of Software Jilin University Changchun China College of Computer Science and Technology Jilin University Changchun China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun China College of Electrical and Computer Engineering University of Waterloo Waterloo Canada

With the rapid development of wireless communication, unmanned aerial vehicle (UAV) networks have received extensive attention and been applied in many fields, but some challenges exist in their applications, such as the issue of security when implementing communication. In this paper, a virtual antenna array (VAA) is formed in multiple UAV units using collaborative beamforming (CB) technology. Under the interference of multiple eavesdroppers, secure communication with the ground base station (BS) is achieved. To achieve better performance, we formulate a multi-objective optimization problem for UAV network security communication (SCMOP), and jointly optimize the positions and excitation current weights of UAVs to set the null values in the direction of known eavesdroppers, reduce the sidelobe levels (SLLs) and enhance the directivity of the main lobe (ML). Since the formulated SCMOP is an NP-hard problem, we propose an improved the third non-dominated sorting genetic algorithm (IMNSGA-III) with chaos operator and crossover and mutation operators to solve the problem in this paper. The simulation results show that the IMNSGA-III can solve the SCMOP well and obtain the best results compared with other benchmark algorithms.

关键词： Chaos Wireless communication Array signal processing Null value Collaboration Autonomous aerial vehicles Statistics

UAV-assisted Joint Mobile Edge Computing and Data Collection via Matching-enabled Deep Reinforcement Learning

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wang, Boxiong Kang, Hui Li, Jiahui Sun, Geng Sun, Zemin Wang, Jiacheng Niyato, Dusit College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Computing and Data Science Nanyang Technological University 639798 Singapore College of Computing and Data Science Nanyang Technological University Singapore

Unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC) and data collection (DC) have been popular research issues. Different from existing works that consider MEC and DC scenarios separately, this paper investigates a multi-UAV-assisted joint MEC-DC system. Specifically, we formulate a joint optimization problem to minimize the MEC latency and maximize the collected data volume. This problem can be classified as a non-convex mixed integer programming problem that exhibits long-term optimization and dynamics. Thus, we propose a deep reinforcement learning-based approach that jointly optimizes the UAV movement, user transmit power, and user association in real time to solve the problem efficiently. Specifically, we reformulate the optimization problem into an action space-reduced Markov decision process (MDP) and optimize the user association by using a two-phase matching-based association (TMA) strategy. Subsequently, we propose a soft actor-critic (SAC)-based approach that integrates the proposed TMA strategy (SAC-TMA) to solve the formulated joint optimization problem collaboratively. Simulation results demonstrate that the proposed SAC-TMA is able to coordinate the two subsystems and can effectively reduce the system latency and improve the data collection volume compared with other benchmark algorithms. Copyright © 2025, The Authors. All rights reserved.

关键词： Unmanned aerial vehicles (UAV)

A Lightweight Api Recommendation Method for App Development Based on Multi-Objective Evolutionary Algorithm

学校读者我要写书评

暂无评论

SSRN

SSRN 2022年

作者： Li, Xun Liu, Lei Liu, Yuzhou Liu, Huaxiao College of Computer Science and Technology Jilin University Jilin130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Changchun Jilin University Jilin130012 China

Context: API is important in daily programming activities during app development, but finding appropriate APIs is time-consuming for developers. To simplify this process, many researchers pay attention to overcoming the task-API knowledge gap using semantic information mined from the large-scale dataset for API recommendation. However, only semantic information is not enough since API descriptions and developer's query may not share similar words, meanwhile, large-scale data mining brings huge time cost and causes knowledge fixed problem (i.e. data cannot be timely updated). This limits the efficiency of existing API commendation methods. Objective: In this work, we aim at proposing a lightweight API recommendation method for app development based on the data in app store. Method: We model API recommendation as a multi-objective optimization problem by considering both structural and semantic information of API, and use the genetic algorithm to gain optimal solutions for overcoming limitations of the small-scale dataset. Specially, we collect APK files of related apps and API descriptions to establish a lightweight dataset, and extract the structural and semantic information of API from them with graph embedding and NLP techniques respectively. Then, we get the recommended APIs satisfying structural and semantic objectives according to the developers’ target functionality with a genetic algorithm. Finally, we give the interpretation of our recommendation information to help developers understand the results easily. Results and Conclusion: We conduct a series of experiments based on apps in Google Play and Q&As in Stack Overflow. The results show that Precision@N of our recommendation can be up to 0.89, MAP@N is up to 0.50, and MRR reaches 0.69, and our method achieves such good performance only utilizing less than 1/19 of the project number of our compared machine learning method. Besides, we conduct a survey and most of the participants confirm the understandabilit

关键词： Multiobjective optimization