检索结果-内蒙古大学图书馆

GraphInstruct: Empowering Large Language Models with Graph Understanding and Reasoning Capability

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Luo, Zihan Song, Xiran Huang, Hong Lian, Jianxun Zhang, Chenhao Jiang, Jinqi Xie, Xing Huazhong University of Science and Technology Wuhan China Microsoft Research Asia Beijing China The National Engineering Research Center for Big Data Technology and System Service Computing Technology and Systems Laboratory Cluster and Grid Computing Lab School of Computer Science and Technology Huazhong University of Science and Technology China

Evaluating and enhancing the general capabilities of large language models (LLMs) has been an important research topic. Graph is a common data structure in the real world, and understanding graph data is a crucial part for advancing general intelligence. To evaluate and enhance the graph understanding abilities of LLMs, in this paper, we propose a benchmark named GraphInstruct, which comprehensively includes 21 classical graph reasoning tasks, providing diverse graph generation pipelines and detailed reasoning steps. Based on GraphInstruct, we further construct GraphLM through efficient instruction-tuning, which shows prominent graph understanding capability. In order to enhance the LLM with graph reasoning capability as well, we propose a step mask training strategy, and construct a model named GraphLM+. As one of the pioneering efforts to enhance the graph understanding and reasoning abilities of LLMs, extensive experiments have demonstrated the superiority of GraphLM and GraphLM+ over other LLMs. We look forward to more researchers exploring the potential of LLMs in the graph data mining domain through GraphInstruct. Our code for generating GraphInstruct is released publicly at: https://***/CGCL-codes/GraphInstruct. Copyright © 2024, The Authors. All rights reserved.

关键词： Computational linguistics

SSC- l0 : Sparse Subspace Clustering with the l0 Inequality Constraint 7th

学校读者我要写书评

暂无评论

SSC- l0 : Sparse Subspace Clustering with the l0 Inequality...

7th Asian Conference on Pattern Recognition, ACPR 2023

作者： Wang, Yangbo Zhou, Jie Lin, Qingshui Lu, Jianglin Gao, Can National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen518060 China College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China SZU Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518060 China Basic Teaching Department Liaoning Technical University Huludao125105 China College of Engineering Northeastern University BostonMA02115 United States

ISBN: (纸本)9783031476648

Self-expression learning methods often obtain a coefficient matrix to measure the similarity between pairs of samples. However, directly using all points to represent a fixed sample in a class under the self-expression framework may not be ideal, as points from other classes participate in the representing process. To alleviate this issue, this study attempts to achieve representation learning between points only coming from the same class. In practice, it is easier for data points from the same class to represent each other than that from different classes. So, when reconstructing a point, if the number of non-zero elements in the coefficient vector is limited, a model is more likely to select data points from the class where the reconstructed point lies to complete the reconstruction work. Based on this idea, we propose Sparse Subspace Clustering with the l0 inequality constraint (SSC- l0 ). In SSC- l0, the l0 inequality constraint determines the maximum number of non-zero elements in the coefficient vector, which helps SSC- l0 to conduct representation learning among the points in the same class. After introducing the simplex constraint to ensure the translation invariance of the model, an optimization method concerning l0 inequality constraint is formed to solve the proposed SSC- l0, and its convergence is theoretically analyzed. Extensive experiments on well-known datasets demonstrate the superiority of SSC- l0 compared to several state-of-the-art methods. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2023.

关键词： Learning systems

Accumulative time-based ranking method to reputation evaluation in information networks

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Liao, Hao Liu, Qi-Xin Huang, Ze-Cheng Yeung, Chi Ho Zhang, Yi-Cheng National Engineering Laboratory on Big Data System Computing Technology Guangdong Province Engineering Center of China-made High Performance Data Computing System College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Institute of Big Data Intelligent Management and Decision Shenzhen University Shenzhen518060 China Department of Science and Environmental Studies The Education University of Hong Kong Hong Kong Hong Kong Department of Physics University of Fribourg Fribourg Switzerland

With the rapid development of modern technology, the Web has become an important platform for users to make friends and acquire information. However, since information on the Web is over-abundant, information filtering becomes a key task for online users to obtain relevant suggestions. As most Websites can be ranked according to users’ rating and preferences, relevance to queries, and recency, how to extract the most relevant item from the over-abundant information is always a key topic for researchers in various fields. In this paper, we adopt tools used to analyze complex networks to evaluate user reputation and item quality. In our proposed accumulative time-based ranking (ATR) algorithm, we incorporate two behavioral weighting factors which are updated when users select or rate items, to reflect the evolution of user reputation and item quality over time. We showed that our algorithm outperforms state-of-the-art ranking algorithms in terms of precision and robustness on empirical datasets from various online retailers and the citation datasets among research publications. Copyright © 2019, The Authors. All rights reserved.

关键词： Information filtering

Graph-Augmented Contrastive Clustering for Time Series data

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Zhang, Qin Liang, Zhuoluo Ngueilbaye, Alladoumbaye Zhang, Peng Chen, Junyang Chen, Xiaojun Huang, Joshua Zhexue College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen518060 China Cyberspace Institute of Advanced Technology Guangzhou University Guangzhou510006 China

The recent emergence of time series contrastive clustering methods can be categorized into two classes. The first class uses contrastive learning for universal representations, which can be effective in various downstream tasks, but overlooks important categorical information and clustering objectives, leading to unsuitable models. The second class incorporates contrastive learning into clustering objectives but fails to fully explore potential connections and structures between time series data. To this end, we propose the "Time Series Graph-augmented Contrastive Clustering (TSGCC) method", a graph-augmented contrastive learning framework aiming to create cluster-friendly features and assignments by iteratively optimizing contrastive loss. The method uses a weighted KNN graph to build positive and negative sample pairs, projecting the instances into a feature space with the dimensionality number of clusters. Experimental results demonstrate that TSGCC outperforms 18 advanced time-series clustering methods on the 36 representatives out of the 128 UCR benchmarks, achieving the best clustering results on 12 datasets, with the highest average rank (3.22) of RI and the second-highest average rank (3.89) of NMI among 18 clustering methods. We further compared our method with recent approaches on the entire set of 128 UCR datasets, demonstrating our method's broad applicability and effectiveness. © 2024, The Authors. All rights reserved.

关键词： Time series

Modeling heterogeneous edges to represent networks with graph auto-encoder

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Wang, Lu Song, Yu Huang, Hong Ye, Fanghua Shi, Xuanhua Jin, Hai National Engineering Research Center for Big Data Technology and System Wuhan China Service Computing Technology and Systems Laboratory Wuhan China School of Computer Science and Technology Huazhong University of Science and Technology Wuhan China School of Computer Science University College London London United Kingdom

In the real world, networks often contain multiple relationships among nodes, manifested as the heterogeneity of the edges in the networks. We convert the heterogeneous networks into multiple views by using each view to describe a specific type of relationship between nodes, so that we can leverage the collaboration of multiple views to learn the representation of networks with heterogeneous edges. Given this, we propose a regularized graph auto-encoders (RGAE) model, committed to utilizing abundant information in multiple views to learn robust network representations. More specifically, RGAE designs shared and private graph auto-encoders as main components to capture high-order nonlinear structure information of the networks. Besides, two loss functions serve as regularization to extract consistent and unique information, respectively. Concrete experimental results on realistic datasets indicate that our model outperforms state-of-the-art baselines in practical applications. © 2021, CC BY.

关键词： Deep learning

Graph-Augmented Contrastive Clustering for Time Series

学校读者我要写书评

暂无评论

SSRN

SSRN 2023年

The recent emergence of time series contrastive clustering methods can be categorized into two classes. The first class uses contrastive learning for universal representations, which can be effective in various downstream tasks, but overlooks important categorical information and clustering objectives, leading to unsuitable models. The second class incorporates contrastive learning into clustering objectives, but fails to fully explore potential connections and structures between time series data. To this end, we propose the "Time Series Graph-augmented Contrastive Clustering (TSGCC) method", a graph-augmented contrastive learning framework aiming to create cluster-friendly features and assignments by iteratively optimizing contrastive loss. The method uses a weighted KNN graph to build positive and negative sample pairs, projecting the instances into a feature space with the dimensionality number of clusters. Experimental results demonstrate that TSGCC outperforms 18 advanced time-series clustering methods on the 36 representatives out of the 128 UCR benchmarks, achieving the best clustering results on 12 datasets, with the highest average rank (3.22) of RI and the second-highest average rank (3.89) of NMI among 18 clustering methods. We further compared our method with recent approaches on the entire set of 128 UCR datasets, demonstrating our method's broad applicability and effectiveness. © 2023, The Authors. All rights reserved.

关键词： Time series

A Cooperative Co-Evolution Algorithm with Variable-Importance Grouping for Large-Scale Optimization 13

学校读者我要写书评

暂无评论

A Cooperative Co-Evolution Algorithm with Variable-Importanc...

13th IEEE Congress on Evolutionary Computation, CEC 2024

作者： Li, Yongfeng Zhang, Yuze Ma, Lijia Ji, Junkai Liu, Dugang Leung, Victor C. M. Li, Jianqiang Shenzhen University National Engineering Laboratory for Big Data System Computing Technology Shenzhen518060 China Guangdong Laboratory of Artificial Intelligence and Digital Economy Shenzhen518123 China College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Artificial Intelligence Research Institute Shenzhen MSU-BIT University Shenzhen518172 China The University of British Columbia Department of Electrical and Computer Engineering VancouverV6T 1Z4 Canada

ISBN: (纸本)9798350308365

Cooperative co-evolution (CC) is a promising direction in solving large-scale multiobjective optimization problems (LMOPs). However, most existing methods of grouping decision variables face some difficulties when searching in the huge search space. Specifically, the methods of grouping decision variables can be classified into two types, i.e., high-consumption grouping methods and non-consumption grouping methods. On the one hand, the former ones divide the decision variables into different groups based on the correlation analysis between variables, which consume much evaluation. This way may lead to premature convergence within limited computational resources. On the other hand, the later ones allocate the decision variables into sub-groups based on some metrics, e.g., order and size, which consume no evaluation while may cause the search fall into local optima. To alleviate the above issues, this paper proposes a CC-based algorithm with a variable-importance grouping (VIG) method, called VICCA. Firstly, the decision variables are classified into several subgroups according to their importance quantified by a meta-gene construction method. Secondly, a CC strategy is designed to simultaneously optimize all subgroups of decision variables formed by VIG using the differential evolution operator, which aims to accelerate the convergence speed. Thirdly, a global evolutionary strategy is proposed to optimize original decision variable space by the competitive swarm optimizer, aiming to maintain the diversity. Finally, the experiments demonstrate that our proposed VICCA has the significant advantage in solving LMOPs when compared with state-of-the-art evolutionary algorithms. © 2024 IEEE.

关键词： Optimization algorithms

PHD: A Deep Learning Based Human Detection Framework for Panoramic Videos

学校读者我要写书评

暂无评论

PHD: A Deep Learning Based Human Detection Framework for Pan...

International Conference on Wireless Communications and Signal Processing (WCSP)

作者： Jinting Tang Zhenhui Chen Yongkai Huo Peichang Zhang National Engineering Laboratory for Big Data System Computing Technology Research Institute for Future Media Computing School of Computer Science and Software Engineering Shenzhen University Shenzhen China The College of Information Engineering Shenzhen University Shenzhen China

Panoramic video has attracted substantial research attention as the coming video format. It is capable of providing 360 degree immersive experience of omnidirectional visual information. State-of-the-art detection networks may fail to detect humans on spherical images, which are normally represented in deformed rectangular shapes. In this paper, we propose a socalled Panoramic Human Detection (PHD) scheme to address the task of human detection in panoramic videos. Moreover, the PHD method is designed to detect humans by extracting multiple overlapping sub-images from each integral spherical image, where three-dimensional rotation of spherical images is employed to ensure consistency of sub-images. Two detection box filters are designed for removing redundant boxes. Our PHD method is capable of accomplishing the task of human detection in various panoramic video types. Experiments prove that our PHD method outperforms the baseline by 35% and 48.6% in terms of precision and recall, respectively.

关键词： Videos Task analysis Feature extraction Matrices Visualization Strain Transmission line matrix methods

VARIATIONAL AUTO-ENCODER BASED SOLUTIONS TO INTERACTIVE DYNAMIC INFLUENCE DIAGRAMS

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Pan, Yinghui Ma, Biyang Zhang, Hanyi Zeng, Yifeng National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen China School of Computer Science Minnan Normal University Zhangzhou China Department of Computer and Information Sciences Northumbria University Newcastle United Kingdom

Addressing multiagent decision problems in AI, especially those involving collaborative or competitive agents acting concurrently in a partially observable and stochastic environment, remains a formidable challenge. While Interactive Dynamic Influence Diagrams (I-DIDs) have offered a promising decision framework for such problems, they encounter limitations when the subject agent encounters unknown behaviors exhibited by other agents that are not explicitly modeled within the I-DID. This can lead to sub-optimal responses from the subject agent. In this paper, we propose a novel data-driven approach that utilizes an encoder-decoder architecture, particularly a variational autoencoder, to enhance I-DID solutions. By integrating a perplexity-based tree loss function into the optimization algorithm of the variational autoencoder, coupled with the advantages of Zig-Zag One-Hot encoding and decoding, we generate potential behaviors of other agents within the I-DID that are more likely to contain their true behaviors, even from limited interactions. This new approach enables the subject agent to respond more appropriately to unknown behaviors, thus improving its decision quality. We empirically demonstrate the effectiveness of the proposed approach in two well-established problem domains, highlighting its potential for handling multi-agent decision problems with unknown behaviors. This work is the first time of using neural networks based approaches to deal with the I-DID challenge in agent planning and learning problems. © 2024, CC BY.

关键词： Decoding