检索结果-内蒙古大学图书馆

More Grounded Image Captioning by Distilling Image-Text Matching Model

学校读者我要写书评

暂无评论

More Grounded Image Captioning by Distilling Image-Text Matc...

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Yuanen Zhou Meng Wang Daqing Liu Zhenzhen Hu Hanwang Zhang Key Laboratory of Knowledge Engineering with Big Data (Ministry of Education) School of Computer Science and Information Engineering Hefei University of Technology University of Science and Technology of China Nanyang Technological University

ISBN: (数字)9781728171685

ISBN: (纸本)9781728171692

Visual attention not only improves the performance of image captioners, but also serves as a visual interpretation to qualitatively measure the caption rationality and model transparency. Specifically, we expect that a captioner can fix its attentive gaze on the correct objects while generating the corresponding words. This ability is also known as grounded image captioning. However, the grounding accuracy of existing captioners is far from *** improve the grounding accuracy while retaining the captioning quality, it is expensive to collect the word-region alignment as strong *** this end, we propose a Part-of-Speech (POS) enhanced image-text matching model (SCAN[24]): POS-SCAN, as the effective knowledge distillation for more grounded image captioning. The benefits are two-fold: 1) given a sentence and an image, POS-SCAN can ground the objects more accurately than SCAN; 2) POS-SCAN serves as a word-region alignment regularization for the captioner's visual attention module. By showing benchmark experimental results, we demonstrate that conventional image captioners equipped with POS-SCAN can significantly improve the grounding accuracy without strong supervision. Last but not the least, we explore the indispensable Self-Critical Sequence Training (SCST[46]) in the context of grounded image captioning and show that the image-text matching score can serve as a reward for more grounded captioning 1 .

关键词： Visualization Grounding Task analysis Training Measurement Computational modeling Image edge detection

Disentangled Cascaded Graph Convolution Networks for Multi-Behavior Recommendation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Cheng, Zhiyong Dong, Jianhua Liu, Fan Zhu, Lei Yang, Xun Wang, Meng School of Computer Science and Information Engineering Hefei University of Technology No. 485 Danxia Road Anhui Hefei230009 China Shandong Artificial Intelligence Institute Qilu University of Technology Shandong Academy of Sciences No. 19 Keyuan Road Shandong Jinan250014 China School of Computing National University of Singapore 21 Lower Kent Ridge Road Singapore119077 Singapore School of Electronic and Information Engineering University of Tongji No. 4800 Caoan Road Shanghai201804 China School of Information Science and Technology University of Science and Technology of China No. 443 Huangshan Road Anhui Hefei230027 China Key Laboratory of Knowledge Engineering with Big Data Hefei University of Technology Institute of Artificial Intelligence Hefei Comprehensive National Science Centery No. 485 Danxia Road Anhui Hefei230009 China

Multi-behavioral recommender systems have emerged as a solution to address data sparsity and cold-start issues by incorporating auxiliary behaviors alongside target behaviors. However, existing models struggle to accurately capture varying user preferences across different behaviors and fail to account for diverse item preferences within behaviors. Various user preference factors (such as price or quality) entangled in the behavior may lead to sub-optimization problems. Furthermore, these models overlook the personalized nature of user behavioral preferences by employing uniform transformation networks for all users and items. To tackle these challenges, we propose the Disentangled Cascaded Graph Convolutional Network (Disen-CGCN), a novel multi-behavior recommendation model. Disen-CGCN employs disentangled representation techniques to effectively separate factors within user and item representations, ensuring their independence. In addition, it incorporates a multi-behavioral meta-network, enabling personalized feature transformation across user and item behaviors. Furthermore, an attention mechanism captures user preferences for different item factors within each behavior. By leveraging attention weights, we aggregate user and item embeddings separately for each behavior, computing preference scores that predict overall user preferences for items. Our evaluation on benchmark datasets demonstrates the superiority of Disen-CGCN over state-of-the-art models, showcasing an average performance improvement of 7.07% and 9.00% on respective datasets. These results highlight Disen-CGCN’s ability to effectively leverage multi-behavioral data, leading to more accurate recommendations. Copyright © 2024, The Authors. All rights reserved.

关键词： Recommender systems

Active Learning with Multi-granular Graph Auto-Encoder

学校读者我要写书评

暂无评论

Active Learning with Multi-granular Graph Auto-Encoder

IEEE International Conference on data Mining (ICDM)

作者： Yi He Xu Yuan Nian-Feng Tzeng Xindong Wu Center for Advanced Computer Studies University of Louisiana Lafayette Key Laboratory of Knowledge Engineering with Big Data Hefei University of Technology Mininglamp Academy of Sciences Mininglamp Technology

ISBN: (数字)9781728183169

ISBN: (纸本)9781728183176

Predictive modeling of networked data finds many real-world applications, such as fraud detection in social networks, drug discovery in biomedical networks, paper topic classification in citation networks, and so forth. Although the advanced machine learning approaches can help build reasonably accurate predictive models, their applicability is immensely hindered by the data labeling tasks, which are onerous, time-consuming, and error-prone. In this paper, we propose a novel active learning paradigm for networked data, named topology-and-content-aware (TACA) active learning, aiming to minimize the number of labels while achieving a desirable level of model accuracy. Overall, TACA advances existing works from two aspects: (1) TACA makes no assumption on the network property, whereas most existing works only perform effectively on a locally consistent network in which linked nodes are expected to share the same labels and (2) TACA generates queries without relying on model performance, thereby enjoying robust predictive results even when noises exist in the queried labels. Both theoretical and empirical evidences are presented, substantiating the effectiveness of and optimism our approach.

关键词： Social networking (online) Neural networks Predictive models data models Labeling Noise measurement Task analysis

Iterative context-aware graph inference for visual dialog

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Guo, Dan Wang, Hui Zhang, Hanwang Zha, Zheng-Jun Wang, Meng Key Laboratory of Knowledge Engineering with Big Data Hefei University of Technology School of Computer Science and Information Engineering Hefei University of Technology Nanyang Technological University University of Science and Technology of China

Visual dialog is a challenging task that requires the comprehension of the semantic dependencies among implicit visual and textual contexts. This task can refer to the relation inference in a graphical model with sparse contexts and unknown graph structure (relation descriptor), and how to model the underlying context-aware relation inference is critical. To this end, we propose a novel Context-Aware Graph (CAG) neural network. Each node in the graph corresponds to a joint semantic feature, including both object-based (visual) and history-related (textual) context representations. The graph structure (relations in dialog) is iteratively updated using an adaptive top-K message passing mechanism. Specifically, in every message passing step, each node selects the most K relevant nodes, and only receives messages from them. Then, after the update, we impose graph attention on all the nodes to get the final graph embedding and infer the answer. In CAG, each node has dynamic relations in the graph (different related K neighbor nodes), and only the most relevant nodes are attributive to the context-aware relational graph inference. Experimental results on VisDial v0.9 and v1.0 datasets show that CAG outperforms comparative methods. Visualization results further validate the interpretability of our method. Copyright © 2020, The Authors. All rights reserved.

关键词： Message passing

Balanced Tree Partitioning with Succinct Logic

学校读者我要写书评

暂无评论

Balanced Tree Partitioning with Succinct Logic

IEEE International Conference on Big knowledge (ICBK)

作者： Xindong Wu Shaojing Sheng Peng Zhou Key Laboratory of Knowledge Engineering with Big Data (Heifei Unversity of Technology) Ministry of Education Heifei China School of Compuster Science and Technology Anhui University Heifei China

ISBN: (数字)9781728181561

ISBN: (纸本)9781728181578

As a widely used data structure, graphs are good at characterizing data with internal associations, such as social and biological data. Tree structured data are special and are widely used in many real-world applications, such as organizational structure analysis and genealogical knowledge graph reasoning. For example, in kinship knowledge graph analysis, when a genealogical tree is particularly large (more than 25 levels and 45,000 nodes), it is a great challenge to partition this large tree into a specified number of subtrees with succinct logic and a balanced number of nodes. Therefore, in this paper, we propose the TPA (tree partitioning algorithm) algorithm to achieve a balanced and succinct logic partition of large-scale tree structured data. TPA first extracts all related nodes from a massive graph database and then constructs the convergent subgraph into a complete tree with a specified root node. Specifically, several virtual nodes are supplemented for generation-skipping connected nodes to achieve correct node numbering and partitioning. Finally, a graph partitioning algorithm is executed on the complete tree to obtain a specified number of subtrees with succinct logic and balanced node scales. Experiments conducted on four real-world datasets verify the effectiveness of our TPA algorithm.

关键词： Partitioning algorithms data visualization Convergence data analysis Distributed databases Big data

Towards efficient local causal structure learning

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Yang, Shuai Wang, Hao Yu, Kui Cao, Fuyuan Wu, Xindong The School of Computer Science and Information Engineering Hefei University of Technology Hefei230601 China The School of Computer and Information Technology Shanxi University Taiyuan030006 China The Key Laboratory of Knowledge Engineering With Big Data Ministry of Education Hefei University of Technology Hefei230601 China Mininglamp Academy of Sciences Mininglamp Technology Beijing100102 China

Local causal structure learning aims to discover and distinguish direct causes (parents) and direct effects (children) of a variable of interest from data. While emerging successes have been made, existing methods need to search a large space to distinguish direct causes from direct effects of a target variable T. To tackle this issue, we propose a novel Efficient Local Causal Structure learning algorithm, named ELCS. Specifically, we first propose the concept of N-structures, then design an efficient Markov Blanket (MB) discovery subroutine to integrate MB learning with N-structures to learn the MB of T and simultaneously distinguish direct causes from direct effects of T. With the proposed MB subroutine, ELCS starts from the target variable, sequentially finds MBs of variables connected to the target variable and simultaneously constructs local causal structures over MBs until the direct causes and direct effects of the target variable have been distinguished. Using eight Bayesian networks the extensive experiments have validated that ELCS achieves better accuracy and efficiency than the state-of-the-art algorithms. Copyright © 2021, The Authors. All rights reserved.

关键词： Bayesian networks

Iterative Context-Aware Graph Inference for Visual Dialog

学校读者我要写书评

暂无评论

Iterative Context-Aware Graph Inference for Visual Dialog

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Dan Guo Hui Wang Hanwang Zhang Zheng-Jun Zha Meng Wang Key Laboratory of Knowledge Engineering with Big Data Hefei University of Technology School of Computer Science and Information Engineering Hefei University of Technology Nanyang Technological University University of Science and Technology of China

ISBN: (数字)9781728171685

ISBN: (纸本)9781728171692

关键词： Visualization History Task analysis Semantics Message passing Neural networks Cognition

Combining Global and Sequential Patterns for Multivariate Time Series Forecasting

学校读者我要写书评

暂无评论

Combining Global and Sequential Patterns for Multivariate Ti...

IEEE International Conference on Big data

作者： Zhaoxi Li Jun He Hongyan Liu Xiaoyong Du Key Laboratory of Data Engineering and Knowledge Engineering Ministry of Education China School of Information Renmin University of China Beijing China School of Economics and Management Tsinghua g University Beijing China

ISBN: (数字)9781728162515

ISBN: (纸本)9781728162522

Multivariate time series forecasting is very important for many applications. Many studies have been conducted for accurate and interpretable prediction methods. However, existing methods either cannot take both times series and covariates into consideration, lacking of interpretability, or ignore global trends across multivariate time series. In this paper, we aim to solve these issues. To this end, we propose a new model named TEDGE for accurate and interpretable time series prediction. In this model, we extract global trends hidden across multivariate times series to improve prediction accuracy. Meanwhile, we utilize a deep recurrent model with attention mechanism to find long-and short-term sequential patterns hidden in individual time series with interpretability. We conduct experiments on several datasets to evaluate the proposed models performance. Results demonstrate the superior performance of our proposed model.

关键词： Conferences Time series analysis Predictive models Big data Market research data models Forecasting

Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Chen, Lei Wu, Le Hong, Richang Zhang, Kun Wang, Meng Key Laboratory of Knowledge Engineering with Big Data Hefei University of Technology School of Computer Science and Information Engineering HeFei University of Technology School of Computer Science and Technology University of Science and Technology of China

Graph Convolutional Networks (GCNs) are state-of-the-art graph based representation learning models by iteratively stacking multiple layers of convolution aggregation operations and non-linear activation operations. Recently, in Collaborative Filtering (CF) based Recommender Systems (RS), by treating the user-item interaction behavior as a bipartite graph, some researchers model higher-layer collaborative signals with GCNs. These GCN based recommender models show superior performance compared to traditional works. However, these models suffer from training difficulty with non-linear activations for large user-item graphs. Besides, most GCN based models could not model deeper layers due to the over smoothing effect with the graph convolution operation. In this paper, we revisit GCN based CF models from two aspects. First, we empirically show that removing non-linearities would enhance recommendation performance, which is consistent with the theories in simple graph convolutional networks. Second, we propose a residual network structure that is specifically designed for CF with user-item interaction modeling, which alleviates the over smoothing problem in graph convolution aggregation operation with sparse user-item interaction data. The proposed model is a linear model and it is easy to train, scale to large datasets, and yield better efficiency and effectiveness on two real datasets. We publish the source code at https://***/newlei/LRGCCF. Copyright © 2020, The Authors. All rights reserved.

关键词： Collaborative filtering