检索结果-内蒙古大学图书馆

SEA: Sentence encoder assembly for video retrieval by textual queries

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Li, Xirong Zhou, Fangming Xu, Chaoxi Ji, Jiaqi Yang, Gang Key Lab of Data Engineering and Knowledge Engineering AI & Media Computing Lab School of Information Renmin University of China Beijing100872 China

Retrieving unlabeled videos by textual queries, known as Ad-hoc Video Search (AVS), is a core theme in multimedia data management and retrieval. The success of AVS counts on cross-modal representation learning that encodes both query sentences and videos into common spaces for semantic similarity computation. Inspired by the initial success of previously few works in combining multiple sentence encoders, this paper takes a step forward by developing a new and general method for effectively exploiting diverse sentence encoders. The novelty of the proposed method, which we term Sentence Encoder Assembly (SEA), is two-fold. First, different from prior art that use only a single common space, SEA supports text-video matching in multiple encoder-specific common spaces. Such a property prevents the matching from being dominated by a specific encoder that produces an encoding vector much longer than other encoders. Second, in order to explore complementarities among the individual common spaces, we propose multi-space multi-loss learning. As extensive experiments on four benchmarks (MSR-VTT, TRECVID AVS 2016-2019, TGIF and MSVD) show, SEA surpasses the state-of-the-art. In addition, SEA is extremely ease to implement. All this makes SEA an appealing solution for AVS and promising for continuously advancing the task by harvesting new sentence encoders. © 2020, CC-BY.

关键词： Signal encoding

Measuring Semantic Associaiton in Domain Ontology

学校读者我要写书评

暂无评论

Measuring Semantic Associaiton in Domain Ontology

International Conference on Semantics, knowledge and Grid (SKG)

作者： Xuan Tian Haihua Li Xiaoyong Du School of Information Renmin University of China Beijing China Key Laboratory of Data Engineering and Knowledge Engineering MOESchool of Information Renmin University of China Beijing China

In domain ontology, semantic association (SA) is used to depict the correlation between two concepts. In this paper, we define semantic association degree (SAD) for measuring SA in the domain ontology. We first present a method to measure SAD of two direct related concepts by evaluating the semantic relationship between them, and then give another method to measure SAD of two indirect related concepts though SAD of two directed neighboring concepts. A set of comparison experiments show the benefit of our approaches.

关键词： Ontologies Psychology data mining Diseases Information retrieval laboratories data engineering knowledge engineering Text categorization History

Random analysis of statistical rough set

学校读者我要写书评

暂无评论

Random analysis of statistical rough set

International Conference on Machine Learning and Cybernetics (ICMLC)

作者： Eric C. C. Tsang Su-Yun Zhao Faculty of Information Technology Macau University of Science and Technology Macau China MOE Key Laboratory of Data Engineering and Knowledge Engineering (Renmin University of China) Beijing China

ISBN: (纸本)9781509003914

Attribute reduction is an inevitable problem in machine learning and statistical learning. To improve the traditional rough set reduction, statistical rough sets is then proposed by introducing random sampling into the rough approximation. Random sampling is the main contribution of statistical rough sets. As a result, it is necessary to analyze the randomness of statistical rough sets. In this paper, we analyze and demonstrate the influence of the randomness in the process of attribute reduction by a large number of experiments to test the effectiveness and stability of the random sampling.

关键词： Rough sets Standards Cybernetics Fluctuations Stability analysis Big data Algorithm design and analysis

USER: A unified information search and recommendation model based on integrated behavior sequence

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Yao, Jing Dou, Zhicheng Xie, Ruobing Lu, Yanxiong Wang, Zhiping Wen, Ji-Rong Gaoling School of Artificial Intelligence Renmin University of China WeChat Search Application Department Tencent China Beijing Key Laboratory of Big Data Management and Analysis Methods Key Laboratory of Data Engineering and Knowledge Engineering MOE

Search and recommendation are the two most common approaches used by people to obtain information. They share the same goal - satisfying the user's information need at the right time. There are already a lot of Internet platforms and Apps providing both search and recommendation services, showing us the demand and opportunity to simultaneously handle both tasks. However, most platforms consider these two tasks independently - they tend to train separate search model and recommendation model, without exploiting the relatedness and dependency between them. In this paper, we argue that jointly modeling these two tasks will benefit both of them and finally improve overall user satisfaction. We investigate the interactions between these two tasks in the specific information content service domain. We propose first integrating the user's behaviors in search and recommendation into a heterogeneous behavior sequence, then utilizing a joint model for handling both tasks based on the unified sequence. More specifically, we design the Unified Information SEarch and Recommendation model (USER), which mines user interests from the integrated sequence and accomplish the two tasks in a unified way. Experiments on a dataset from a real-world information content service platform verify that our model outperforms separate search and recommendation baselines. Copyright © 2021, The Authors. All rights reserved.

关键词： Recommender systems

Personalizing search results using hierarchical RNN with query-aware attention

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Ge, Songwei Dou, Zhicheng Jiang, Zhengbao Nie, Jian-Yun Wen, Ji-Rong School of Information Renmin University of China DIRO Université de Montréal Beijing Key Laboratory of Big Data Management and Analysis Methods National Engineering Laboratory of Big Data System Software Beijing Institute of Technology Key Laboratory of Data Engineering and Knowledge Engineering MOE

Search results personalization has become an effective way to improve the quality of search engines. Previous studies extracted information such as past clicks, user topical interests, query click entropy and so on to tailor the original ranking. However, few studies have taken into account the sequential information underlying previous queries and sessions. Intuitively, the order of issued queries is important in inferring the real user interests. And more recent sessions should provide more reliable personal signals than older sessions. In addition, the previous search history and user behaviors should influence the personalization of the current query depending on their relatedness. To implement these intuitions, in this paper we employ a hierarchical recurrent neural network to exploit such sequential information and automatically generate user profile from historical data. We propose a query-aware attention model to generate a dynamic user profile based on the input query. Significant improvement is observed in the experiment with data from a commercial search engine when compared with several traditional personalization models. Our analysis reveals that the attention model is able to attribute higher weights to more related past sessions after fine training. Copyright © 2019, The Authors. All rights reserved.

关键词： Search engines

Image Manipulation Detection by Multi-View Multi-Scale Supervision

学校读者我要写书评

暂无评论

Image Manipulation Detection by Multi-View Multi-Scale Super...

International Conference on Computer Vision (ICCV)

作者： Xinru Chen Chengbo Dong Jiaqi Ji Juan Cao Xirong Li MoE Key Lab of Data Engineering and Knowledge Engineering Renmin University of China AIMC Lab School of Information Renmin University of China Institute of Computing Technology Chinese Academy of Sciences State Key Laboratory of Media Convergence Production Technology and Systems

ISBN: (纸本)9781665428132

The key challenge of image manipulation detection is how to learn generalizable features that are sensitive to manipulations in novel data, whilst specific to prevent false alarms on authentic images. Current research emphasizes the sensitivity, with the specificity overlooked. In this paper we address both aspects by multi-view feature learning and multi-scale supervision. By exploiting noise distribution and boundary artifact surrounding tampered regions, the former aims to learn semantic-agnostic and thus more generalizable features. The latter allows us to learn from authentic images which are nontrivial to be taken into account by current semantic segmentation network based methods. Our thoughts are realized by a new network which we term MVSS-Net. Extensive experiments on five benchmark sets justify the viability of MVSS-Net for both pixel-level and image-level manipulation detection.

关键词： Representation learning Image segmentation Computer vision Sensitivity Costs Image edge detection Semantics

Simple and Deep Graph Convolutional Networks

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Chen, Ming Wei, Zhewei Huang, Zengfeng Ding, Bolin Li, Yaliang School of Information Renmin University of China China Gaoling School of Articial Intelligence Renmin University of China China Beijing Key Lab of Big Data Management and Analysis Methods China MOE Key Lab of Data Engineering and Knowledge Engineering China School of Data Science Fudan University China Alibaba Group

Graph convolutional networks (GCNs) are a powerful deep learning approach for graph-structured data. Recently, GCNs and subsequent variants have shown superior performance in various application areas on real-world datasets. Despite their success, most of the current GCN models are shallow, due to the over-smoothing problem. In this paper, we study the problem of designing and analyzing deep graph convolutional networks. We propose the GCNII, an extension of the vanilla GCN model with two simple yet effective techniques: Initial residual and Identity mapping. We provide theoretical and empirical evidence that the two techniques effectively relieves the problem of over-smoothing. Our experiments show that the deep GCNII model outperforms the state-of-the-art methods on various semi- and full-supervised tasks. Code is available at https://***/chennnM/GCNII. Copyright © 2020, The Authors. All rights reserved.

关键词： Convolutional neural networks

Image manipulation detection by multi-view multi-scale supervision

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Chen, Xinru Dong, Chengbo Ji, Jiaqi Cao, Juan Li, Xirong MoE Key Lab of Data Engineering and Knowledge Engineering Renmin University of China AIMC Lab School of Information Renmin University of China Institute of Computing Technology Chinese Academy of Sciences State Key Laboratory of Media Convergence Production Technology and Systems

关键词： Semantic Segmentation

Pre-training for ad-hoc retrieval: Hyperlink is also you need

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Ma, Zhengyi Dou, Zhicheng Xu, Wei Zhang, Xinyu Jiang, Hao Cao, Zhao Wen, Ji-Rong Gaoling School of Artificial Intelligence Renmin University of China Beijing China Distributed and Parallel Software Lab Huawei Beijing Key Laboratory of Big Data Management and Analysis Methods Beijing China Key Laboratory of Data Engineering and Knowledge Engineering MOE Beijing China

Designing pre-training objectives that more closely resemble the downstream tasks for pre-trained language models can lead to better performance at the fine-tuning stage, especially in the ad-hoc retrieval area. Existing pre-training approaches tailored for IR tried to incorporate weak supervised signals, such as query-likelihood based sampling, to construct pseudo query-document pairs from the raw textual corpus. However, these signals rely heavily on the sampling method. For example, the query likelihood model may lead to much noise in the constructed pre-training data. In this paper, we propose to leverage the large-scale hyperlinks and anchor texts to pre-train the language model for ad-hoc retrieval. Since the anchor texts are created by webmasters and can usually summarize the target document, it can help to build more accurate and reliable pre-training samples than a specific algorithm. Considering different views of the downstream ad-hoc retrieval, we devise four pre-training tasks based on the hyperlinks. We then pre-train the Transformer model to predict the pair-wise preference, jointly with the Masked Language Model objective. Experimental results on two large-scale ad-hoc retrieval datasets show the significant improvement of our model compared with the existing methods. Copyright © 2021, The Authors. All rights reserved.

关键词： Hypertext systems