检索结果-内蒙古大学图书馆

IEEE International Conference on Data Mining (ICDM)

作者： Zhao Yang Junhong Lian Xiang Ao Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China University of Chinese Academy of Sciences Beijing China Institute of Intelligent Computing Technology Suzhou CAS

Personalized news headline generation, aiming at generating user-specific headlines based on readers’ preferences, burgeons a recent flourishing research direction. Existing studies generally inject a user interest embedding into an encoder-decoder headline generator to make the output personalized, while the factual consistency of headlines is inadequate to be verified. In this paper, we propose a framework Fact-Preserved Personalized News Headline Generation (short for FPG), to prompt a tradeoff between personalization and consistency. In FPG, the similarity between the candidate news to be exposed and the historical clicked news is used to give different levels of attention to key facts in the candidate news, and the similarity scores help to learn a fact-aware global user embedding. Besides, an additional training procedure based on contrastive learning is devised to further enhance the factual consistency of generated headlines. Extensive experiments conducted on a real-world benchmark PENS 1 validate the superiority of FPG, especially on the tradeoff between personalization and factual consistency. 1 https://***/***

关键词：

来源：评论

学校读者我要写书评

暂无评论

Masked Video Distillation: Rethinking Masked Feature Modeling for Self-supervised Video Representation Learning

arXiv

引用

arXiv 2022年

作者： Wang, Rui Chen, Dongdong Wu, Zuxuan Chen, Yinpeng Dai, Xiyang Liu, Mengchen Yuan, Lu Jiang, Yu-Gang Shanghai Key Lab of Intelligent Information Processing School of Computer Science Fudan Univeristy China Microsoft Cloud + AI

Benefiting from masked visual modeling, self-supervised video representation learning has achieved remarkable progress. However, existing methods focus on learning representations from scratch through reconstructing low-level features like raw pixel RGB values. In this paper, we propose masked video distillation (MVD), a simple yet effective two-stage masked feature modeling framework for video representation learning: firstly we pretrain an image (or video) model by recovering low-level features of masked patches, then we use the resulting features as targets for masked feature modeling. For the choice of teacher models, we observe that students taught by video teachers perform better on temporally-heavy video tasks, while image teachers transfer stronger spatial representations for spatially-heavy video tasks. Visualization analysis also indicates different teachers produce different learned patterns for students. Motivated by this observation, to leverage the advantage of different teachers, we design a spatial-temporal co-teaching method for MVD. Specifically, we distill student models from both video teachers and image teachers by masked feature modeling. Extensive experimental results demonstrate that video transformers pretrained with spatial-temporal co-teaching outperform models distilled with a single teacher on a multitude of video datasets. Our MVD with vanilla ViT achieves state-of-the-art performance compared with previous supervised or self-supervised methods on several challenging video downstream tasks. For example, with the ViT-Large model, our MVD achieves 86.4% and 76.7% Top-1 accuracy on Kinetics-400 and Something-Something-v2, outperforming VideoMAE by 1.2% and 2.4% respectively. When a larger ViT-Huge model is adopted, MVD achieves the state-of-the-art performance with 77.3% Top-1 accuracy on Something- Copyright © 2022, The Authors. All rights reserved.

关键词： Distillation

来源：评论

学校读者我要写书评

暂无评论

Non-autoregressive machine translation with probabilistic context-free grammar 23

Non-autoregressive machine translation with probabilistic co...

引用

Proceedings of the 37th International Conference on Neural information processing Systems

作者： Shangtong Gui Chenze Shao Zhengrui Ma Xishan Zhang Yunji Chen Yang Feng State Key Lab of Processors Institute of Computing Technology Chinese Academy of Sciences and Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences and University of Chinese Academy of Sciences Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences and University of Chinese Academy of Sciences State Key Lab of Processors Institute of Computing Technology Chinese Academy of Sciences and Cambricon Technologies State Key Lab of Processors Institute of Computing Technology Chinese Academy of Sciences and University of Chinese Academy of Sciences

Non-autoregressive Transformer(NAT) significantly accelerates the inference of neural machine translation. However, conventional NAT models suffer from limited expression power and performance degradation compared to autoregressive (AT) models due to the assumption of conditional independence among target tokens. To address these limitations, we propose a novel approach called PCFG-NAT, which leverages a specially designed Probabilistic Context-Free Grammar (PCFG) to enhance the ability of NAT models to capture complex dependencies among output tokens. Experimental results on major machine translation benchmarks demonstrate that PCFG-NAT further narrows the gap in translation quality between NAT and AT models. Moreover, PCFG-NAT facilitates a deeper understanding of the generated sentences, addressing the lack of satisfactory explainability in neural machine translation. Code is publicly available at https://***/ictnlp/PCFG-NAT.

关键词：

来源：评论

学校读者我要写书评

暂无评论

A Semantic Overlay on Blockchain for Supporting Traceability in Cross-border Logistics

A Semantic Overlay on Blockchain for Supporting Traceability...

引用

Digital Twins and Parallel Intelligence (DTPI), IEEE International Conference on

作者： Xiaoping Sun Key Lab of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing China

ISBN: (数字)9781665492270

ISBN: (纸本)9781665492287

Traceability is important for maintaining quality of logistics transactions and improving logistics efficiency. Implementing traceability for cross-border logistics is facing challenges when it lacks global centralized logistics information management services. Blockchain techniques enable a decentralized cross-border logistics management by publishing logistics transaction on blockchain transactions to support privacy protection and traceability. Logistics transactions involves complex interactions among participants. How to publish those interactions on a blockchain platform is a challenge. We propose a semantic overlay model that publishes a logistics transaction as a semantic link on a blockchain platform for supporting traceability. A semantic link schema model is designed and published on the blockchain platform to validate semantics links for ensuring the correctness of logistics transaction execution. The proposed semantic overlay on blockchain supports further extension of semantic computing in decentralized applications.

关键词： Privacy Overlay networks Publishing Law Computational modeling Semantics Smart contracts

来源：评论

学校读者我要写书评

暂无评论

Harnessing Hierarchical label Distribution Variations in Test Agnostic Long-tail Recognition 41

Harnessing Hierarchical Label Distribution Variations in Tes...

引用

41st International Conference on Machine Learning, ICML 2024

作者： Yang, Zhiyong Xu, Qianqian Wang, Zitai Li, Sicong Han, Boyu Bao, Shilong Cao, Xiaochun Huang, Qingming School of Computer Science and Tech. University of Chinese Academy of Sciences China Key Lab. of Intelligent Information Processing Institute of Computing Tech. CAS China Institute of Information Engineering CAS China School of Cyber Security University of Chinese Academy of Sciences China School of Cyber Science and Tech. Shenzhen Campus of Sun Yat-sen University China BDKM University of Chinese Academy of Sciences China

This paper explores test-agnostic long-tail recognition, a challenging long-tail task where the test label distributions are unknown and arbitrarily imbalanced. We argue that the variation in these distributions can be broken down hierarchically into global and local levels. The global ones reflect a broad range of diversity, while the local ones typically arise from milder changes, often focused on a particular neighbor. Traditional methods predominantly use a Mixture-of-Expert (MoE) approach, targeting a few fixed test label distributions that exhibit substantial global variations. However, the local variations are left unconsidered. To address this issue, we propose a new MoE strategy, DirMixE, which assigns experts to different Dirichlet meta-distributions of the label distribution, each targeting a specific aspect of local variations. Additionally, the diversity among these Dirichlet meta-distributions inherently captures global variations. This dual-level approach also leads to a more stable objective function, allowing us to sample different test distributions better to quantify the mean and variance of performance outcomes. Theoretically, we show that our proposed objective benefits from enhanced generalization by virtue of the variance-based regularization. Comprehensive experiments across multiple benchmarks confirm the effectiveness of DirMixE. The code is available at https://***/scongl/DirMixE. Copyright 2024 by the author(s)

关键词： Benchmarking

来源：评论

学校读者我要写书评

暂无评论

Exploiting Knowledge Embedding to Improve the Description for Image Captioning 5th

Exploiting Knowledge Embedding to Improve the Description fo...

引用

5th China Conference on Knowledge Graph, and Semantic computing, CCKS 2020

作者： Song, Dandan Peng, Cuimei Yang, Huan Liao, Lejian Beijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Applications Beijing Key Laboratory of Intelligent Information Technology School of Computer Science and Technology Beijing Institute of Technology Beijing China

ISBN: (纸本)9789811619632

Most existing methods for image captioning are based on the encoder-decoder framework which directly translates visual features into sentences, without exploiting commonsense knowledge available in the form of knowledge graph. Inspired by the success of information retrieval and question answering systems that leverage prior knowledge, we explore a knowledge embedding approach for image captioning. In this paper, we propose a Knowledge Embedding with Attention on Attention (KE-AoA) method for image captioning, which judges whether or how well the objects are related and augments semantic correlations and constraints between them. The KE-AoA method combines knowledge base method (TransE) and text method (Skip-gram), adding external knowledge graph information (triplets) into the language model to guide the learning of word vectors as the regularization term. Then it employs the AoA module to model the relations among different objects. As more inherent relations and commonsense knowledge are learned, the model can generate better image descriptions. The experiments on MSCOCO data sets achieve a significant improvement on the existing methods and validate the effectiveness of our prior knowledge-based approach. © 2021, Springer Nature Singapore Pte Ltd.

关键词： Knowledge graph

来源：评论

学校读者我要写书评

暂无评论

Ten Words Only Still Help: Improving Black-Box AI-Generated Text Detection via Proxy-Guided Efficient Re-Sampling

arXiv

引用

arXiv 2024年

作者： Shi, Yuhui Sheng, Qiang Cao, Juan Mi, Hao Hu, Beizhe Wang, Danding Key Lab of Intelligent Information Processing Chinese Academy of Sciences Institute of Computing Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China Xi’an Jiaotong University China

With the rapidly increasing application of large language models (LLMs), their abuse has caused many undesirable societal problems such as fake news, academic dishonesty, and information pollution. This makes AI-generated text (AIGT) detection of great importance. Among existing methods, white-box methods are generally superior to black-box methods in terms of performance and generalizability, but they require access to LLMs’ internal states and are not applicable to black-box settings. In this paper, we propose to estimate word generation probabilities as pseudo white-box features via multiple re-sampling to help improve AIGT detection under the black-box setting. Specifically, we design POGER, a proxy-guided efficient re-sampling method, which selects a small subset of representative words (e.g., 10 words) for performing multiple re-sampling in black-box AIGT detection. Experiments on datasets containing texts from humans and seven LLMs show that POGER outperforms all baselines in macro F1 under black-box, partial white-box, and out-of-distribution settings and maintains lower re-sampling costs than its existing counterparts. © 2024, CC BY-NC-SA.

关键词： Computational linguistics

来源：评论

学校读者我要写书评

暂无评论

OmniViD: A Generative Framework for Universal Video Understanding

OmniViD: A Generative Framework for Universal Video Understa...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Junke Wang Dongdong Chen Chong Luo Bo He Lu Yuan Zuxuan Wu Yu-Gang Jiang Shanghai Key Lab of Intell. Info. Processing School of CS Fudan University Shanghai Collaborative Innovation Center of Intelligent Visual Computing Microsoft Cloud + AI Microsoft Research Asia University of Maryland College Park

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

The core of video understanding tasks, such as recognition, captioning, and tracking, is to automatically de-tect objects or actions in a video and analyze their temporal evolution. Despite sharing a common goal, different tasks often rely on distinct model architectures and annotation formats. In contrast, natural language processing benefits from a unified output space, i.e., text sequences, which simplifies the training of powerful foundational language models, such as GPT-3, with extensive training cor-pora. Inspired by this, we seek to unify the output space of video understanding tasks by using languages as labels and additionally introducing time and box tokens. In this way, a variety of video tasks could be formulated as video-grounded token generation. This enables us to address var-ious types of video tasks, including classification (such as action recognition), captioning (covering clip captioning, video question answering, and dense video captioning), and localization tasks (such as visual object tracking) within a fully shared encoder-decoder architecture, following a generative framework. Through comprehensive experiments, we demonstrate such a simple and straightforward idea is quite effective and can achieve state-of-the-art or compet-itive results on seven video benchmarks, providing a novel perspective for more universal video understanding. Code is available at https://***/wangjk666/OmniVid.

关键词： Training Location awareness Visualization Vocabulary Computer architecture Benchmark testing Robustness

来源：评论

学校读者我要写书评

暂无评论

Harnessing hierarchical label distribution variations in test agnostic long-tail recognition 24

Harnessing hierarchical label distribution variations in tes...

引用

Proceedings of the 41st International Conference on Machine Learning

作者： Zhiyong Yang Qianqian Xu Zitai Wang Sicong Li Boyu Han Shilong Bao Xiaochun Cao Qingming Huang School of Computer Science and Tech. University of Chinese Academy of Sciences Key Lab. of Intelligent Information Processing Institute of Computing Tech. CAS Institute of Information Engineering CAS and School of Cyber Security University of Chinese Academy of Sciences Key Lab. of Intelligent Information Processing Institute of Computing Tech. CAS and School of Computer Science and Tech. University of Chinese Academy of Sciences School of Cyber Science and Tech. Shenzhen Campus of Sun Yat-sen University School of Computer Science and Tech. University of Chinese Academy of Sciences and 2Key Lab. of Intelligent Information Processing Institute of Computing Tech. CAS and BDKM University of Chinese Academy of Sciences

关键词：

来源：评论

学校读者我要写书评

暂无评论

Look Before You Match: Instance Understanding Matters in Video Object Segmentation

Look Before You Match: Instance Understanding Matters in Vid...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Junke Wang Dongdong Chen Zuxuan Wu Chong Luo Chuanxin Tang Xiyang Dai Yucheng Zhao Yujia Xie Lu Yuan Yu-Gang Jiang Shanghai Key Lab of Intell. Info. Processing School of CS Fudan University Shanghai Collaborative Innovation Center of Intelligent Visual Computing Microsoft Cloud + AI Microsoft Research Asia

Exploring dense matching between the current frame and past frames for long-range context modeling, memory-based methods have demonstrated impressive results in video object segmentation (VOS) recently. Nevertheless, due to the lack of instance understanding ability, the above approaches are oftentimes brittle to large appearance variations or viewpoint changes resulted from the movement of objects and cameras. In this paper, we argue that instance understanding matters in VOS, and integrating it with memory-based matching can enjoy the synergy, which is intuitively sensible from the definition of VOS task, i.e., identifying and segmenting object instances within the video. Towards this goal, we present a two-branch network for VOS, where the query-based instance segmentation (IS) branch delves into the instance details of the current frame and the VOS branch performs spatial-temporal matching with the memory bank. We employ the well-learned object queries from IS branch to inject instance-specific information into the query key, with which the instance-augmented matching is further performed. In addition, we introduce a multi-path fusion block to effectively combine the memory readout with multi-scale features from the instance segmentation decoder, which incorporates high-resolution instance-aware features to produce final segmentation results. Our method achieves state-of-the-art performance on DAVIS 2016/2017 val (92.6% and 87.1%), DAVIS 2017 test-dev (82.8%), and YouTube-VOS 2018/2019 val (86.3% and 86.3%), outperforming alternative methods by clear margins.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：