检索结果-内蒙古大学图书馆

Quantum supremacy circuit simulation on sunway taihulight

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Li, Riling Wu, Bujiao Ying, Mingsheng Sun, Xiaoming Yang, Guangwen Department of Computer Science & Technology Tsinghua University Beijing China CAS Key Lab of Network Data Science and Technology Institute of Computing Technology Chinese Academy of Sciences Beijing China Centre for Quantum Software and Information University of Technology Sydney Sydney Australia State Key Lab of Computer Science Institute of Software Chinese Academy of Sciences Department of Computer Science & Technology Tsinghua University Beijing China

With the rapid progress made by industry and academia, quantum computers with dozens of qubits or even larger size are being realized. However, the fidelity of existing quantum computers often sharply decreases as the circuit depth increases. Thus, an ideal quantum circuit simulator on classical computers, especially on high-performance computers, is needed for benchmarking and validation. We design a large-scale simulator of universal random quantum circuits, often called "quantum supremacy circuits", and implement it on Sunway TaihuLight. The simulator can be used to accomplish the following two tasks: 1) computing a complete output state-vector;2) Calculating one or a few amplitudes. We target the simulation of 49-qubit circuits. For task 1), we successfully simulate such a circuit of depth 39, and for task 2) we reach the 55-depth level. To the best of our knowledge, both of the simulation results reach the largest depth for 49-qubit quantum supremacy circuits. Copyright © 2018, The Authors. All rights reserved.

关键词： Circuit simulation

Transformation driven visual reasoning

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Hong, Xin Lan, Yanyan Pang, Liang Guo, Jiafeng Cheng, Xueqi CAS Key Laboratory of Network Data Science and Technology Institute of Computing Technology Chinese Academy of Sciences Beijing China University of Chinese Academy of Sciences Beijing China Institute for AI Industry Research Tsinghua University Beijing China

This paper defines a new visual reasoning paradigm by introducing an important factor, i.e. transformation. The motivation comes from the fact that most existing visual reasoning tasks, such as CLEVR in VQA, are solely defined to test how well the machine understands the concepts and relations within static settings, like one image. We argue that this kind of state driven visual reasoning approach has limitations in reflecting whether the machine has the ability to infer the dynamics between different states, which has been shown as important as state-level reasoning for human cognition in Piaget’s theory. To tackle this problem, we propose a novel transformation driven visual reasoning task. Given both the initial and final states, the target is to infer the corresponding single-step or multi-step transformation, represented as a triplet (object, attribute, value) or a sequence of triplets, respectively. Following this definition, a new dataset namely TRANCE is constructed on the basis of CLEVR, including three levels of settings, i.e. Basic (single-step transformation), Event (multi-step transformation), and View (multi-step transformation with variant views). Experimental results show that the state-of-the-art visual reasoning models perform well on Basic, but are still far from human-level intelligence on Event and View. We believe the proposed new paradigm will boost the development of machine visual reasoning. More advanced methods and real data need to be investigated in this direction. The resource of TVR is available at https://***/TVR. Copyright © 2020, The Authors. All rights reserved.

关键词： Machine learning

Conditional GANs with Auxiliary Discriminative Classifier

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Hou, Liang Cao, Qi Shen, Huawei Pan, Siyuan Li, Xiaoshuang Cheng, Xueqi Data Intelligence System Research Center Institute of Computing Technology Chinese Academy of Sciences Beijing China University of Chinese Academy of Sciences Beijing China Shanghai Jiao Tong University Shanghai China CAS Key Laboratory of Network Data Science and Technology Institute of Computing Technology Chinese Academy of Sciences Beijing China

Conditional generative models aim to learn the underlying joint distribution of data and labels to achieve conditional data generation. Among them, the auxiliary classifier generative adversarial network (AC-GAN) has been widely used, but suffers from the problem of low intra-class diversity of the generated samples. The fundamental reason pointed out in this paper is that the classifier of AC-GAN is generator-agnostic, which therefore cannot provide informative guidance for the generator to approach the joint distribution, resulting in a minimization of the conditional entropy that decreases the intra-class diversity. Motivated by this understanding, we propose a novel conditional GAN with an auxiliary discriminative classifier (ADC-GAN) to resolve the above problem. Specifically, the proposed auxiliary discriminative classifier becomes generator-aware by recognizing the class-labels of the real data and the generated data discriminatively. Our theoretical analysis reveals that the generator can faithfully learn the joint distribution even without the original discriminator, making the proposed ADC-GAN robust to the value of the coefficient hyperparameter and the selection of the GAN loss, and stable during training. Extensive experimental results on synthetic and real-world datasets demonstrate the superiority of ADC-GAN in conditional generative modeling compared to state-of-the-art classifier-based and projection-based conditional GANs. Copyright © 2021, The Authors. All rights reserved.

关键词： Generative adversarial networks

Match2: A Matching over Matching Model for Similar Question Identification

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Wang, Zizhen Fan, Yixing Guo, Jiafeng Yang, Liu Zhang, Ruqing Lan, Yanyan Cheng, Xueqi Jiang, Hui Wang, Xiaozhao University of Chinese Academy of Sciences Beijing China CAS Key Lab of Network Data Science and Technology Institute of Computing Technology Chinese Academy of Sciences Beijing China University of Massachusetts Amherst MA United States Alibaba Group Beijing China

Community Question Answering (CQA) has become a primary means for people to acquire knowledge, where people are free to ask questions or submit answers. To enhance the efficiency of the service, similar question identification becomes a core task in CQA which aims to find a similar question from the archived repository whenever a new question is asked. However, it has long been a challenge to properly measure the similarity between two questions due to the inherent variation of natural language, i.e., there could be different ways to ask a same question or different questions sharing similar expressions. To alleviate this problem, it is natural to involve the existing answers for the enrichment of the archived questions. Traditional methods typically take a one-side usage, which leverages the answer as some expanded representation of the corresponding question. Unfortunately, this may introduce unexpected noises into the similarity computation since answers are often long and diverse, leading to inferior performance. In this work, we propose a two-side usage, which leverages the answer as a bridge of the two questions. The key idea is based on our observation that similar questions could be addressed by similar parts of the answer while different questions may not. In other words, we can compare the matching patterns of the two questions over the same answer to measure their similarity. In this way, we propose a novel matching over matching model, namely Match2, which compares the matching patterns between two question-answer pairs for similar question identification. Empirical experiments on two benchmark datasets demonstrate that our model can significantly outperform previous state-of-the-art methods on the similar question identification *** CONCEPTS •Information systems → Question answering;Copyright © 2020, The Authors. All rights reserved.

关键词：

Spatio-Temporal meets Wavelet: Disentangled Traffic Flow Forecasting via Efficient Spectral Graph Attention network

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Fang, Yuchen Qin, Yanjun Luo, Haiyong Zhao, Fang Xu, Bingbing Wang, Chenxing Zeng, Liang School of Computer Science National Pilot Software Engineering School Beijing University of Posts and Telecommunications China Research Center for Ubiquitous Computing Systems Institute of Computing Technology Chinese Academy of Sciences China CAS Key Laboratory of Network Data Science and Technology Institute of Computing Technology Chinese Academy of Sciences China Tsinghua University China

Traffic forecasting is crucial for public safety and resource optimization, yet is very challenging due to three aspects: i) current existing works mostly exploit intricate temporal patterns (e.g., the short-term thunderstorm and long-term daily trends) within a single method, which fail to accurately capture spatio-temporal dependencies under different schemas;ii) the under-exploration of the graph positional encoding limit the extraction of spatial information in the commonly used full graph attention network;iii) the quadratic complexity of the full graph attention introduces heavy computational needs. To achieve the effective traffic flow forecasting, we propose an efficient spectral graph attention network with disentangled traffic sequences. Specifically, the discrete wavelet transform is leveraged to obtain the low- and high-frequency components of traffic sequences, and a dual-channel encoder is elaborately designed to accurately capture the spatio-temporal dependencies under long- and short-term schemas of the low- and high-frequency components. Moreover, a novel wavelet-based graph positional encoding and a query sampling strategy are introduced in our spectral graph attention to effectively guide message passing and efficiently calculate the attention. Extensive experiments on four real-world datasets show the superiority of our model, i.e., the higher traffic forecasting precision with lower computational cost. Copyright © 2021, The Authors. All rights reserved.

关键词： Message passing

Collaborative self-attention network for session-based recommendation 29

学校读者我要写书评

暂无评论

Collaborative self-attention network for session-based recom...

29th International Joint Conference on Artificial Intelligence, IJCAI 2020

作者： Luo, Anjing Zhao, Pengpeng Liu, Yanchi Zhuang, Fuzhen Wang, Deqing Xu, Jiajie Fang, Junhua Sheng, Victor S. Institute of AI School of Computer Science and Technology Soochow University China Rutgers University New Jersey United States Key Lab of IIP of CAS Institute of Computing Technology Beijing China University of Chinese Academy of Sciences Beijing China School of Computer Beihang University Beijing China Texas Tech University TX United States

ISBN: (纸本)9780999241165

Session-based recommendation becomes a research hotspot for its ability to make recommendations for anonymous users. However, existing session-based methods have the following limitations: (1) They either lack the capability to learn complex dependencies or focus mostly on the current session without explicitly considering collaborative information. (2) They assume that the representation of an item is static and fixed for all users at each time step. We argue that even the same item can be represented differently for different users at the same time step. To this end, we propose a novel solution, Collaborative Self-Attention network (CoSAN) for session-based recommendation, to learn the session representation and predict the intent of the current session by investigating neighborhood sessions. Specially, we first devise a collaborative item representation by aggregating the embedding of neighborhood sessions retrieved according to each item in the current session. Then, we apply self-attention to learn long-range dependencies between collaborative items and generate collaborative session representation. Finally, each session is represented by concatenating the collaborative session representation and the embedding of the current session. Extensive experiments on two real-world datasets show that CoSAN constantly outperforms state-of-the-art methods. © 2020 Inst. Sci. inf., Univ. Defence in Belgrade. All rights reserved.

关键词： Embeddings

Color Image Segmentation Based on Modified Kuramoto Model

学校读者我要写书评

暂无评论

Procedia Computer science 2016年 88卷 245-258页

作者： Xiaojie Liu Yuanhua Qiao Xianghui Chen Jun Miao Lijuan Duan College of Applied Sciences Beijing University of Technology Beijing 100124 China Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing 100190 China College of Computer Science and Technology Beijing University of Technology Beijing 100124 China

A new approach for color image segmentation is proposed based on Kuramoto model in this paper. Firstly, the classic Kuramoto model which describes a global coupled oscillator network is changed to be one that is locally coupled to simulate the neuron activity in visual cortex and to describe the influence for phase changing by external stimuli. Secondly, a rebuilt method of coupled neuron activities is proposed by introducing and computing instantaneous frequency. Three oscillating curves corresponding to the pixel values of R, G, B for color image are formed by the coupled network and are added up to produce the superposition of oscillation. Finally, color images are segmented according to the synchronization of the oscillating superposition by extracting and checking the frequency of the oscillating curves. The performance is compared with that from other representative segmentation approaches.

关键词： Kuramoto model Neural network Color image segmentation

Evaluating Interpolation and Extrapolation Performance of Neural Retrieval Models

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zhan, Jingtao Xie, Xiaohui Mao, Jiaxin Liu, Yiqun Guo, Jiafeng Zhang, Min Ma, Shaoping Department of Computer Science and Technology Beijing National Research Center for Information Science and Technology Tsinghua University Beijing100084 China Beijing Key Laboratory of Big Data Management and Analysis Methods Gaoling School of Artificial Intelligence Renmin University of China Beijing100872 China CAS Key Lab of Network Data Science and Technology Institute of Computing Technology Chinese Academy of Sciences Beijing China

A retrieval model should not only interpolate the training data but also extrapolate well to the queries that are different from the training data. While neural retrieval models have demonstrated impressive performance on ad-hoc search benchmarks, we still know little about how they perform in terms of interpolation and extrapolation. In this paper, we demonstrate the importance of separately evaluating the two capabilities of neural retrieval models. Firstly, we examine existing ad-hoc search benchmarks from the two perspectives. We investigate the distribution of training and test data and find a considerable overlap in query entities, query intent, and relevance labels. This finding implies that the evaluation on these test sets is biased toward interpolation and cannot accurately reflect the extrapolation capacity. Secondly, we propose a novel evaluation protocol to separately evaluate the interpolation and extrapolation performance on existing benchmark datasets. It resamples the training and test data based on query similarity and utilizes the resampled dataset for training and evaluation. Finally, we leverage the proposed evaluation protocol to comprehensively revisit a number of widely-adopted neural retrieval models. Results show models perform differently when moving from interpolation to extrapolation. For example, representation-based retrieval models perform almost as well as interaction-based retrieval models in terms of interpolation but not extrapolation. Therefore, it is necessary to separately evaluate both interpolation and extrapolation performance and the proposed resampling method serves as a simple yet effective evaluation tool for future IR studies. Copyright © 2022, The Authors. All rights reserved.

关键词： Extrapolation

Semantic models for the first-stage retrieval: a comprehensive review

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Guo, Jiafeng Cai, Yinqiong Fan, Yixing Sun, Fei Zhang, Ruqing Cheng, Xueqi CAS Key Lab of Network Data Science and Technology Institute of Computing Technology Chinese Academy of Sciences University of Chinese Academy of Sciences NO. 6 Kexueyuan South Road Haidian District Beijing100190 China Alibaba Group Beijing100102 China

Multi-stage ranking pipelines have been a practical solution in modern search systems, where the first-stage retrieval is to return a subset of candidate documents, and latter stages attempt to re-rank those candidates. Unlike re-ranking stages going through quick technique shifts during past decades, the first-stage retrieval has long been dominated by classical term-based models. Unfortunately, these models suffer from the vocabulary mismatch problem, which may block re-ranking stages from relevant documents at the very beginning. Therefore, it has been a long-term desire to build semantic models for the first-stage retrieval that can achieve high recall efficiently. Recently, we have witnessed an explosive growth of research interests on the first-stage semantic retrieval models. We believe it is the right time to survey current status, learn from existing methods, and gain some insights for future development. In this paper, we describe the current landscape of the first-stage retrieval models under a unified framework to clarify the connection between classical term-based retrieval methods, early semantic retrieval methods and neural semantic retrieval methods. Moreover, we identify some open challenges and envision some future directions, with the hope of inspiring more researches on these important yet less investigated topics. © 2021, CC BY-NC-ND.

关键词： Surveys