Improving Online Clustering of Chinese Technology Web News With Bag-of-Near-Synonyms

作     者：Zhang, Zhe Chen, Le Yin, Fengjing Zhang, Xin Guo, Lixiang 

作者机构：Natl Univ Def Technol Coll Syst Engn Sci & Technol Informat Syst Engn Lab Changsha 410073 Peoples R China Acad Mil Sci Inst Syst Engn Beijing 100091 Peoples R China 

出 版 物：《IEEE ACCESS》 (IEEE Access)

年 卷 期：2020年第8卷

页      面：94245-94257页

核心收录：

主　　题：Computational modeling Semantics Vocabulary Clustering algorithms Facebook Licenses Artificial intelligence Information retrieval single-pass algorithm document representation word embeddings agglomerative clustering 

摘      要：In the Internet era, online clustering of technology web news can help discover scientific breakthroughs and grasp technology trends. To do that automatically, the news documents to be clustered must be represented appropriately with numerical vectors. However, traditional representations such as Term Frequency-Inverse Document Frequency (TF-IDF) cannot distinguish near-synonyms and may cause dimension disaster To overcome these problems, this article proposes the Bag-of-Near-Synonyms (BoNS) model based on the idea to construct near-synonym sets using word embeddings and agglomerative clustering, and then to represent a document with a Set Frequency-Inverse Document Frequency (SF-IDF) vector in which each dimension corresponds to a near-synonym set rather than a single word. To speed up computation, we further propose the hashed version of SF-IDF and name it hSF-IDF, which employs a hash function to map each near-synonym set to a unique number as the key and hence reduces the computation of SF to linear time. In addition, we apply hSF-IDF to online clustering of Chinese technology web news and propose an improved batch-based method. Extensive experiments have been conducted on a real-world dataset. The results show that our model outperforms some strong baselines including TF-IDF, average pooling of word or character embeddings, Latent Dirichlet Allocation (LDA), and bag-of-concepts in terms of both accuracy and efficiency.