检索结果-内蒙古大学图书馆

arXiv 2020年

作者： Xu, Zenan Guo, Daya Tang, Duyu Su, Qinliang Shou, Linjun Gong, Ming Zhong, Wanjun Quan, Xiaojun Jiang, Daxin Duan, Nan School of Computer Science and Engineering Sun Yat-sen University Guangzhou China Microsoft Research Asia Beijing China Microsoft Search Technology Center Asia Beijing China Guangdong Key Laboratory Big Data Analysis and Processing Guangzhou China Key Lab. of Machine Intelligence and Advanced Computing Ministry of Education China

We study the problem of leveraging the syntactic structure of text to enhance pre-trained models such as BERT and RoBERTa. Existing methods utilize syntax of text either in the pre-training stage or in the fine-tuning stage, so that they suffer from discrepancy between the two stages. Such a problem would lead to the necessity of having human-annotated syntactic information, which limits the application of existing methods to broader scenarios. To address this, we present a model that utilizes the syntax of text in both pre-training and fine-tuning stages. Our model is based on Transformer with a syntax-aware attention layer that considers the dependency tree of the text. We further introduce a new pre-training task of predicting the syntactic distance among tokens in the dependency tree. We evaluate the model on three downstream tasks, including relation classification, entity typing, and question answering. Results show that our model achieves state-of-the-art performance on six public benchmark datasets. We have two major findings. First, we demonstrate that infusing automatically produced syntax of text improves pre-trained models. Second, global syntactic distances among tokens bring larger performance gains compared to local head relations between contiguous tokens. Copyright © 2020, The Authors. All rights reserved.

关键词： Syntactics

来源：评论

学校读者我要写书评

暂无评论

Extremely Short Chinese Text Classification Method Based on Bidirectional Semantic Extension

引用

Journal of Physics: Conference Series 2020年第1期1437卷

作者： Yongzeng Yue Yuhong Zhang Xuegang Hu Peipei Li Key Laboratory of knowledge Engineering with Big Data (Hefei University of Technology) Ministry of Education School of Computer Science and Information Engineering Hefei University of Technology Hefei 23061 China

Short text classification methods have achieved significant progress and wide application on text data such as Twitter and Weibo. However, the extremely short chinese texts like tax invoice data are different with traditional short texts in lackness of contextual semantic information, feature sparseness and extremely short length. The existing short text classification methods are difficult to achieve a satisfactory performance in these texts. To address these problems, this paper proposes a text classification method based on bidirectional semantic extension for extremely short texts like Chinese tax invoice data. More specifically, firstly, the Chinese knowledge graph is introduced for extending bidirectional semantic of texts and label data to expand the extremely short texts and ease the problem of feature sparseness; secondly, the hash vectorization is used to avoid the semantic problem caused by the lackness of contextual information. Experimental results conducted the real tax invoice dataset demonstrate the effectiveness of our proposed method.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Meta mask correction for nuclei segmentation in histopathological image

arXiv

引用

arXiv 2021年

作者： Shi, Jiangbo Jia, Chang Gao, Zeyu Gong, Tieliang Wang, Chunbao Li, Chen National Engineering Lab for Big Data Analytics Xi'an Jiao Tong University Shaanxi Xi'an710049 China School of Computer Science and Technology Xi'an Jiao tong University Shaanxi Xi'an710049 China Shaanxi Province Key Laboratory of Satellite and Terrestrial Network Tech.R&D Xi'an Jiao tong University Shaanxi Xi'an710049 China Department of Pathology The First Affiliated Hospital of Xi'an Jiaotong University Shaanxi Xi'an710061 China

Nuclei segmentation is a fundamental task in digital pathology analysis and can be automated by deep learning-based methods. However, the development of such an automated method requires a large amount of data with precisely annotated masks which is hard to obtain. Training with weakly labeled data is a popular solution for reducing the workload of annotation. In this paper, we propose a novel meta-learning-based nuclei segmentation method which follows the label correction paradigm to leverage data with noisy masks. Specifically, we design a fully conventional meta-model that can correct noisy masks using a small amount of clean meta-data. Then the corrected masks can be used to supervise the training of the segmentation model. Meanwhile, a bi-level optimization method is adopted to alternately update the parameters of the main segmentation model and the meta-model in an end-to-end way. Extensive experimental results on two nuclear segmentation datasets show that our method achieves the state-of-the-art result. It even achieves comparable performance with the model training on supervised data in some noisy settings. © 2021, CC BY.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

Deep semantic dictionary learning for multi-label image classification

arXiv

引用

arXiv 2020年

作者： Zhou, Fengtao Huang, Sheng Xing, Yun School of Big data & Software Engineering Chongqing University Shazheng street NO.174 Shapingba District Chongqing400044 China Ministry of Education Key Laboratory of Dependable Service Computing in Cyber Physical Society Shazheng street NO.174 Shapingba District Chongqing400044 China

Compared with single-label image classification, multi-label image classification is more practical and challenging. Some recent studies attempted to leverage the semantic information of categories for improving multi-label image classification performance. However, these semantic-based methods only take semantic information as type of complements for visual representation without further exploitation. In this paper, we present an innovative path towards the solution of the multi-label image classification which considers it as a dictionary learning task. A novel end-to-end model named Deep Semantic Dictionary Learning (DSDL) is designed. In DSDL, an auto-encoder is applied to generate the semantic dictionary from class-level semantics and then such dictionary is utilized for representing the visual features extracted by Convolutional Neural Network (CNN) with label embeddings. The DSDL provides a simple but elegant way to exploit and reconcile the label, semantic and visual spaces simultaneously via conducting the dictionary learning among them. Moreover, inspired by iterative optimization of traditional dictionary learning, we further devise a novel training strategy named Alternately Parameters Update Strategy (APUS) for optimizing DSDL, which alternately optimizes the representation coefficients and the semantic dictionary in forward and backward propagation. Extensive experimental results on three popular benchmarks demonstrate that our method achieves promising performances in comparison with the state-of-the-arts. Our codes and models have been released1 © 2020, CC BY-NC-SA.

关键词： Image classification

来源：评论

学校读者我要写书评

暂无评论

Spatio-temporal propagation of COVID-19 pandemics

arXiv

引用

arXiv 2020年

作者： Gross, Bnaya Zheng, Zhiguo Liu, Shiyan Chen, Xiaoqi Sela, Alon Li, Jianxin Li, Daqing Havlin, Shlomo Department of Physics Bar-Ilan University Ramat-Gan52900 Israel School of Reliability and Systems Engineering Beihang University Beijing100191 China Department of Industrial Engineering Ariel University Ariel Israel Beijing Advanced Innovation Center for Big Data and Brain Computing Beihang University Beijing100083 China State Key Laboratory of Software Development Environment Beihang University Beijing100083 China Beijing Advanced Innovation Center for Big Data-Based Precision Medicine Beihang University Beijing100191 China

The new coronavirus known as COVID-19 is rapidly spreading since December 2019. Without any vaccination or medicine, the means of controlling it are limited to quarantine and social distancing. Here we study the spatio-temporal propagation of the COVID-19 virus in China and compare it to other global locations. Our results suggest that the disease propagation is highly related to population migration from Hubei resembling a Lévy flight which is characteristic of human mobility and thus could be controlled by efficient quarantines. Since quarantine is usually applied on a city level, more insight can be obtained in analyzing the epidemic in cities. Our results suggest that the disease spread in a city in China is characterized by two-stages process. At early times, at order of few days, the infection rate in the city is close to constant probably due to the lack of means to detect infected individuals before infection signs are observed and at later times it decays approximately exponentially due to quarantines. These two stages can explain the significant differences between the propagation in China and in other world-wide locations. While most cities in China control the disease which resulted in the decaying stage, in other world-wide countries the situation is still becoming worse probably due to less social interactions control and overloaded health systems which reflects in the death and recovery rates. Copyright © 2020, The Authors. All rights reserved.

关键词： Population dynamics

来源：评论

学校读者我要写书评

暂无评论

Automatic Generation Method of Ancient Poetry Based on LSTM

Automatic Generation Method of Ancient Poetry Based on LSTM

引用

IEEE Conference on Industrial Electronics and Applications (ICIEA)

作者： Hanshuang Zhang Zhi Zhang College of Computer Science and Technology Wuhan University of Science and Technology Wuhan China Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System Wuhan China Big Data Science and Engineering Research Institute Wuhan University of Science and Technology Wuhan China

ISBN: (数字)9781728151694

ISBN: (纸本)9781728151700

This paper mainly focuses on the literary genre of ancient poetry with a certain rhythm and cadence, and proposes a novel automatic generation model of ancient poetry. The model uses about 300,000 Tang poems and Song poems as training data, uses One-hot encoding to process data, and uses long short-term memory networks (LSTMs) to learn the semantics of ancient poetry texts and conduct research across a single RNN structure. According to the user's requirements, the model can automatically calculate the most relevant coherent words in the context of the selected context, and generate common ancient poetry and specified words. The method of BLEU automatic evaluation and manual evaluation finally demonstrates the effectiveness of the experiment.

关键词： Industrial electronics Semantics Training data Manuals Rhythm Encoding Periodic structures

来源：评论

学校读者我要写书评

暂无评论

A survey of facial expression recognition based on deep learning

A survey of facial expression recognition based on deep lear...

引用

IEEE Conference on Industrial Electronics and Applications (ICIEA)

作者： Heng Wei Zhi Zhang Collage of Computer Science and Technology Wuhan University of Science and Technology Wuhan China Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System Wuhan China Big Data Science and Engineering Research Institute Wuhan University of Science and Technology Wuhan China

ISBN: (数字)9781728151694

ISBN: (纸本)9781728151700

Facial expression recognition is the key research direction in many fields such as machine vision, pattern recognition and artificial intelligence. lt has become a research hotspot of many scholars and experts. This paper gives a comprehensive overview of deep expression recognition from image preprocessing, common expression recognition networks, and common expression databases. Then we review the current design and training strategies of deep neural networks based on static images and dynamic images, and discuss their advantages and limitations. Finally, the future challenges and corresponding opportunities in the field are analyzed, as well as the future direction of deep learning expression recognition systems.

关键词： Deep learning Training Image recognition databases Face recognition Neural networks Training data

来源：评论

学校读者我要写书评

暂无评论

Influence of Elevation and Orbit Interpolation on the Accuracy of R-D Location Model

Influence of Elevation and Orbit Interpolation on the Accura...

引用

Asian and Pacific Conference on Synthetic Aperture Radar (APSAR)

作者： Minghu Fan Xianyu Zuo Junfeng Tian Key Laboratory of Big Data Analysis and Processing of Henan Province College of Computer Science and Information Engineering Henan University Kaifeng China

ISBN: (数字)9781728129129

ISBN: (纸本)9781728129136

R-D model is the most commonly location model in geometric processing of SAR images. How to improve its location accuracy has been one of the focuses in application. Based on the in-depth analysis of the solving process of R-D equation, two kinds of influencing factors are selected to study. They are elevation and satellite orbit interpolation method. Then, aiming at the pixel location of high-resolution spaceborne SAR images, three kinds of DEM and two orbit interpolation algorithms were studied. The experimental results show that these two kinds of factors mainly affect the location accuracy of range direction, both the horizontal and vertical resolution of elevation have great influence on location accuracy, the quartic polynomial orbit interpolation can meet requirements of high accuracy location, and further improvement of the location accuracy need other auxiliary means.

关键词：

来源：评论

学校读者我要写书评

暂无评论

A layered parallel algorithm for data clustering via fuzzy c-means technique

Research Square

引用

Research Square 2021年

作者： Mu, Yashuang Wei, Wei Guo, Hongyue Sun, Lijun Key Laboratory of Grain Information Processing and Control Henan University of Technology Ministry of Education Zhengzhou450001 China School of Artificial Intelligence and Big Data Henan University of Technology Zhengzhou450001 China College of Information Science and Engineering Henan University of Technology Zhengzhou450001 China School of Maritime Economics and Management Dalian Maritime University Dalian116026 China Collaborative Innovation Center for Transport Studies Dalian Maritime University Dalian116026 China

In this study, a layered parallel algorithm via fuzzy c-means (FCM) technique, called LP-FCM, is proposed in the framework of Map-Reduce for data clustering problems. The LP-FCM mainly contains three layers. The first layer follows a parallel data partitioning method which is developed to randomly divide the original dataset into several subdatasets. The second layer uses a parallel cluster centers searching method based on Map-Reduce, where the classic FCM algorithm is applied to search the cluster centers for each subdataset in Map phases, and all the centers are gathered to the Reduce phase for the confirmation of the final cluster centers through FCM technique again. The third layer implements a parallel data clustering method based on the final cluster centers. After comparing with some famous classic random initialization sequential clustering algorithms which include K-means, K-medoids, FCM and MinMaxK-means on 20 benchmark datasets, the feasibility in terms of clustering accuracy is evaluated. Furthermore, the clustering time and the parallel performance are also tested on some generated large-scale datasets for the parallelism. © 2021, CC BY.

关键词： K-means clustering

来源：评论

学校读者我要写书评

暂无评论

FedPHE: A Secure and Efficient Federated Learning via Packed Homomorphic Encryption

引用

IEEE Transactions on Dependable and Secure Computing 2025年

作者： Li, Yuqing Yan, Nan Chen, Jing Wang, Xiong Hong, Jianan He, Kun Wang, Wei Li, Bo Wuhan University Key Laboratory of Aerospace Information Security and Trusted Computing Ministry of Education School of Cyber Science and Engineering Wuhan430072 China Wuhan University RiZhao Information Technology Institute Rizhao276800 China Huazhong University of Science and Technology National Engineering Research Center for Big Data Technology and System Services Computing Technology and System Lab/Cluster and Grid Computing Lab School of Computer Science and Technology Wuhan430074 China Shanghai Jiao Tong University School of Cyber Science and Engineering Shanghai200240 China Hong Kong University of Science and Technology Department of Computer Science and Engineering Hong Kong

Cross-silo federated learning (FL) enables multiple institutions (clients) to collaboratively build a global model without sharing private data. To prevent privacy leakage during aggregation, homomorphic encryption (HE) is widely used to encrypt model updates, yet incurs high computation and communication overheads. To reduce these overheads, packed HE (PHE) has been proposed to encrypt multiple plaintexts into a single ciphertext. However, the original design of PHE assumes all clients share a single private key, making the system vulnerable to security threats of ciphertexts being intercepted and decrypted by honest-but-curious clients. Also, it does not consider the heterogeneity among different clients, resulting in undermined training efficiency with slow convergence and stragglers. To address these challenges, we propose FedPHE, a secure and efficient FL framework with PHE by jointly exploiting contribution-aware secure aggregation and straggler-resistant client selection. Using CKKS with sparsification and blinding, FedPHE achieves efficient secure aggregation that allows clients to only provide obscured encrypted updates while the server can perform aggregation by accounting for contributions of local updates. To mitigate the straggler effect, we devise a perturbed sketch-based selection to cherry-pick representative clients with heterogeneous models and computing capabilities in a communication-efficient and privacy-preserving manner. We show, through rigorous security analysis and extensive experiments, that FedPHE can efficiently safeguard clients' privacy, achieve 2.45-6.56× training speedup, cut the communication overhead by 1.32-24.85×, and reduce straggler effects by 1.89-2.78×. © 2004-2012 IEEE.

关键词： Privacy by design

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：