This paper proposes a Chinese semantic role classification approach on the basis of feature combination. First we define a set of effective basic features. Then a statistics-based feature combination method is develop...
详细信息
Duplicate emails, which exist on the internet widely and are mainly caused by mailing lists, not only waste storage resource but also bring users garbage. In this paper, according to the structure and text feature of ...
详细信息
Duplicate emails, which exist on the internet widely and are mainly caused by mailing lists, not only waste storage resource but also bring users garbage. In this paper, according to the structure and text feature of email, we put forward the concept of Mail-Duplicate-Degree, and in this way the email duplicate is firstly defined. Based on this definition, we develop an algorithm based on clustering to detect duplicate emails. By introducing a hash function provided by TRIE tree to optimize the efficiency, the algorithm gets over the slow processing speed problem existing in traditional clustering methods. Experimental results on large-scale emails have shown that the algorithm has a high precision.
In the research and development of various naturallanguageprocessing systems, like Q&A system and text-to-scene conversation system, we realize that knowledge of text entailment helps a lot in improving the perf...
详细信息
In the research and development of various naturallanguageprocessing systems, like Q&A system and text-to-scene conversation system, we realize that knowledge of text entailment helps a lot in improving the performance of the system. Systems with text entailment knowledge will be smarter than those who without entailment knowledge. Currently many research teams are focusing on text entailment, including recognition, generation and extraction. However, entailment extraction is the main method in creating entailment knowledge database. Meanwhile, for text-to-scene conversation system, due to the importance of events in stories, find a method for event entailment extraction is our main goal. In this paper, we proposed a method for extracting event entailment from corpus based on EM iteration, which has not been used before.
Selection of wavelet type, decomposition level and fusing rule is a key problem when wavelet transform is applied to image fusion. 2916 kinds of different fusing methods(54×5×9, including 54 wavelet types, 5...
详细信息
Information Extraction is the task of identifying information in texts and converting it into a predefined format. In this paper, we build an information integration system which focuses on the information of computer...
详细信息
Information Extraction is the task of identifying information in texts and converting it into a predefined format. In this paper, we build an information integration system which focuses on the information of computer science teachers in Chinese universities. The target of the system is to automatically extract the useful information from heterogeneous sources and re-organize them into structured format. The system includes 4 main modules: web pages retrieval module, web pages' structure classification module, information extraction module and information updating module. We have successfully applied the system to deal with 107 universities in China which shows the effect of the proposed system.
Traditional machine learning methods rely on strong assumptions, especially assuming that training data and testing data in homogeneous feature spaces. However, this is not always true in reality. To break such assump...
详细信息
Traditional machine learning methods rely on strong assumptions, especially assuming that training data and testing data in homogeneous feature spaces. However, this is not always true in reality. To break such assumptions, this paper proposes a domain-adaptive transfer learning method, which automatically learns knowledge from existing knowledge bank by extracting linguistic information such as part-of-speech and co-occurrence of keywords and constructing a new domain-adaptive transfer knowledge bank. Through experiments on homogeneous and heterogeneous feature spaces, we testify the efficacy of our methods.
In our study of Text-to-Scene conversation (TTS), which translates naturallanguage into animations automatically, we realized that event entailment knowledge is useful in generating scenes since the main part of a sc...
详细信息
In our study of Text-to-Scene conversation (TTS), which translates naturallanguage into animations automatically, we realized that event entailment knowledge is useful in generating scenes since the main part of a scene is to show an event. In this paper, we provide some results of our attempt to extract event entailment knowledge. We use entailment chains instead of traditional entailment rules since the sequence of events is a process which make useful in TTS. The result shows that the work is worth to continue to study.
Primary Question detection in online forum is a subtask of extracting question-answer pairs. In this paper, by surveying the forms of questions in Chinese online forums, a combination of textual and N-gram features ac...
详细信息
Primary Question detection in online forum is a subtask of extracting question-answer pairs. In this paper, by surveying the forms of questions in Chinese online forums, a combination of textual and N-gram features achieved via feature selection is adopted to help detecting primary questions. By viewing primary question detection a binary classification problem, decision tree classifier C4.5 and support vector machine are introduced to distinguish questions from non-questions separately. Experimental results across multiple datasets demonstrate that the mixture of textual and N-gram features performs better than using each of them separately under both C4.5 and support vector machine. By computing the weight of each feature in the two classifiers, the top 6 features are found the very same except for a little adjustment of order, showing that the combination of textual and N-gram features is universal and effective in detecting primary questions.
This paper proposes a word-by-word model selection approach to domain adaptation for Word Sense Disambiguation. By this approach, the model for a target word is automatically selected from a candidate model set, which...
详细信息
This paper proposes a word-by-word model selection approach to domain adaptation for Word Sense Disambiguation. By this approach, the model for a target word is automatically selected from a candidate model set, which is comprised of improved self-training models and a supervised model. The improved self-training uses sense priors to prevent its iteration from converging into undesirable states. Experimental results on a domain-specific corpus show that: (1) our improved self-training model is effective for the words which have target domain linked senses; (2) the selected models obtain higher accuracies than each single model and effectively improve the performance compared to the state-of-the-art supervised model.
This paper proposes a novel approach to comment spam identification based on content analysis. Three main features including the number of links, content repetitiveness, and text similarity are used for comment spam i...
详细信息
This paper proposes a novel approach to comment spam identification based on content analysis. Three main features including the number of links, content repetitiveness, and text similarity are used for comment spam identification. In practice, content repetitiveness is determined by the length and frequency of the longest common substring. Furthermore, text similarity is calculated using vector space model. The precisions of preliminary experiments on comment spam identification conducted on Chinese and English are as high as 93% and 82% respectively. The results show the validity and language independency of this approach. Compared with conventional spam filtering approaches, our method requires no training, no rule sets and no link relationships. The proposed approach can also deal with new comments as well as existing comments.
暂无评论