Evaluating state-of-the-art Treebank-style parsers for Coh-Metrix and other learning technology environments

作     者：Hempelmann, Christian F. Rus, Vasile Graesser, Arthur C. McNamara, Danielle S. 

作者机构：Institute for Intelligent Systems Department of Computer Science The University of Memphis Memphis TN 38120 United States 

出 版 物：《Natural Language Engineering》 (Nat Lang Eng)

年 卷 期：2006年第12卷第2期

页      面：131-144页

核心收录：

学科分类：1205[管理学-图书情报与档案管理] 08[工学] 081203[工学-计算机应用技术] 0835[工学-软件工程] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

主　　题：Computer program listings 

摘      要：This paper evaluates four of the most commonly used, freely available, state-of-the-art parsers on a standard benchmark as well as with respect to a set of data relevant for measuring text cohesion, as one example of a learning technology application that requires fast and accurate syntactic parsing. We outline advantages and disadvantages of existing technologies and make recommendations. Our performance report uses traditional measures based on a gold standard as well as novel dimensions for parsing evaluation. To our knowledge, this is the first attempt to evaluate parsers across genres and grade levels for the implementation in learning technology using both gold standard and directed evaluation methods. © 2006 Cambridge University Press.