Cross-framework evaluation for statistical parsing

Reut Tsarfaty, Joakim Nivre, Evelina Andersson

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

24 Scopus citations

Abstract

A serious bottleneck of comparative parser evaluation is the fact that different parsers subscribe to different formal frameworks and theoretical assumptions. Converting outputs from one framework to another is less than optimal as it easily introduces noise into the process. Here we present a principled protocol for evaluating parsing results across frameworks based on function trees, tree generalization and edit distance metrics. This extends a previously proposed framework for cross-Theory evaluation and allows us to compare a wider class of parsers. We demonstrate the usefulness and language independence of our procedure by evaluating constituency and dependency parsers on English and Swedish.

Original languageEnglish
Title of host publicationEACL 2012 - 13th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings
PublisherAssociation for Computational Linguistics (ACL)
Pages44-54
Number of pages11
ISBN (Electronic)9781937284190
StatePublished - 2012
Externally publishedYes
Event13th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2012 - Avignon, France
Duration: 23 Apr 201227 Apr 2012

Publication series

NameEACL 2012 - 13th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings

Conference

Conference13th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2012
Country/TerritoryFrance
CityAvignon
Period23/04/1227/04/12

Bibliographical note

Publisher Copyright:
© 2012 Association for Computational Linguistics.

Fingerprint

Dive into the research topics of 'Cross-framework evaluation for statistical parsing'. Together they form a unique fingerprint.

Cite this