Instance-based evaluation of entailment rule acquisition

Idan Szpektor, Eyal Shnarch, Ido Dagan

Research output: Contribution to journalArticlepeer-review

52 Scopus citations


Obtaining large volumes of inference knowledge, such as entailment rules, has become a major factor in achieving robust semantic processing. While there has been substantial research on learning algorithms for such knowledge, their evaluation methodology has been problematic, hindering further research. We propose a novel evaluation methodology for entailment rules which explicitly addresses their semantic properties and yields satisfactory human agreement levels. The methodology is used to compare two state of the art learning algorithms, exposing critical issues for future progress. © 2007 Association for Computational Linguistics.


Dive into the research topics of 'Instance-based evaluation of entailment rule acquisition'. Together they form a unique fingerprint.

Cite this