Abstract
This paper presents the Third PASCAL Recognising Textual Entailment Challenge (RTE-3), providing an overview of the dataset creating methodology and the submitted systems. In creating this year’s dataset, a number of longer texts were introduced to make the challenge more oriented to realistic scenarios. Additionally, a pool of resources was offered so that the participants could share common tools. A pilot task was also set up, aimed at differentiating unknown entailments from identified contradictions and providing justifications for overall system decisions. 26 participants submitted 44 runs, using different approaches and generally presenting new entailment models and achieving higher scores than in the previous challenges.
| Original language | English |
|---|---|
| Pages (from-to) | 1-9 |
| Number of pages | 9 |
| Journal | Proceedings of the Annual Meeting of the Association for Computational Linguistics |
| State | Published - 2007 |
| Event | 2007 ACL-PASCAL Workshop on Textual Entailment and Paraphrasing, ACL-PASCAL 2007 at the Annual Meeting of the Association for Computational Linguistics, ACL 2007 - Prague, Czech Republic Duration: 28 Jun 2007 → 29 Jun 2007 |
Bibliographical note
Publisher Copyright:© ACL 2007.All right reserved.
Funding
We would also like to acknowledge the people and organizations involved in creating and annotating the data: Pamela Forner, Errol Hayman, Cam-eron Fordyce from CELCT and Courtenay Hendricks, Adam Savel and Annika Hamalainen from the Butler Hill Group, which was funded by Microsoft Research.
| Funders | Funder number |
|---|---|
| CELCT | |
| Courtenay Hendricks | |
| Microsoft Research |