[PDF][PDF] Cambridge: Parser evaluation using textual entailment by grammatical relation comparison
Proceedings of the 5th International Workshop on Semantic Evaluation, 2010•aclanthology.org
This paper describes the Cambridge submission to the SemEval-2010 Parser Evaluation
using Textual Entailment (PETE) task. We used a simple definition of entailment, parsing
both T and H with the C&C parser and checking whether the core grammatical relations
(subject and object) produced for H were a subset of those for T. This simple system
achieved the top score for the task out of those systems submitted. We analyze the errors
made by the system and the potential role of the task in parser evaluation.
using Textual Entailment (PETE) task. We used a simple definition of entailment, parsing
both T and H with the C&C parser and checking whether the core grammatical relations
(subject and object) produced for H were a subset of those for T. This simple system
achieved the top score for the task out of those systems submitted. We analyze the errors
made by the system and the potential role of the task in parser evaluation.
Abstract
This paper describes the Cambridge submission to the SemEval-2010 Parser Evaluation using Textual Entailment (PETE) task. We used a simple definition of entailment, parsing both T and H with the C&C parser and checking whether the core grammatical relations (subject and object) produced for H were a subset of those for T. This simple system achieved the top score for the task out of those systems submitted. We analyze the errors made by the system and the potential role of the task in parser evaluation.
aclanthology.org
Showing the best result for this search. See all results