Article

A probabilistic classification approach for lexical textual entailment

Authors:

Moshe KoppelAuthors Info & Claims

AAAI'05: Proceedings of the 20th national conference on Artificial intelligence - Volume 3

Pages 1050 - 1055

Published: 09 July 2005 Publication History

Abstract

The textual entailment task - determining if a given text entails a given hypothesis - provides an abstraction of applied semantic inference. This paper describes first a general generative probabilistic setting for textual entailment. We then focus on the sub-task of recognizing whether the lexical concepts present in the hypothesis are entailed from the text. This problem is recast as one of text categorization in which the classes are the vocabulary words. We make novel use of Naïve Bayes to model the problem in an entirely unsupervised fashion. Empirical tests suggest that the method is effective and compares favorably with state-of-the-art heuristic scoring approaches.

References

[1]

Barzilay, R. and McKeown, K. 2001. Extracting Paraphrases from a Parallel Corpus. ACL, pp. 50-57.

[2]

Cliff, M. E. and Mooney, R. J. 2003. Bottom-Up Relational Learning of Pattern Matching Rules for Information Extraction. Journal of Machine Learning Research, 4, pp. 177-210.

[3]

Chierchia, G, and McConnell-Ginet, S. 2001. Meaning and grammar: An introduction to semantics, MIT Press.

[4]

Condoravdi, C.; Crouch, D.; de Paiva, V.; Stolle, R.; Bobrow. D. G. 2003. Entailment. Intensionality and Text Understanding. HLT-NAACL 2003 Workshop on Text Meaning.

[5]

Ido Dagan. Oren Glickman and Bernardo Magnini. 2005. The PASCAL Recognising Textual Entailment Challenge. In Proceedings of the PASCAL Challenges Workshop for Recognizing Textual Entailment. Southampton. U.K.

[6]

Harabagiu, S. M.; Moldovan, D. I.; Pasca. M.; Mihalcea, R.; Surdeanu, M.; Bunescu, R. C.; Girju, R.; Rus, V.; Morarescu, P. 2000. FALCON: Boosting Knowledge for Answer Engines. The ninth Text REtrieval Conference (TREC-9).

[7]

Hobbs, J. R.; Stickel, M. E.; Appelt, D. E.; Martin, P. 1993. Interpretation as Abduction. Artificial Intelligence 63: 69-142.

[8]

Hovy, E. H.; Hermjakob, U.; Lin. 2001. The Use of External Knowledge in Factoid QA. TREC-10.

[9]

Landis. R. J. and Koch, G. G. 1977. The measurement of observer agreement for categorical data. Biometrics 33: 159-174.

[10]

Lin, D. and Pantel, P. 2001. Discovery of Inference Rules for Question Answering. Natural Language Engineering 7:4.

[11]

McCallum, A. and Nigam, K. 1998. A Comparison of Event Models for Naive Bayes Text Classification. AAAI-98 Workshop on "Learning for Text Categorization".

[12]

Moldovan, D. I. and Rus, V. 2001. Logic Form Transformation of WordNet and its Applicability to Question Answering. ACL.

[13]

Monz. C. and de Rijke. M. 2001. Light-Weight Entailment Checking for Computational Semantics. The third workshop on inference in computational semantics (ICoS-3).

[14]

Nie, J. Y. and Brisebois, M. 1996. An Inferential Approach to Information Retrieval and Its Implementation Using a Manual Thesaurus. Artificial Intelligence Revue 10(5-6): 409-439.

[15]

Nigam, K; McCallum. A.; Thrun, S.; Mitchell, T. 2000. Text Classification from Labeled and Unlabeled Documents using EM. Machine Learning, 39(2/3). pp. 103-134.

[16]

Rose, T. G.; Stevenson, M.; Whitehead. M. 2002. The Reuters Corpus volume 1 - from yester-day's news to tomorrow's language resources. Third International Conference on Language Resources and Evaluation (LREC-02).

[17]

Horacio Saggion, Rob Gaizauskas. Mark Hepple, Ian Roberts and Mark A. Greenwood. 2004. Exploring the Performance of Boolean Retrieval Strategies For Open Domain Question Answering. In Proceedings of the Information Retrieval for Question Answering (IR4QA) Workshop at SIGIR 2004.

[18]

Szpektor. I; Tanev. H; Dagan, I; Coppola B. 2004. Scaling Web-based Acquisition of Entailment Relations. EMNLP.

Cited By

Espinosa-Anke LSaggion HRonzano FNavigli R(2016)ExTaSem! extending, taxonomizing and semantifying domain terminologiesProceedings of the Thirtieth AAAI Conference on Artificial Intelligence10.5555/3016100.3016264(2594-2600)Online publication date: 12-Feb-2016
https://dl.acm.org/doi/10.5555/3016100.3016264
Rooney NWang HTaylor P(2014)An investigation into the application of ensemble learning for entailment classificationInformation Processing and Management: an International Journal10.1016/j.ipm.2013.08.00250:1(87-103)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1016/j.ipm.2013.08.002
Radinsky KHorvitz ELeonardi SPanconesi AFerragina PGionis A(2013)Mining the web to predict future eventsProceedings of the sixth ACM international conference on Web search and data mining10.1145/2433396.2433431(255-264)Online publication date: 4-Feb-2013
https://dl.acm.org/doi/10.1145/2433396.2433431
Show More Cited By

A probabilistic classification approach for lexical textual entailment
1. Hardware
  1. Power and energy
    1. Power estimation and optimization

Recommendations

A lexical alignment model for probabilistic textual entailment
MLCW'05: Proceedings of the First international conference on Machine Learning Challenges: evaluating Predictive Uncertainty Visual Object Classification, and Recognizing Textual Entailment

This paper describes the Bar-Ilan system participating in the Recognising Textual Entailment Challenge. The paper proposes first a general probabilistic setting that formalizes the notion of textual entailment. We then describe a concrete alignment-...
A probabilistic lexical approach to textual entailment
IJCAI'05: Proceedings of the 19th international joint conference on Artificial intelligence

The textual entailment problem is to determine if a given text entails a given hypothesis. This paper describes first a general generative probabilistic setting for textual entailment. We then focus on the sub-task of recognizing whether the lexical ...
APPLIED TEXTUAL ENTAILMENT: A generic framework to capture shallow semantic inference

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

AAAI'05: Proceedings of the 20th national conference on Artificial intelligence - Volume 3

July 2005

1447 pages

ISBN:157735236x

Editor:
Anthony Cohn
University of Leeds

Sponsors

AAAI: American Association for Artificial Intelligence

Publisher

AAAI Press

Publication History

Published: 09 July 2005

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Espinosa-Anke LSaggion HRonzano FNavigli R(2016)ExTaSem! extending, taxonomizing and semantifying domain terminologiesProceedings of the Thirtieth AAAI Conference on Artificial Intelligence10.5555/3016100.3016264(2594-2600)Online publication date: 12-Feb-2016
https://dl.acm.org/doi/10.5555/3016100.3016264
Rooney NWang HTaylor P(2014)An investigation into the application of ensemble learning for entailment classificationInformation Processing and Management: an International Journal10.1016/j.ipm.2013.08.00250:1(87-103)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1016/j.ipm.2013.08.002
Radinsky KHorvitz ELeonardi SPanconesi AFerragina PGionis A(2013)Mining the web to predict future eventsProceedings of the sixth ACM international conference on Web search and data mining10.1145/2433396.2433431(255-264)Online publication date: 4-Feb-2013
https://dl.acm.org/doi/10.1145/2433396.2433431
Radinsky KDavidovich SMarkovitch SMille AGandon FMisselis JRabinovich MStaab S(2012)Learning causality for news events predictionProceedings of the 21st international conference on World Wide Web10.1145/2187836.2187958(909-918)Online publication date: 16-Apr-2012
https://dl.acm.org/doi/10.1145/2187836.2187958
Shnarch EGoldberger JDagan IClark PDagan IErk KPado SThater SZanzotto F(2011)Towards a probabilistic model for lexical entailmentProceedings of the TextInfer 2011 Workshop on Textual Entailment10.5555/2140473.2140475(10-19)Online publication date: 30-Jul-2011
https://dl.acm.org/doi/10.5555/2140473.2140475
Kozareva ZHovy ELi HMàrquez L(2010)A semi-supervised method to learn and construct taxonomies using the webProceedings of the 2010 Conference on Empirical Methods in Natural Language Processing10.5555/1870658.1870766(1110-1118)Online publication date: 9-Oct-2010
https://dl.acm.org/doi/10.5555/1870658.1870766
Heilman MSmith NKaplan R(2010)Good question! Statistical ranking for question generationHuman Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics10.5555/1857999.1858085(609-617)Online publication date: 2-Jun-2010
https://dl.acm.org/doi/10.5555/1857999.1858085
Ennals RTrushkowsky BAgosta JRappa MJones PFreire JChakrabarti S(2010)Highlighting disputed claims on the webProceedings of the 19th international conference on World wide web10.1145/1772690.1772726(341-350)Online publication date: 26-Apr-2010
https://dl.acm.org/doi/10.1145/1772690.1772726
Glickman OShnarch EDagan IJurafsky DGaussier E(2006)Lexical referenceProceedings of the 2006 Conference on Empirical Methods in Natural Language Processing10.5555/1610075.1610103(172-179)Online publication date: 22-Jul-2006
https://dl.acm.org/doi/10.5555/1610075.1610103
Glickman ODagan IKeller MBengio SDaelemans WMarquez LKlein D(2006)Investigating lexical substitution scoring for subtitle generationProceedings of the Tenth Conference on Computational Natural Language Learning10.5555/1596276.1596286(45-52)Online publication date: 8-Jun-2006
https://dl.acm.org/doi/10.5555/1596276.1596286
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents