Article

Free access

Word sense disambiguation vs. statistical machine translation

Authors:

Marine Carpuat,

Dekai WuAuthors Info & Claims

ACL '05: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics

Pages 387 - 394

https://doi.org/10.3115/1219840.1219888

Published: 25 June 2005 Publication History

Abstract

We directly investigate a subject of much recent debate: do word sense disambiguation models help statistical machine translation quality? We present empirical results casting doubt on this common, but unproved, assumption. Using a state-of-the-art Chinese word sense disambiguation model to choose translation candidates for a typical IBM statistical MT system, we find that word sense disambiguation does not yield significantly better translation quality than the statistical machine translation system alone. Error analysis suggests several key factors behind this surprising finding, including inherent limitations of current statistical MT architectures.

References

[1]

Peter Brown, Stephen Della Pietra, Vincent Della Pietra, and Robert Mercer. Word-sense disambiguation using statistical methods. In Proceedings of 29th meeting of the Association for Computational Linguistics, pages 264--270, Berkeley, California, 1991.

Digital Library

[2]

Marine Carpuat, Weifeng Su, and Dekai Wu. Augmenting ensemble classification for word sense disambiguation with a Kernel PCA model. In Proceedings of Senseval-3, Third International Workshop on Evaluating Word Sense Disambiguation Systems, Barcelona, July 2004. SIGLEX, Association for Computational Linguistics.

[3]

Xavier Carreras, Lluis Marques, and Lluís Padró. Named entity extraction using AdaBoost. In Dan Roth and Antal van den Bosch, editors, Proceedings of CoNLL-2002, pages 167--170, Taipei, Taiwan, 2002.

Digital Library

[4]

Philip Clarkson and Ronald Rosenfeld. Statistical language modeling using the CMU-Cambridge toolkit. In Proceedings of Eurospeech '97, pages 2707--2710, Rhodes, Greece, 1997.

[5]

Mona Diab. Relieving the data acquisition bottleneck in word sense disambiguation. In Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, 2004.

Digital Library

[6]

Yoram Freund and Robert E. Schapire. A decision-theoretic generalization of on-line learning and an application to boosting. In Journal of Computer and System Sciences, 55(1), pages 119--139, 1997.

Digital Library

[7]

Ulrich Germann. Greeedy decoding for statistical machine translation in almost linear time. In Proceedings of HLT-NAACL-2003. Edmonton, AB, Canada, 2003.

Digital Library

[8]

E. T. Jaynes. Where do we Stand on Maximum Entropy? MIT Press, Cambridge MA, 1978.

[9]

Dan Klein and Christopher D. Manning. Conditional structure versus conditional estimation in NLP models. In Proceedings of EMNLP-2002, Conference on Empirical Methods in Natural Language Processing, pages 9--16, Philadelphia, July 2002. SIGDAT, Association for Computational Linguistics.

Digital Library

[10]

Cong Li and Hang Li. Word translation disambiguation using bilingual bootstrapping. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 343--351, 2002.

Digital Library

[11]

Hwee Tou Ng, Bin Wang, and Yee Seng Chan. Exploiting parallel texts for word sense disambiguation: An empirical study. In Proceedings of ACL-03, Sapporo, Japan, pages 455--462, 2003.

Digital Library

[12]

Franz Och and Hermann Ney. Discriminative training and maximum entropy models for statistical machine translation. In Proceedings of ACL-02, Philadelphia, 2002.

Digital Library

[13]

Franz Josef Och and Hermann Ney. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1):19--52, 2003.

Digital Library

[14]

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. BLEU: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, 2002.

Digital Library

[15]

Robert E. Schapire and Yoram Singer. BoosTexter: A boosting-based system for text categorization. Machine Learning, 39(2):135--168, 2000.

Digital Library

[16]

Bernhard Schölkopf, Alexander Smola, and Klaus-Rober Müller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10(5), 1998.

Digital Library

[17]

Dekai Wu and Hongsing Wong. Machine translation with a stochastic grammatical channel. In Proceedings of COLINGACL'98, Montreal, Canada, August 1998.

Digital Library

[18]

Dekai Wu, Weifeng Su, and Marine Carpuat. A Kernel PCA method for superior word sense disambiguation. In Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, Barcelona, July 2004.

Digital Library

[19]

Dekai Wu. A polynomial-time algorithm for statistical machine translation. In Proceedings of 34th Annual Meeting of the Association for Computational Linguistics, Santa Cruz, California, June 1996.

Digital Library

[20]

David Yarowsky and Radu Florian. Evaluating sense disambiguation across diverse parameter spaces. Natural Language Engineering, 8(4):293--310, 2002.

Digital Library

[21]

Richard Zens, Hermann Ney, Taro Watanabe, and Eiichiro Sumita. Reordering constraints for phrase-based statistical machine translation. In Proceedings of COLING-2004, Geneva, Switzerland, August 2004.

Digital Library

Cited By

Jain GLobiyal D(2022)Word Sense Disambiguation using Cooperative Game Theory and Fuzzy Hindi WordNet based on ConceptNetACM Transactions on Asian and Low-Resource Language Information Processing10.1145/350273921:4(1-25)Online publication date: 4-Mar-2022
https://dl.acm.org/doi/10.1145/3502739
Camacho-Collados JPilehvar M(2019)From word to sense embeddingsJournal of Artificial Intelligence Research10.1613/jair.1.1125963:1(743-788)Online publication date: 17-Apr-2019
https://dl.acm.org/doi/10.1613/jair.1.11259
Kim SBaldwin T(2013)Word sense and semantic relations in noun compoundsACM Transactions on Speech and Language Processing 10.1145/2483969.248397110:3(1-17)Online publication date: 11-Jul-2013
https://dl.acm.org/doi/10.1145/2483969.2483971
Show More Cited By

Word sense disambiguation vs. statistical machine translation
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
2. Hardware
  1. Power and energy
    1. Power estimation and optimization

Recommendations

Word sense disambiguation for statistical machine translation
Word Sense Based Hindi-Tamil Statistical Machine Translation

Corpus based natural language processing has emerged with great success in recent years. It is not only used for languages like English, French, Spanish, and Hindi but also is widely used for languages like Tamil, Telugu etc. This paper focuses to ...
Building a training corpus for word sense disambiguation in English-to-Vietnamese machine translation
COLING-MTIA '02: Proceedings of the 2002 COLING workshop on Machine translation in Asia - Volume 16

The most difficult task in machine translation is the elimination of ambiguity in human languages. A certain word in English as well as Vietnamese often has different meanings which depend on their syntactical position in the sentence and the actual ...

Comments

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

ACL '05: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics

June 2005

657 pages

General Chair:
Kevin Knight
University of Southern California

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 25 June 2005

Qualifiers

Article

Acceptance Rates

ACL '05 Paper Acceptance Rate 77 of 423 submissions, 18%;

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
831
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)4

Reflects downloads up to 11 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jain GLobiyal D(2022)Word Sense Disambiguation using Cooperative Game Theory and Fuzzy Hindi WordNet based on ConceptNetACM Transactions on Asian and Low-Resource Language Information Processing10.1145/350273921:4(1-25)Online publication date: 4-Mar-2022
https://dl.acm.org/doi/10.1145/3502739
Camacho-Collados JPilehvar M(2019)From word to sense embeddingsJournal of Artificial Intelligence Research10.1613/jair.1.1125963:1(743-788)Online publication date: 17-Apr-2019
https://dl.acm.org/doi/10.1613/jair.1.11259
Kim SBaldwin T(2013)Word sense and semantic relations in noun compoundsACM Transactions on Speech and Language Processing 10.1145/2483969.248397110:3(1-17)Online publication date: 11-Jul-2013
https://dl.acm.org/doi/10.1145/2483969.2483971
Apidianaki MWisniewski GSokolov AMax AYvon F(2012)WSD for n-best reranking and local language modeling in SMTProceedings of the Sixth Workshop on Syntax, Semantics and Structure in Statistical Translation10.5555/2392936.2392938(1-9)Online publication date: 12-Jul-2012
https://dl.acm.org/doi/10.5555/2392936.2392938
Gelling DCohn TCohn TBlunsom PGraca J(2012)Using senses in HMM word alignmentProceedings of the NAACL-HLT Workshop on the Induction of Linguistic Structure10.5555/2390426.2390433(39-46)Online publication date: 7-Jun-2012
https://dl.acm.org/doi/10.5555/2390426.2390433
McCarthy D(2011)Measuring similarity of word meaning in context with lexical substitutes and translationsProceedings of the 12th international conference on Computational linguistics and intelligent text processing - Volume Part I10.5555/1964799.1964822(238-252)Online publication date: 20-Feb-2011
https://dl.acm.org/doi/10.5555/1964799.1964822
Mei YKirchhoff KJoshi AHuang CJurafsky D(2010)Contextual modeling for meeting translation using unsupervised word sense disambiguationProceedings of the 23rd International Conference on Computational Linguistics10.5555/1873781.1873919(1227-1235)Online publication date: 23-Aug-2010
https://dl.acm.org/doi/10.5555/1873781.1873919
Carpuat MAgirre EMarquez LWicentowski R(2009)One translation per discourseProceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions10.5555/1621969.1621974(19-27)Online publication date: 4-Jun-2009
https://dl.acm.org/doi/10.5555/1621969.1621974
Wu DFung P(2009)Semantic roles for SMTProceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers10.5555/1620853.1620858(13-16)Online publication date: 31-May-2009
https://dl.acm.org/doi/10.5555/1620853.1620858
Brody SLapata MLascarides AGardent CNivre J(2009)Bayesian word sense inductionProceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics10.5555/1609067.1609078(103-111)Online publication date: 30-Mar-2009
https://dl.acm.org/doi/10.5555/1609067.1609078
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents