Article

Free access

A translation model for sentence retrieval

Authors:

Vanessa Murdock,

W. Bruce CroftAuthors Info & Claims

HLT '05: Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing

Pages 684 - 691

https://doi.org/10.3115/1220575.1220661

Published: 06 October 2005 Publication History

Abstract

In this work we propose a translation model for monolingual sentence retrieval. We propose four methods for constructing a parallel corpus. Of the four methods proposed, a lexicon learned from a bilingual Arabic-English corpus aligned at the sentence level performs best, significantly improving results over the query likelihood baseline. Further, we demonstrate that smoothing from the local context of the sentence improves retrieval over the query likelihood baseline.

References

[1]

Y. Al-Onaizan, J. Curin, M. Jahr, K. Knight, J. Lafferty, I. D. Melamed, F. J. Och, D. Purdy, N. A. Smith, and D. Yarowsky. 1999. Statistical machine translation, final report, JHU workshop.

[2]

Adam Berger and John Lafferty. 1999. Information retrieval as statistical translation. In Proceedings of the 22nd Annual Conference on Research and Development in Information Retrieval (ACM SIGIR).

Digital Library

[3]

Adam Berger, Rich Caruana, David Cohn, Dayne Freitag, and Vibhu Mittal. 2000. Bridging the lexical chasm: Statistical approaches to answer-finding. In Proceedings of the 23rd Annual Conference on Research and Development in Information Retrieval (ACM SIGIR), pages 192--199.

Digital Library

[4]

Peter F. Brown, John Cocke, Stephen A. Della Pietra, Vincent J. Della Pietra, Frederick Jelineck, John D. Lafferty, Robert L. Mercer, and Paul S. Roossin. 1990. A statistical approach to machine translation. Computational Linguistics, 16(2):79--85.

Digital Library

[5]

Kevyn Collins-Thompson, Paul Ogilvie, Yi Zhang, and Jamie Callan. 2002. Information filtering, novelty detection and named-page finding. In Proceedings of the Eleventh Text Retrieval Conference (TREC).

[6]

Donna Harman. 2002. Overview of the TREC 2002 novelty track. In Proceedings of the Eleventh Text Retrieval Conference (TREC).

[7]

Leah Larkey, James Allan, Margie Connell, Alvaro Bolivar, and Courtney Wade. 2002. UMass at TREC 2002: Cross language and novelty tracks. In Proceedings of the Eleventh Text Retrieval Conference (TREC), page 721.

[8]

Christof Monz, Jaap Kamps, and Maarten de Rijke. 2002. The University of Amsterdam at TREC 2002. In Proceedings of the Eleventh Text Retrieval Conference (TREC).

[9]

Vanessa Murdock and W. Bruce Croft. 2004. Simple translation models for sentence retrieval in factoid question answering. In Proceedings of the Information Retrieval for Question Answering Workshop at SIGIR 2004.

Digital Library

[10]

Ryosuke Ohgaya, Akiyoshi Shimmura, and Tomohiro Takagi. 2003. Meiji University web and novelty track experiments at TREC 2003. In Proceedings of the Twelth Text Retrieval Conference (TREC).

[11]

Jeffrey C. Reynar and Adwait Ratnaparkhi. 1997. A maximum entropy approach to identifying sentence boundaries. In Proceedings of the 5th Conference on Applied Natural Language Processing (ANLP). http://www.cis.upenn.edu/~adwait/statnlp.html.

Digital Library

[12]

Mark Smucker and James Allan. 2005. An investigation of dirichlet prior smoothing's performance advantage. Technical Report IR-391, The University of Massachusetts, The Center for Intelligent Information Retrieval.

[13]

Ian Soboroff and Donna Harman. 2003. Overview of the TREC 2003 novelty track. In Proceedings of the Twelfth Text Retrieval Conference (TREC).

[14]

Ian Soboroff. 2004. Overview of the TREC 2004 novelty track. In Proceedings of the Thirteenth Text Retrieval Conference (TREC). forthcoming.

[15]

Jinxi Xu, Alexander Fraser, and Ralph Weischedel. 2002. Empirical studies in strategies for arabic retrieval. In Proceedings of the 25th Annual Conference on Research and Development in Information Retrieval (ACM SIGIR).

Digital Library

[16]

ChengXiang Zhai and John Lafferty. 2001. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 334--342.

Digital Library

Cited By

Bae KKo Y(2019)Efficient question classification and retrieval using category information and word embedding on cQA servicesJournal of Intelligent Information Systems10.1007/s10844-019-00556-x53:1(27-49)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1007/s10844-019-00556-x
Sheetrit ECollins-Thompson KMei QDavison BLiu YYilmaz E(2018)Utilizing Inter-Passage Similarities for Focused RetrievalThe 41st International ACM SIGIR Conference on Research & Development in Information Retrieval10.1145/3209978.3210222(1453-1453)Online publication date: 27-Jun-2018
https://dl.acm.org/doi/10.1145/3209978.3210222
Sheetrit EShtok AKurland OShprincis ICollins-Thompson KMei QDavison BLiu YYilmaz E(2018)Testing the Cluster Hypothesis with Focused and Graded Relevance JudgmentsThe 41st International ACM SIGIR Conference on Research & Development in Information Retrieval10.1145/3209978.3210120(1173-1176)Online publication date: 27-Jun-2018
https://dl.acm.org/doi/10.1145/3209978.3210120
Show More Cited By

A translation model for sentence retrieval

Recommendations

Trained trigger language model for sentence retrieval in QA: bridging the vocabulary gap
CIKM '11: Proceedings of the 20th ACM international conference on Information and knowledge management

We propose a novel language model for sentence retrieval in Question Answering (QA) systems called trained trigger language model. This model addresses the word mismatch problem in information retrieval. The proposed model captures pairs of trigger and ...
Semantic morphological variant selection and translation disambiguation for cross-lingual information retrieval
Abstract
Cross-Lingual Information Retrieval (CLIR) enables a user to query in a language which is different from the target documents language. CLIR incorporates a translation technique based on either a manual dictionary or a probabilistic dictionary ...
Splitting input sentence for machine translation using language model with sentence similarity
COLING '04: Proceedings of the 20th international conference on Computational Linguistics

In order to boost the translation quality of corpus-based MT systems for speech translation, the technique of splitting an input sentence appears promising. In previous research, many methods used N-gram clues to split sentences. In this paper, to ...

Comments

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

HLT '05: Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing

October 2005

1054 pages

Conference Chair:
Raymond J. Mooney
The University of Texas at Austin

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 06 October 2005

Qualifiers

Article

Acceptance Rates

HLT '05 Paper Acceptance Rate 127 of 402 submissions, 32%;

Overall Acceptance Rate 240 of 768 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
417
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)7

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bae KKo Y(2019)Efficient question classification and retrieval using category information and word embedding on cQA servicesJournal of Intelligent Information Systems10.1007/s10844-019-00556-x53:1(27-49)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1007/s10844-019-00556-x
Sheetrit ECollins-Thompson KMei QDavison BLiu YYilmaz E(2018)Utilizing Inter-Passage Similarities for Focused RetrievalThe 41st International ACM SIGIR Conference on Research & Development in Information Retrieval10.1145/3209978.3210222(1453-1453)Online publication date: 27-Jun-2018
https://dl.acm.org/doi/10.1145/3209978.3210222
Sheetrit EShtok AKurland OShprincis ICollins-Thompson KMei QDavison BLiu YYilmaz E(2018)Testing the Cluster Hypothesis with Focused and Graded Relevance JudgmentsThe 41st International ACM SIGIR Conference on Research & Development in Information Retrieval10.1145/3209978.3210120(1173-1176)Online publication date: 27-Jun-2018
https://dl.acm.org/doi/10.1145/3209978.3210120
Subašić IBerendt B(2013)Story graphsIntelligent Data Analysis10.5555/2595545.259555217:1(125-147)Online publication date: 1-Jan-2013
https://dl.acm.org/doi/10.5555/2595545.2595552
Carmel DShtok AKurland OHe QIyengar ANejdl WPei JRastogi R(2013)Position-based contextualization for passage retrievalProceedings of the 22nd ACM international conference on Information & Knowledge Management10.1145/2505515.2507865(1241-1244)Online publication date: 27-Oct-2013
https://dl.acm.org/doi/10.1145/2505515.2507865
Huang WKataria SCaragea CMitra PGiles CRokach LChen XLebanon GWang HZaki M(2012)Recommending citationsProceedings of the 21st ACM international conference on Information and knowledge management10.1145/2396761.2398542(1910-1914)Online publication date: 29-Oct-2012
https://dl.acm.org/doi/10.1145/2396761.2398542
He JNie JLu YZhao W(2012)Position-Aligned translation model for citation recommendationProceedings of the 19th international conference on String Processing and Information Retrieval10.1007/978-3-642-34109-0_27(251-263)Online publication date: 21-Oct-2012
https://dl.acm.org/doi/10.1007/978-3-642-34109-0_27
Fan JLi GZhou L(2011)An effective approach for searching closest sentence translations from the webProceedings of the 16th international conference on Database systems for advanced applications: Part II10.5555/1997251.1997256(47-57)Online publication date: 22-Apr-2011
https://dl.acm.org/doi/10.5555/1997251.1997256
Subašić IBerendt B(2010)From bursty patterns to bursty factsProceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence10.5555/1860967.1861069(517-522)Online publication date: 4-Aug-2010
https://dl.acm.org/doi/10.5555/1860967.1861069
Krikon EKurland OBendersky M(2010)Utilizing inter-passage and inter-document similarities for reranking search resultsACM Transactions on Information Systems10.1145/1877766.187776929:1(1-28)Online publication date: 27-Dec-2010
https://dl.acm.org/doi/10.1145/1877766.1877769
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents