Article

Free access

Learning bilingual translations from comparable corpora to cross-language information retrieval: hybrid statistics-based and linguistics-based approach

Authors:

Masatoshi Yoshikawa,

Shunsuke UemuraAuthors Info & Claims

AsianIR '03: Proceedings of the sixth international workshop on Information retrieval with Asian languages - Volume 11

Pages 57 - 64

https://doi.org/10.3115/1118935.1118943

Published: 07 July 2003 Publication History

Abstract

Recent years saw an increased interest in the use and the construction of large corpora. With this increased interest and awareness has come an expansion in the application to knowledge acquisition and bilingual terminology extraction. The present paper will seek to present an approach to bilingual lexicon extraction from non-aligned comparable corpora, combination to linguistics-based pruning and evaluations on Cross-Language Information Retrieval. We propose and explore a two-stages translation model for the acquisition of bilingual terminology from comparable corpora, disambiguation and selection of best translation alternatives on the basis of their morphological knowledge. Evaluations using a large-scale test collection on Japanese-English and different weighting schemes of SMART retrieval system confirmed the effectiveness of the proposed combination of two-stages comparable corpora and linguistics-based pruning on Cross-Language Information Retrieval.

References

[1]

C. Buckley, J. Allan and G. Salton. 1994. Automatic Routing and Ad-hoc Retrieval using Smart. Proc. Second Text Retrieval Conference TREC-2, pages 45--56,

Digital Library

[2]

I. Dagan and I. Itai. 1994. Word Sense Disambiguation using a Second Language Monolingual Corpus. Computational Linguistics, 20(4):563--596.

Digital Library

[3]

H. Dejean, E. Gaussier and F. Sadat. 2002. An Approach based on Multilingual Thesauri and Model Combination for Bilingual Lexicon Extraction. In Proc. COLING 2002.

Digital Library

[4]

M. Diab and S. Finch. 2000. A Statistical Word-level Translation Model for Comparable Corpora. Proc. of the Conference on Content-based Multimedia Information Access RIAO.

[5]

T. Dunning. 1993. Accurate Methods for the Statistics of Surprise and Coincidence. Computational linguistics 19(1).

Digital Library

[6]

EDR. 1996. Japan Electronic Dictionary Research Institute, Ltd. EDR electronic dictionary version 1.5 EDR. Technical guide. Technical report TR2-007.

[7]

A. E. Fox and A. J. Shaw. 1994. Combination of Multiple Searches. Proc. Second Text Retrieval Conference TREC-2, pages 243--252.

[8]

N. Fuhr, U. Pfeifer, C. Bremkamp, M. Pollmann and C. Buckley. 1994. Probabilistic Learning Approaches for Indexing and Retrieval with the TREC-2 Collection. Proc. Second Text Retrieval Conference TREC-2, pages 67--74.

[9]

P. Fung. 2000. A Statistical View of Bilingual Lexicon Extraction: From Parallel Corpora to Non-Parallel Corpora. In Jean Veronis, Ed. Parallel Text Processing.

[10]

D.Hull. 1993. Using Statistical Testing in the Evaluation of Retrieval Experiments. Proc. ACM SIGIR '93, pages 329--338.

Digital Library

[11]

N. Kando. 2001. Overview of the Second NTCIR Workshop. In Proc. Second NTCIR Workshop on Research in Chinese and Japanese Text Retrieval and Text Summarization.

[12]

J. Klavans and E. Tzoukermann. 1996. Combining Corpus and Machine-Readable Dictionary Data for Building Bilingual Lexicons. Machine Translation, 10(3-4): 1--34.

[13]

D. Knaus and P. Shauble. 1993. Effective and Efficient Retrieval from Large and Dynamic Document Collections. Proc. Second Text Retrieval Conference TREC-3, pages 163--170.

[14]

K. Knight and J. Graehl. 1998. Machine Transliteration. Computational Linguistics, 24(4).

Digital Library

[15]

P. Koehn and K. Knight. 2002. Learning a Translation Lexicon from Monolingual Corpora.In Proc. ACL-02 Workshop on Unsupervised Lexical Acquisition.

Digital Library

[16]

Y.Matsumoto, A. Kitauchi, T. Yamashita, O. Imaichi and T. Imamura. 1997. Japanese Morphological Analysis System ChaSen Manual. Technical Report NAIST-IS-TR97007.

[17]

H. Nakagawa. 2000. Disambiguation of Lexical Translations based on Bilingual Comparable Corpora. Proc. LREC2000, Workshop of Terminology Resources and Computation WTRC2000, pages 33--38.

[18]

C. Peters and E. Picchi. 1995. Capturing the comparable: A System for Querying Comparable Text Corpora. Proc. 3rd International Conference on Statistical Analysis of Textual Data, pages 255--262.

[19]

R. Rapp. 1999. Automatic Identification of Word Translations from Unrelated English and German Corpora. In Proc. European Association for Computational Linguistics.

Digital Library

[20]

F. Sadat, M. Yoshikawa and S. Uemura. 2003. Enhancing Cross-language Information Retrieval by an Automatic Acquisition of Bilingual Terminology from Comparable Corpora. In Proc. ACM SIGIR 2003, Toronto, Canada.

Digital Library

[21]

F. Sadat, M. Yoshikawa and S. Uemura. 2003. Bilingual Terminology Acquisition from Comparable Corpora and Phrasal Translation to Cross-Language Information Retrieval. In Proc. ACL 2003, Sapporo, Japan.

Digital Library

[22]

G. Salton. 1971. The SMART Retrieval System, Experiments in Automatic Documents Processing. Prentice-Hall, Inc., Englewood Cliffs, NJ.

Digital Library

[23]

G. Salton and J. McGill. 1983. Introduction to Modern Information Retrieval. New York, Mc Graw-Hill.

Digital Library

[24]

J. Savoy. 2003. Cross-Language Information Retrieval: Experiments based on CLEF 2000 Corpora. Information Processing & Management 39(1):75--115.

Digital Library

[25]

S. Sekine. 2001. OAK System-Manual. New York University.

[26]

I. Shahzad, K. Ohtake, S. Masuyama and K. Yamamoto. 1999. Identifying Translations of Compound using Non-aligned Corpora. Proc. Workshop MAL, pages 108--113.

[27]

K. Tanaka and H. Iwasaki. 1996 Extraction of Lexical Translations from Non-aligned Corpora. Proc. COLING 96.

Digital Library

Cited By

Kishida KIshita E(2018)Translation disambiguation for cross-language information retrieval using context-based translation probabilityJournal of Information Science10.1177/016555150910359935:4(481-495)Online publication date: 28-Dec-2018
https://dl.acm.org/doi/10.1177/0165551509103599
Lee LAw AZhang MLi HJoshi AHuang CJurafsky D(2010)EM-based hybrid model for bilingual terminology extraction from comparable corporaProceedings of the 23rd International Conference on Computational Linguistics: Posters10.5555/1944566.1944639(639-646)Online publication date: 23-Aug-2010
https://dl.acm.org/doi/10.5555/1944566.1944639
Sadat F(2010)Using comparable corpora to improve the effectiveness of cross-language information retrievalProceedings of the 7th international conference on Advances in natural language processing10.5555/1884371.1884409(320-331)Online publication date: 16-Aug-2010
https://dl.acm.org/doi/10.5555/1884371.1884409
Show More Cited By

Learning bilingual translations from comparable corpora to cross-language information retrieval: hybrid statistics-based and linguistics-based approach

Recommendations

Enhancing cross-language information retrieval by an automatic acquisition of bilingual terminology from comparable corpora
SIGIR '03: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval

This paper presents an approach to bilingual lexicon extraction from comparable corpora and evaluations on Cross-Language Information Retrieval. We explore a bi-directional extraction of bilingual terminology primarily from comparable corpora. A ...
Using comparable corpora to improve the effectiveness of cross-language information retrieval
IceTAL'10: Proceedings of the 7th international conference on Advances in natural language processing

Large-scale comparable corpora became more abundant and accessible than parallel corpora, with the explosive growth of the World Wide Web. From the Cross-Language Information Retrieval point of view, limitation of translation resources as well as ...
Extracting translations from comparable corpora for Cross-Language Information Retrieval using the language modeling framework

Proposing a language modeling method to extract translations from comparable corpora.Comparing two similarity functions for deriving bilingual word correlations.Improving translation quality by integrating co-occurrence relations into word ...

Comments

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

AsianIR '03: Proceedings of the sixth international workshop on Information retrieval with Asian languages - Volume 11

July 2003

175 pages

Program Chair:
Jun Adachi
National Institute of Informatics

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 07 July 2003

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
487
Total Downloads

Downloads (Last 12 months)43
Downloads (Last 6 weeks)5

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kishida KIshita E(2018)Translation disambiguation for cross-language information retrieval using context-based translation probabilityJournal of Information Science10.1177/016555150910359935:4(481-495)Online publication date: 28-Dec-2018
https://dl.acm.org/doi/10.1177/0165551509103599
Lee LAw AZhang MLi HJoshi AHuang CJurafsky D(2010)EM-based hybrid model for bilingual terminology extraction from comparable corporaProceedings of the 23rd International Conference on Computational Linguistics: Posters10.5555/1944566.1944639(639-646)Online publication date: 23-Aug-2010
https://dl.acm.org/doi/10.5555/1944566.1944639
Sadat F(2010)Using comparable corpora to improve the effectiveness of cross-language information retrievalProceedings of the 7th international conference on Advances in natural language processing10.5555/1884371.1884409(320-331)Online publication date: 16-Aug-2010
https://dl.acm.org/doi/10.5555/1884371.1884409
Sadat F(2010)Exploiting comparable corpora for cross-language information retrievalProceedings of the 11th Pacific Rim international conference on Trends in artificial intelligence10.5555/1884293.1884363(662-667)Online publication date: 30-Aug-2010
https://dl.acm.org/doi/10.5555/1884293.1884363
Lee LAw AVu TMahani SZhang MLi HLee GSchulte im Walde S(2009)MARSProceedings of the ACL-IJCNLP 2009 Software Demonstrations10.5555/1667872.1667878(21-24)Online publication date: 3-Aug-2009
https://dl.acm.org/doi/10.5555/1667872.1667878
Peirsman YPadó S(2008)Semantic relations in bilingual lexiconsACM Transactions on Speech and Language Processing (TSLP)10.1145/2050100.20501028:2(1-21)Online publication date: 6-Dec-2008
https://dl.acm.org/doi/10.1145/2050100.2050102
Morin EDaille BTakeuchi KKageura K(2008)Brains, not brawnACM Transactions on Speech and Language Processing (TSLP)10.1145/1839478.18394797:1(1-23)Online publication date: 4-Oct-2008
https://dl.acm.org/doi/10.1145/1839478.1839479
Echizen-ya HAraki KMomouchi Y(2006)Automatic extraction of bilingual word pairs using inductive chain learning in various languagesInformation Processing and Management: an International Journal10.1016/j.ipm.2005.11.00442:5(1294-1315)Online publication date: 1-Sep-2006
https://dl.acm.org/doi/10.1016/j.ipm.2005.11.004
Fattah MRen FKuroiwa S(2006)Stemming to improve translation lexicon creation form bitextsInformation Processing and Management: an International Journal10.1016/j.ipm.2005.07.00242:4(1003-1016)Online publication date: 1-Jul-2006
https://dl.acm.org/doi/10.1016/j.ipm.2005.07.002
Sadat FSoulé-Dupuis C(2004)Knowledge acquisition from collections of news articles to cross-language information retrievalCoupling approaches, coupling media and coupling languages for information retrieval10.5555/2816272.2816318(504-513)Online publication date: 26-Apr-2004
https://dl.acm.org/doi/10.5555/2816272.2816318

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents