Article

Free access

Paraphrasing rules for automatic evaluation of translation into Japanese

Author:

Kanayama HiroshiAuthors Info & Claims

PARAPHRASE '03: Proceedings of the second international workshop on Paraphrasing - Volume 16

Pages 88 - 93

https://doi.org/10.3115/1118984.1118996

Published: 11 July 2003 Publication History

PDF eReader

Abstract

Automatic evaluation of translation quality has proved to be useful when the target language is English. In this paper the evaluation of translation into Japanese is studied. An existing method based on n-gram similarity between translations and reference sentences is difficult to apply to the evaluation of Japanese because of the agglutinativeness and variation of semantically similar expressions in Japanese. The proposed method applies a set of paraphrasing rules to the reference sentences in order to increase the similarity score for the expressions that differ only in their writing styles. Experimental results show the paraphrasing rules improved the correlation between automatic evaluation and human evaluation from 0.80 to 0.93.

References

[1]

Teruko Mitamura and Eric Nyberg. 2001. Automatic rewriting for controlled language translation. In Proc. of NLPRS2001 Workshop on Automatic Paraphrasing, pages 1--12.

Google Scholar

[2]

Kishore Papineni, Salim Roukos, Todd Ward, John Henderson, and Florence Reeder. 2002a. Corpus-based comprehensive and diagnostic MT evaluation: Initial Arabic, Chinese, French, and Spanish results. In Proc. of HLT2002, pages 124--127.

Digital Library

Google Scholar

[3]

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002b. BLEU: a method for automatic evaluation of machine translation. In Proc. of the 40th ACL, pages 311--318.

Digital Library

Google Scholar

[4]

Tetsuro Takahashi, Tomoya Iwakura, Ryu Iida, and Kentaro Inui. 2001. Kura: A revision-based lexico-structural paraphrasing engine. In Proc. of NLPRS2001 Workshop on Automatic Paraphrasing, pages 37--46.

Google Scholar

[5]

Kentaro Torisawa. 2002. An unsupervised learning method for associative relationships between verb phrases. In Proc. of COLING 2002, pages 1009--1015.

Digital Library

Google Scholar

[6]

Ingrid Zukerman and Bhavani Raskutti. 2002. Lexical query paraphrasing for document retrieval. In Proc. of COLING 2002, pages 1177--1183.

Digital Library

Google Scholar

Cited By

View all

Faruqui MPadó SDaelemans W(2012)Towards a model of formal and informal address in EnglishProceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics10.5555/2380816.2380892(623-633)Online publication date: 23-Apr-2012
https://dl.acm.org/doi/10.5555/2380816.2380892
Faruqui MPadó SLin D(2011)"I thou thee, thou traitor"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 210.5555/2002736.2002830(467-472)Online publication date: 19-Jun-2011
https://dl.acm.org/doi/10.5555/2002736.2002830
Hirahara KNanba HTakezawa TOkumura M(2009)Automatic evaluation of texts by using paraphrasesProceedings of the 4th conference on Human language technology: challenges for computer science and linguistics10.5555/1987717.1987779(556-566)Online publication date: 6-Nov-2009
https://dl.acm.org/doi/10.5555/1987717.1987779
Show More Cited By

Paraphrasing rules for automatic evaluation of translation into Japanese

Recommendations

Automatic Extraction of Rules for AnaphoraResolution of Japanese Zero Pronouns in Japanese–English Machine Translation from Aligned Sentence Pairs

This paper proposes a method to extract rules for the anaphora resolution of Japanese zero pronouns in Japanese–English MT from aligned sentence pairs. After aligned sentence pairs unsuitable for rule extraction because of analysis errors or free ...
Paraphrasing for automatic evaluation
HLT-NAACL '06: Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics

This paper studies the impact of paraphrases on the accuracy of automatic evaluation. Given a reference sentence and a machine-generated sentence, we seek to find a paraphrase of the reference sentence that is closer in wording to the machine output ...
Automatic transliteration for Japanese-to-English text retrieval
SIGIR '03: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval

For cross language information retrieval (CLIR) based on bilingual translation dictionaries, good performance depends upon lexical coverage in the dictionary. This is especially true for languages possessing few inter-language cognates, such as between ...

Comments

Information & Contributors

Information

Published In

PARAPHRASE '03: Proceedings of the second international workshop on Paraphrasing - Volume 16

July 2003

103 pages

Conference Chairs:
Kentaro Inui
Nara Institute of Science and Technology, Japan
,
Ulf Hermjakob
USC Information Science Institute, USA

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 11 July 2003

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
230
Total Downloads

Downloads (Last 12 months)64
Downloads (Last 6 weeks)19

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Faruqui MPadó SDaelemans W(2012)Towards a model of formal and informal address in EnglishProceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics10.5555/2380816.2380892(623-633)Online publication date: 23-Apr-2012
https://dl.acm.org/doi/10.5555/2380816.2380892
Faruqui MPadó SLin D(2011)"I thou thee, thou traitor"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 210.5555/2002736.2002830(467-472)Online publication date: 19-Jun-2011
https://dl.acm.org/doi/10.5555/2002736.2002830
Hirahara KNanba HTakezawa TOkumura M(2009)Automatic evaluation of texts by using paraphrasesProceedings of the 4th conference on Human language technology: challenges for computer science and linguistics10.5555/1987717.1987779(556-566)Online publication date: 6-Nov-2009
https://dl.acm.org/doi/10.5555/1987717.1987779
Li WLiu TLi S(2004)Combining sentence length with location information to align monolingual parallel textsProceedings of the 2004 international conference on Asian Information Retrieval Technology10.1007/978-3-540-31871-2_11(118-128)Online publication date: 18-Oct-2004
https://dl.acm.org/doi/10.1007/978-3-540-31871-2_11

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Recommendations

Automatic Extraction of Rules for AnaphoraResolution of Japanese Zero Pronouns in Japanese–English Machine Translation from Aligned Sentence Pairs

Paraphrasing for automatic evaluation

Automatic transliteration for Japanese-to-English text retrieval

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations