In this paper, we present a modular approach to error analysis and evaluation; we use manually-constructed, gold-standard input for each module to obtain an ...

We presented a modular method for evaluating a complex multilingual Question Answering system. Our analysis using different levels of goldstandard input.

The QA module is responsible for parsing the input question, choosing the appropriate answer type, and producing a set of keywords. The TM module translates the ...

In this paper, we present a modular approach to error analysis and evaluation ; we use manuallyconstructed, goldstandard input for each module to obtain an ...

2006. pdf bib abs. Modular Approach to Error Analysis and Evaluation for Multilingual Question Answering · Hideki Shima | Mengqiu Wang | Frank Lin | ...

Apr 28, 2023 · The results and error analysis suggest that an end-to-end strategy to decide if timexes can be normalized, and to ignore them if not, is highly ...

Modular Approach to Error Analysis and Evaluation for Multilingual Question Answering. Article. Full-text available. Jan 2006. Hideki Shima ...

Modular Approach to Error Analysis and Evaluation for Multilingual Question Answering. H Shima, M Wang, F Lin, T Mitamura. LREC, 1143-1146, 2006. 6, 2006.

Sep 2, 2020 · This chapter describes the component-based evaluation of automatic question answering (QA) systems, which was pioneered in the NTCIR-7 ACLIA challenge.

Detecting and normalizing temporal expressions is an essential step for many NLP tasks. While a variety of methods have been proposed for detection, ...