Performance issues and error analysis in an open-domain question answering system

Dan Moldovan, Marius Paşca, Sanda Harabagiu, Mihai Surdeanu

Research output: Contribution to journalArticle

127 Scopus citations

Abstract

This paper presents an in-depth analysis of a state-of-the-art Question Answering system. Several scenarios are examined: (1) the performance of each module in a serial baseline system, (2) the impact of feedbacks and the insertion of a logic prover, and (3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.

Original languageEnglish (US)
Pages (from-to)133-154
Number of pages22
JournalACM Transactions on Information Systems
Volume21
Issue number2
DOIs
StatePublished - Apr 1 2003
Externally publishedYes

Keywords

  • Natural language applications
  • Performance analysis
  • Question answering
  • Text retrieval

ASJC Scopus subject areas

  • Information Systems
  • Business, Management and Accounting(all)
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Performance issues and error analysis in an open-domain question answering system'. Together they form a unique fingerprint.

  • Cite this