Performance issues and error analysis in an open-domain question answering system

Dan Moldovan, Marius Paşca, Sanda Harabagiu, Mihai Surdeanu

Research output: Contribution to journalArticle

116 Citations (Scopus)

Abstract

This paper presents an in-depth analysis of a state-of-the-art Question Answering system. Several scenarios are examined: (1) the performance of each module in a serial baseline system, (2) the impact of feedbacks and the insertion of a logic prover, and (3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.

Original languageEnglish (US)
Pages (from-to)133-154
Number of pages22
JournalACM Transactions on Information Systems
Volume21
Issue number2
DOIs
StatePublished - Apr 2003
Externally publishedYes

Fingerprint

Error analysis
Feedback
Processing
Question answering
Resources
Serials
Module
Logic
Scenarios
Natural language processing

Keywords

  • Natural language applications
  • Performance analysis
  • Question answering
  • Text retrieval

ASJC Scopus subject areas

  • Information Systems

Cite this

Performance issues and error analysis in an open-domain question answering system. / Moldovan, Dan; Paşca, Marius; Harabagiu, Sanda; Surdeanu, Mihai.

In: ACM Transactions on Information Systems, Vol. 21, No. 2, 04.2003, p. 133-154.

Research output: Contribution to journalArticle

Moldovan, Dan ; Paşca, Marius ; Harabagiu, Sanda ; Surdeanu, Mihai. / Performance issues and error analysis in an open-domain question answering system. In: ACM Transactions on Information Systems. 2003 ; Vol. 21, No. 2. pp. 133-154.
@article{4ec332d2822b4c8eb0a49ebb272e5051,
title = "Performance issues and error analysis in an open-domain question answering system",
abstract = "This paper presents an in-depth analysis of a state-of-the-art Question Answering system. Several scenarios are examined: (1) the performance of each module in a serial baseline system, (2) the impact of feedbacks and the insertion of a logic prover, and (3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.",
keywords = "Natural language applications, Performance analysis, Question answering, Text retrieval",
author = "Dan Moldovan and Marius Paşca and Sanda Harabagiu and Mihai Surdeanu",
year = "2003",
month = "4",
doi = "10.1145/763693.763694",
language = "English (US)",
volume = "21",
pages = "133--154",
journal = "ACM Transactions on Information Systems",
issn = "1046-8188",
publisher = "Association for Computing Machinery (ACM)",
number = "2",

}

TY - JOUR

T1 - Performance issues and error analysis in an open-domain question answering system

AU - Moldovan, Dan

AU - Paşca, Marius

AU - Harabagiu, Sanda

AU - Surdeanu, Mihai

PY - 2003/4

Y1 - 2003/4

N2 - This paper presents an in-depth analysis of a state-of-the-art Question Answering system. Several scenarios are examined: (1) the performance of each module in a serial baseline system, (2) the impact of feedbacks and the insertion of a logic prover, and (3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.

AB - This paper presents an in-depth analysis of a state-of-the-art Question Answering system. Several scenarios are examined: (1) the performance of each module in a serial baseline system, (2) the impact of feedbacks and the insertion of a logic prover, and (3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.

KW - Natural language applications

KW - Performance analysis

KW - Question answering

KW - Text retrieval

UR - http://www.scopus.com/inward/record.url?scp=2442589044&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=2442589044&partnerID=8YFLogxK

U2 - 10.1145/763693.763694

DO - 10.1145/763693.763694

M3 - Article

AN - SCOPUS:2442589044

VL - 21

SP - 133

EP - 154

JO - ACM Transactions on Information Systems

JF - ACM Transactions on Information Systems

SN - 1046-8188

IS - 2

ER -