Interaction analysis of the ALICE chatterbot: A two-study investigation of dialog and domain questioning

Robert P. Schumaker, Hsinchun Chen

Research output: Contribution to journalArticle

7 Scopus citations

Abstract

This paper analyzes and compares the data gathered from two previously conducted Artificial Linguistic Internet Chat Entity (ALICE) chatterbot studies that were focused on response accuracy and user satisfaction measures for six chatterbots. These chatterbots were further loaded with varying degrees of conversational, telecommunications, and terrorism knowledge. From our prior experiments using 347 participants, we obtained 33 446 human/chatterbot interactions. It was found that asking the ALICE chatterbots "are" and "where" questions resulted in higher response satisfaction levels, as compared to other interrogative-style inputs because of their acceptability to vague,binary, or clichéd chatterbot responses. We also found a relationship between the length of a query and the users perceived satisfaction of the chatterbot response, where shorter queries led to more satisfying responses.

Original languageEnglish (US)
Article number5272316
Pages (from-to)40-51
Number of pages12
JournalIEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans
Volume40
Issue number1
DOIs
StatePublished - Jan 1 2010

    Fingerprint

Keywords

  • Artificial linguistic internet chat entity (ALICE)
  • Chatterbot
  • Dialog platform
  • Domain-specific knowledge
  • Evaluation
  • Knowledge delivery

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Human-Computer Interaction
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this