Alleviating search uncertainty through concept associations: Automatic indexing, co-occurrence analysis, and parallel computing

Hsinchun Chen, Joanne Martinez, Amy Kirchhoff, Tobun D. Ng, Bruce R. Schatz

Research output: Contribution to journalArticle

Abstract

In this article, we report research on an algorithmic approach to alleviating search uncertainty in a large information space. Grounded on object filtering, automatic indexing, and co-occurrence analysis, we performed a large-scale experiment using a parallel supercomputer (SGI Power Challenge) to analyze 400,000+ abstracts in an INSPEC computer engineering collection. Two system-generated thesauri, one based on a combined object filtering and automatic indexing method, and the other based on automatic indexing only, were compared with the human-generated INSPEC subject thesaurus. Our user evaluation revealed that the system-generated thesauri were better than the INSPEC thesaurus in concept recall, but in concept precision the 3 thesauri were comparable. Our analysis also revealed that the terms suggested by the 3 thesauri were complementary and could be used to significantly increase "variety" in search terms and thereby reduce search uncertainty.

Original languageEnglish (US)
Pages (from-to)206-216
Number of pages11
JournalJournal of the American Society for Information Science
Volume49
Issue number3
DOIs
StatePublished - 1998

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'Alleviating search uncertainty through concept associations: Automatic indexing, co-occurrence analysis, and parallel computing'. Together they form a unique fingerprint.

  • Cite this