CI Spider: A tool for competitive intelligence on the Web

Hsinchun Chen, Michael Chau, Daniel Zeng

Research output: Contribution to journalArticle

101 Scopus citations

Abstract

Competitive Intelligence (CI) aims to monitor a firm's external environment for information relevant to its decision-making process. As an excellent information source, the Internet provides significant opportunities for CI professionals as well as the problem of information overload. Internet search engines have been widely used to facilitate information search on the Internet. However, many problems hinder their effective use in CI research. In this paper, we introduce the Competitive Intelligence Spider, or CI Spider, designed to address some of the problems associated with using Internet search engines in the context of competitive intelligence. CI Spider performs real-time collection of Web pages from sites specified by the user and applies indexing and categorization analysis on the documents collected, thus providing the user with an up-to-date, comprehensive view of the Web sites of user interest. In this paper, we report on the design of the CI Spider system and on a user study of CI Spider, which compares CI Spider with two other alternative focused information gathering methods: Lycos search constrained by Internet domain, and manual within-site browsing and searching. Our study indicates that CI Spider has better precision and recall rate than Lycos. CI Spider also outperforms both Lycos and within-site browsing and searching with respect to ease of use. We conclude that there exists strong evidence in support of the potentially significant value of applying the CI Spider approach in CI applications.

Original languageEnglish (US)
Pages (from-to)1-17
Number of pages17
JournalDecision Support Systems
Volume34
Issue number1
DOIs
StatePublished - Dec 2002

Keywords

  • Competitive intelligence
  • Document clustering
  • Experimental research
  • Internet searching and browsing
  • Internet spider
  • Noun phrasing

ASJC Scopus subject areas

  • Management Information Systems
  • Information Systems
  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)
  • Information Systems and Management

Fingerprint Dive into the research topics of 'CI Spider: A tool for competitive intelligence on the Web'. Together they form a unique fingerprint.

  • Cite this