Disease named entity recognition using semisupervised learning and conditional random fields

Nichalin Suakkaphong, Zhu Zhang, Hsinchun Chen

Research output: Contribution to journalArticle

12 Scopus citations

Abstract

Information extraction is an important text-mining task that aims at extracting prespecified types of information from large text collections and making them available in structured representations such as databases. In the biomedical domain, information extraction can be applied to help biologists make the most use of their digital-literature archives. Currently, there are large amounts of biomedical literature that contain rich information about biomedical substances. Extracting such knowledge requires a good named entity recognition technique. In this article, we combine conditional random fields (CRFs), a state-of-the-art sequence-labeling algorithm, with two semisupervised learning techniques, bootstrapping and feature sampling, to recognize disease names from biomedical literature. Two data-processing strategies for each technique also were analyzed: one sequentially processing unlabeled data partitions and another one processing unlabeled data partitions in a round-robin fashion. The experimental results showed the advantage of semisupervised learning techniques given limited labeled training data. Specifically, CRFs with bootstrapping implemented in sequential fashion outperformed strictly supervised CRFs for disease name recognition. The project was supported by NIH/NLM Grant R33 LM07299-01, 2002-2005.

Original languageEnglish (US)
Pages (from-to)727-737
Number of pages11
JournalJournal of the American Society for Information Science and Technology
Volume62
Issue number4
DOIs
StatePublished - Apr 1 2011

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Human-Computer Interaction
  • Computer Networks and Communications
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Disease named entity recognition using semisupervised learning and conditional random fields'. Together they form a unique fingerprint.

  • Cite this