Quantum probability-inspired graph neural network for document representation and classification

Peng Yan, Linjing Li, Miaotianzi Jin, Daniel Zeng

Research output: Contribution to journalArticlepeer-review

Abstract

Recent studies have found that text can be represented in Hilbert space through a neural network driven by quantum probability, which provides a unified representation of texts with different granularities without losing the performance of downstream tasks. However, these quantum probability-inspired methods only focus on intra-document semantics and lack modeling global structural information. In this paper, we explore the potential of combining quantum probability with graph neural network, and propose a quantum probability-inspired graph neural network model to capture global structural information of interaction between documents for document representation and classification. We build a document interaction graph for a given corpus based on document word relation and frequency information, then learn a graph neural network driven by quantum probability on the defined graph. First, the proposed model represents each document node in the graph as a superposition state in a Hilbert space. Then the proposed model further computes density matrix representations for nodes to encode document interaction as mixed states. Finally, the model computes classification probability by performing quantum measurement on the mixed states. Experiments on four document classification benchmarks show that the proposed model outperforms a variety of classical neural network models and the previous quantum probability-inspired model with much smaller parameter size. Extended analyses also demonstrate the robustness of the proposed model with limited training data and its ability to learn semantically distinguishable document representation.

Original languageEnglish (US)
Pages (from-to)276-286
Number of pages11
JournalNeurocomputing
Volume445
DOIs
StatePublished - Jul 20 2021
Externally publishedYes

Keywords

  • Document classification
  • Document representation
  • Graph neural network
  • Natural language processing
  • Quantum probability

ASJC Scopus subject areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Quantum probability-inspired graph neural network for document representation and classification'. Together they form a unique fingerprint.

Cite this