SGCNAX: A Scalable Graph Convolutional Neural Network Accelerator with Workload Balancing

Jiajun Li, Hao Zheng, Ke Wang, Ahmed Louri

Research output: Contribution to journalArticlepeer-review

Abstract

Graph Convolutional Neural Networks (GCNs) have emerged as promising tools for graph-based machine learning applications. Given that GCNs are both compute- and memory-intensive, this constitutes a major challenge for the underlying hardware to efficiently process large-scale GCNs. In this paper, we introduce SGCNAX, a scalable GCN accelerator architecture for the high-performance and energy-efficient acceleration of GCNs. Unlike prior GCN accelerators that either employ limited loop optimization techniques, or determine the design variables based on random sampling, we systematically explore the loop optimization techniques for GCN acceleration and propose a flexible GCN dataflow that adapts to different GCN configurations to achieve optimal efficiency. We further propose two hardware-based techniques to address the workload imbalance problem caused by the unbalanced distribution of zeros in GCNs. Specifically, SGCNAX exploits an outer-product-based computation architecture that mitigates the intra-PE (Processing Elements) workload imbalance, and employs a group-and-shuffle approach to mitigate the inter-PE workload imbalance. Simulation results show that SGCNAX performs 9.2x, 1.6x and 1.2x better, and reduces DRAM accesses by a factor of 9.7x, 2.9x and 1.2x compared to HyGCN, AWB-GCN, and GCNAX, respectively.

Original languageEnglish (US)
JournalIEEE Transactions on Parallel and Distributed Systems
DOIs
StateAccepted/In press - 2021
Externally publishedYes

Keywords

  • Accelerator architectures
  • Computational modeling
  • Dataflow accelerators
  • Domain-specific accelerators
  • Engines
  • Graph convolutional neural networks
  • Memory access optimization
  • Neural networks
  • Optimization
  • Random access memory
  • Registers

ASJC Scopus subject areas

  • Signal Processing
  • Hardware and Architecture
  • Computational Theory and Mathematics

Fingerprint

Dive into the research topics of 'SGCNAX: A Scalable Graph Convolutional Neural Network Accelerator with Workload Balancing'. Together they form a unique fingerprint.

Cite this