Stochastic resonance in iterative decoding: Message passing and gradient descent bit flipping

Predrag Ivanis, Srdan Brkic, Bane Vasic

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper contains a survey on iterative decoders of low-density parity-check (LDPC) codes made of unreliable logic gates that are capable to provide lower probability of error, when compared to their perfectly reliable counterparts. We have recently shown that the error-floor performance of message-passing decoders can be improved, if randomness that exists in unreliable logic gates is incorporated into decoding deliberately, without any complexity cost. Furthermore, we have shown that controlling the level of unreliability enable us to exploit the stochastic resonance phenomenon, previously observed in theoretical physics, electronic and magnetic systems. In contrary to common belief, we have shown that for a narrow range of gate failure probability the overall decoding performance is dramatically increased. In this paper, we show that the effect of stochastic resonance is even more noticeable for the case of the gradient descent bit-flipping (GDBF) algorithm. This decoder combines the simplest iterative decoding algorithm with gradient descent optimization, making it an attractive solution for a variety of low complexity storage systems, or code-based cryptosystems. In addition, we show that getting the most of the stochastic resonance is essentially a deep learning problem, since setting the levels of unreliability for individual parts of the decoder by a training process is a step toward incorporating the machine learning techniques into design and analysis of iterative decoders of LDPC codes.

Original languageEnglish (US)
Title of host publication2017 13th International Conference on Advanced Technologies, Systems and Services in Telecommunications, TELSIKS 2017 - Proceeding
EditorsBratislav D. Milovanovic, Nebojsa S. Doncov, Zoran Z. Stankovic, Tijana Z. Dimitrijevic
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages300-307
Number of pages8
ISBN (Electronic)9781538618004
DOIs
StatePublished - Jun 28 2017
Event13th International Conference on Advanced Technologies, Systems and Services in Telecommunications, TELSIKS 2017 - Nis, Serbia
Duration: Oct 18 2017Oct 20 2017

Publication series

Name2017 13th International Conference on Advanced Technologies, Systems and Services in Telecommunications, TELSIKS 2017 - Proceeding
Volume2017-October

Other

Other13th International Conference on Advanced Technologies, Systems and Services in Telecommunications, TELSIKS 2017
CountrySerbia
CityNis
Period10/18/1710/20/17

Keywords

  • Bit-flipping
  • Fault-Tolerance
  • Gallager B
  • Gradient-descent
  • Low-Density Parity-Check codes
  • Stochastic resonance

ASJC Scopus subject areas

  • Computer Science Applications
  • Hardware and Architecture
  • Signal Processing
  • Computer Networks and Communications
  • Safety, Risk, Reliability and Quality

Fingerprint Dive into the research topics of 'Stochastic resonance in iterative decoding: Message passing and gradient descent bit flipping'. Together they form a unique fingerprint.

  • Cite this

    Ivanis, P., Brkic, S., & Vasic, B. (2017). Stochastic resonance in iterative decoding: Message passing and gradient descent bit flipping. In B. D. Milovanovic, N. S. Doncov, Z. Z. Stankovic, & T. Z. Dimitrijevic (Eds.), 2017 13th International Conference on Advanced Technologies, Systems and Services in Telecommunications, TELSIKS 2017 - Proceeding (pp. 300-307). (2017 13th International Conference on Advanced Technologies, Systems and Services in Telecommunications, TELSIKS 2017 - Proceeding; Vol. 2017-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/TELSKS.2017.8246285