Reinforcement learning for hybrid beamforming in millimeter wave systems

Ture Peken, Ravi Tandon, Tamal Bose

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The use of millimeter waves (mmWave) for next-generation cellular systems is promising due to the large bandwidth available in this band. Beamforming will likely be divided into RF and baseband domains, which is called hybrid beamforming. Precoders can be designed by using a predefined codebook or by choosing beamforming vectors arbitrarily in hybrid beamforming. The computational complexity of finding optimal precoders grows exponentially with the number of RF chains. In this paper, we develop a Q-learning (a form of reinforcement learning) based algorithm to find the precoders jointly. We analyze the complexity of the algorithm as a function of the number of iterations used in the training phase. We compare the spectral efficiency achieved with unconstrained precoding, exhaustive search, and another state-of-art algorithm. Results show that our algorithm provides better spectral efficiency than the state-of-art algorithm and has performance close to that of exhaustive search.

Original languageEnglish (US)
Title of host publication55th Annual International Telemetering Conference, ITC 2019
Subtitle of host publicationCultivating the Next Generation of Range Engineers
PublisherInternational Foundation for Telemetering
Pages138-147
Number of pages10
ISBN (Electronic)9781713801887
StatePublished - 2019
Event55th Annual International Telemetering Conference: Cultivating the Next Generation of Range Engineers, ITC 2019 - Las Vegas, United States
Duration: Oct 21 2019Oct 24 2019

Publication series

NameProceedings of the International Telemetering Conference
Volume55
ISSN (Print)0884-5123

Conference

Conference55th Annual International Telemetering Conference: Cultivating the Next Generation of Range Engineers, ITC 2019
CountryUnited States
CityLas Vegas
Period10/21/1910/24/19

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing
  • Electrical and Electronic Engineering
  • Instrumentation

Fingerprint Dive into the research topics of 'Reinforcement learning for hybrid beamforming in millimeter wave systems'. Together they form a unique fingerprint.

Cite this