Online Reconfigurable Antenna State Selection based on Thompson Sampling

Tianchi Zhao, Ming Li, Gregory Ditzler

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Reconfigurable antennas (RAs) are capable of dynamically and swiftly changing their radiation patterns, which enables them to adapt to channel variations and enhance link capacity. To fully exploit the benefits of RAs, the antenna states need to be optimally selected on-the-fly. The main challenges are two-fold: uncertainty of channel over time, and a large number of candidate antenna states. Previous approaches can only deal with a small number of antenna states, or suffer from slow convergence. In this paper, we propose an optimal online antenna state selection framework for SISO and MISO wireless links, based on the Thompson sampling algorithm for general stochastic bandits. In order to enhance the convergence rate for large antenna state sets, we propose two novel antenna state pruning strategies and integrate them with Thompson sampling, which exploit the relationship between antenna radiation pattern and channel state. The first one requires knowledge of angles of departure of the channel, while guaranteeing convergence to optimality. The other one doesn't require any prior channel information. Simulation results using a real-world reconfigurable antenna's radiation patterns show that, both of our proposed learning algorithms can significantly improve the convergence rate and yield much lower regret compared with existing schemes.

Original languageEnglish (US)
Title of host publication2019 International Conference on Computing, Networking and Communications, ICNC 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages888-893
Number of pages6
ISBN (Electronic)9781538692233
DOIs
StatePublished - Apr 8 2019
Event2019 International Conference on Computing, Networking and Communications, ICNC 2019 - Honolulu, United States
Duration: Feb 18 2019Feb 21 2019

Publication series

Name2019 International Conference on Computing, Networking and Communications, ICNC 2019

Conference

Conference2019 International Conference on Computing, Networking and Communications, ICNC 2019
CountryUnited States
CityHonolulu
Period2/18/192/21/19

Fingerprint

Stochastic systems
Antennas
Sampling
Directional patterns (antenna)
Learning algorithms
Telecommunication links

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Software
  • Hardware and Architecture

Cite this

Zhao, T., Li, M., & Ditzler, G. (2019). Online Reconfigurable Antenna State Selection based on Thompson Sampling. In 2019 International Conference on Computing, Networking and Communications, ICNC 2019 (pp. 888-893). [8685555] (2019 International Conference on Computing, Networking and Communications, ICNC 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCNC.2019.8685555

Online Reconfigurable Antenna State Selection based on Thompson Sampling. / Zhao, Tianchi; Li, Ming; Ditzler, Gregory.

2019 International Conference on Computing, Networking and Communications, ICNC 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 888-893 8685555 (2019 International Conference on Computing, Networking and Communications, ICNC 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zhao, T, Li, M & Ditzler, G 2019, Online Reconfigurable Antenna State Selection based on Thompson Sampling. in 2019 International Conference on Computing, Networking and Communications, ICNC 2019., 8685555, 2019 International Conference on Computing, Networking and Communications, ICNC 2019, Institute of Electrical and Electronics Engineers Inc., pp. 888-893, 2019 International Conference on Computing, Networking and Communications, ICNC 2019, Honolulu, United States, 2/18/19. https://doi.org/10.1109/ICCNC.2019.8685555
Zhao T, Li M, Ditzler G. Online Reconfigurable Antenna State Selection based on Thompson Sampling. In 2019 International Conference on Computing, Networking and Communications, ICNC 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 888-893. 8685555. (2019 International Conference on Computing, Networking and Communications, ICNC 2019). https://doi.org/10.1109/ICCNC.2019.8685555
Zhao, Tianchi ; Li, Ming ; Ditzler, Gregory. / Online Reconfigurable Antenna State Selection based on Thompson Sampling. 2019 International Conference on Computing, Networking and Communications, ICNC 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 888-893 (2019 International Conference on Computing, Networking and Communications, ICNC 2019).
@inproceedings{1c937d15b7174fabac0b751d1366056b,
title = "Online Reconfigurable Antenna State Selection based on Thompson Sampling",
abstract = "Reconfigurable antennas (RAs) are capable of dynamically and swiftly changing their radiation patterns, which enables them to adapt to channel variations and enhance link capacity. To fully exploit the benefits of RAs, the antenna states need to be optimally selected on-the-fly. The main challenges are two-fold: uncertainty of channel over time, and a large number of candidate antenna states. Previous approaches can only deal with a small number of antenna states, or suffer from slow convergence. In this paper, we propose an optimal online antenna state selection framework for SISO and MISO wireless links, based on the Thompson sampling algorithm for general stochastic bandits. In order to enhance the convergence rate for large antenna state sets, we propose two novel antenna state pruning strategies and integrate them with Thompson sampling, which exploit the relationship between antenna radiation pattern and channel state. The first one requires knowledge of angles of departure of the channel, while guaranteeing convergence to optimality. The other one doesn't require any prior channel information. Simulation results using a real-world reconfigurable antenna's radiation patterns show that, both of our proposed learning algorithms can significantly improve the convergence rate and yield much lower regret compared with existing schemes.",
author = "Tianchi Zhao and Ming Li and Gregory Ditzler",
year = "2019",
month = "4",
day = "8",
doi = "10.1109/ICCNC.2019.8685555",
language = "English (US)",
series = "2019 International Conference on Computing, Networking and Communications, ICNC 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "888--893",
booktitle = "2019 International Conference on Computing, Networking and Communications, ICNC 2019",

}

TY - GEN

T1 - Online Reconfigurable Antenna State Selection based on Thompson Sampling

AU - Zhao, Tianchi

AU - Li, Ming

AU - Ditzler, Gregory

PY - 2019/4/8

Y1 - 2019/4/8

N2 - Reconfigurable antennas (RAs) are capable of dynamically and swiftly changing their radiation patterns, which enables them to adapt to channel variations and enhance link capacity. To fully exploit the benefits of RAs, the antenna states need to be optimally selected on-the-fly. The main challenges are two-fold: uncertainty of channel over time, and a large number of candidate antenna states. Previous approaches can only deal with a small number of antenna states, or suffer from slow convergence. In this paper, we propose an optimal online antenna state selection framework for SISO and MISO wireless links, based on the Thompson sampling algorithm for general stochastic bandits. In order to enhance the convergence rate for large antenna state sets, we propose two novel antenna state pruning strategies and integrate them with Thompson sampling, which exploit the relationship between antenna radiation pattern and channel state. The first one requires knowledge of angles of departure of the channel, while guaranteeing convergence to optimality. The other one doesn't require any prior channel information. Simulation results using a real-world reconfigurable antenna's radiation patterns show that, both of our proposed learning algorithms can significantly improve the convergence rate and yield much lower regret compared with existing schemes.

AB - Reconfigurable antennas (RAs) are capable of dynamically and swiftly changing their radiation patterns, which enables them to adapt to channel variations and enhance link capacity. To fully exploit the benefits of RAs, the antenna states need to be optimally selected on-the-fly. The main challenges are two-fold: uncertainty of channel over time, and a large number of candidate antenna states. Previous approaches can only deal with a small number of antenna states, or suffer from slow convergence. In this paper, we propose an optimal online antenna state selection framework for SISO and MISO wireless links, based on the Thompson sampling algorithm for general stochastic bandits. In order to enhance the convergence rate for large antenna state sets, we propose two novel antenna state pruning strategies and integrate them with Thompson sampling, which exploit the relationship between antenna radiation pattern and channel state. The first one requires knowledge of angles of departure of the channel, while guaranteeing convergence to optimality. The other one doesn't require any prior channel information. Simulation results using a real-world reconfigurable antenna's radiation patterns show that, both of our proposed learning algorithms can significantly improve the convergence rate and yield much lower regret compared with existing schemes.

UR - http://www.scopus.com/inward/record.url?scp=85064986846&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064986846&partnerID=8YFLogxK

U2 - 10.1109/ICCNC.2019.8685555

DO - 10.1109/ICCNC.2019.8685555

M3 - Conference contribution

AN - SCOPUS:85064986846

T3 - 2019 International Conference on Computing, Networking and Communications, ICNC 2019

SP - 888

EP - 893

BT - 2019 International Conference on Computing, Networking and Communications, ICNC 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -