Deep reinforcement learning for delay-sensitive LTE downlink scheduling

Nikhilesh Sharma, Sen Zhang, Someshwar Rao Somayajula Venkata, Filippo Malandra, Nicholas Mastronarde, Jacob Chakareski

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

We consider an LTE downlink scheduling system where a base station allocates resource blocks (RBs) to users running delay-sensitive applications. We aim to find a scheduling policy that minimizes the queuing delay experienced by the users. We formulate this problem as a Markov Decision Process (MDP) that integrates the channel quality indicator (CQI) of each user in each RB, and queue status of each user. To solve this complex problem involving high dimensional state and action spaces, we propose a Deep Reinforcement Learning based scheduling framework that utilizes the Deep Deterministic Policy Gradient (DDPG) algorithm to minimize the queuing delay experienced by the users. Our extensive experiments demonstrate that our approach outperforms state-of-the-art benchmarks in terms of average throughput, queuing delay, and fairness, achieving up to 55% lower queuing delay than the best benchmark.

Original languageEnglish (US)
Title of host publication2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728144900
DOIs
StatePublished - Aug 2020
Externally publishedYes
Event31st IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020 - Virtual, London, United Kingdom
Duration: Aug 31 2020Sep 3 2020

Publication series

NameIEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC
Volume2020-August

Conference

Conference31st IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020
Country/TerritoryUnited Kingdom
CityVirtual, London
Period8/31/209/3/20

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Deep reinforcement learning for delay-sensitive LTE downlink scheduling'. Together they form a unique fingerprint.

Cite this