TY - JOUR
T1 - Stochastic dynamic resource allocation for HIV prevention and treatment
T2 - An approximate dynamic programming approach
AU - Coşgun, Özlem
AU - Esra Büyüktahtakın, Büyüktahtakın
N1 - Funding Information:
We gratefully acknowledge the support of the National Science Foundation CAREER Award under Grant No. CBET-1554018 .
Publisher Copyright:
© 2018 Elsevier Ltd
PY - 2018/4
Y1 - 2018/4
N2 - Human immunodeficiency virus (HIV) is a key global health concern, with 33 million people living with HIV worldwide and 2.7 million new infections occurring annually. To prevent the spread of this widely prevalent epidemic disease, prevention and treatment intervention strategies urgently need to be implemented. The goal of this study is to propose stochastic dynamic programming (SDP) and approximate dynamic programming (ADP) algorithms that will optimally allocate the limited intervention budget among the HIV disease compartments and determine the best set of interventions that should be applied to each disease compartment, while minimizing the number of HIV-infected and people diagnosed with acquired immune deficiency syndrome (AIDS) as well as related deaths over a multi-year planning horizon. A compartmental model is constructed and formulated as a nonstationary Markov decision process (MDP) in order to capture the progression of the disease among the highest risk group—African American/black men who have sex with men (BMSM). In order to alleviate the computational difficulties arising from the exponentially growing state space in the SDP, we propose ADP algorithms that determine the approximately optimal budget allocation policies over six years. Our results suggest a greater allocation of the limited budget to prevention measures rather than treatment interventions, such as antiretroviral therapy (ART). As opposed to traditional policies that allocate the budget only once at the beginning of the time horizon, the ADP model suggests using a dynamic proportional budget strategy, allocating the budget dynamically over a multi-period planning period as the uncertainty in disease transmission is revealed. Results show that our ADP approach provides significant increases in health benefits and cost savings in HIV prevention and intervention.
AB - Human immunodeficiency virus (HIV) is a key global health concern, with 33 million people living with HIV worldwide and 2.7 million new infections occurring annually. To prevent the spread of this widely prevalent epidemic disease, prevention and treatment intervention strategies urgently need to be implemented. The goal of this study is to propose stochastic dynamic programming (SDP) and approximate dynamic programming (ADP) algorithms that will optimally allocate the limited intervention budget among the HIV disease compartments and determine the best set of interventions that should be applied to each disease compartment, while minimizing the number of HIV-infected and people diagnosed with acquired immune deficiency syndrome (AIDS) as well as related deaths over a multi-year planning horizon. A compartmental model is constructed and formulated as a nonstationary Markov decision process (MDP) in order to capture the progression of the disease among the highest risk group—African American/black men who have sex with men (BMSM). In order to alleviate the computational difficulties arising from the exponentially growing state space in the SDP, we propose ADP algorithms that determine the approximately optimal budget allocation policies over six years. Our results suggest a greater allocation of the limited budget to prevention measures rather than treatment interventions, such as antiretroviral therapy (ART). As opposed to traditional policies that allocate the budget only once at the beginning of the time horizon, the ADP model suggests using a dynamic proportional budget strategy, allocating the budget dynamically over a multi-period planning period as the uncertainty in disease transmission is revealed. Results show that our ADP approach provides significant increases in health benefits and cost savings in HIV prevention and intervention.
KW - Approximate dynamic programming
KW - Disease transmission uncertainty
KW - HIV epidemic disease
KW - Interventions
KW - Markov decision process (MDP)
KW - Resource allocation
KW - Stochastic dynamic programming
UR - http://www.scopus.com/inward/record.url?scp=85044663638&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85044663638&partnerID=8YFLogxK
U2 - 10.1016/j.cie.2018.01.018
DO - 10.1016/j.cie.2018.01.018
M3 - Article
AN - SCOPUS:85044663638
SN - 0360-8352
VL - 118
SP - 423
EP - 439
JO - Computers and Industrial Engineering
JF - Computers and Industrial Engineering
ER -