TY - JOUR
T1 - Deep Gaussian process for enhanced Bayesian optimization and its application in additive manufacturing
AU - Gnanasambandam, Raghav
AU - Shen, Bo
AU - Law, Andrew Chung Chee
AU - Dou, Chaoran
AU - Kong, Zhenyu
N1 - Publisher Copyright:
© Copyright © 2024 “IISE”.
PY - 2025
Y1 - 2025
N2 - Abstarct: Engineering design problems typically require optimizing a quality measure by finding the right combination of controllable input parameters. In Additive Manufacturing (AM), the output characteristics of the process can often be non-stationary functions of the process parameters. Bayesian Optimization (BO) is a methodology to optimize such “black-box” functions, i.e., the input–output relationship is unknown and expensive to compute. Optimization tasks involving “black-box” functions widely use BO with Gaussian Process (GP) regression surrogate model. Using GPs with standard kernels is insufficient for modeling non-stationary functions, while GPs with non-stationary kernels are typically over-parameterized. On the other hand, a Deep Gaussian Process (DGP) can overcome GPs’ shortcomings by considering a composition of multiple GPs. Inference in a DGP is challenging due to its structure resulting in a non-Gaussian posterior, and using DGP as a surrogate model for BO is not straightforward. Stochastic Imputation (SI)-based inference is promising in speed and accuracy for BO. This work proposes a bootstrap aggregation-based procedure to effectively utilize the SI-based inference for BO with a DGP surrogate model. The proposed BO algorithm DGP-SI-BO is faster and empirically better than the state-of-the-art BO method in optimizing non-stationary functions. Several analytical test functions and a case study in metal AM simulation demonstrate the applicability of the proposed method.
AB - Abstarct: Engineering design problems typically require optimizing a quality measure by finding the right combination of controllable input parameters. In Additive Manufacturing (AM), the output characteristics of the process can often be non-stationary functions of the process parameters. Bayesian Optimization (BO) is a methodology to optimize such “black-box” functions, i.e., the input–output relationship is unknown and expensive to compute. Optimization tasks involving “black-box” functions widely use BO with Gaussian Process (GP) regression surrogate model. Using GPs with standard kernels is insufficient for modeling non-stationary functions, while GPs with non-stationary kernels are typically over-parameterized. On the other hand, a Deep Gaussian Process (DGP) can overcome GPs’ shortcomings by considering a composition of multiple GPs. Inference in a DGP is challenging due to its structure resulting in a non-Gaussian posterior, and using DGP as a surrogate model for BO is not straightforward. Stochastic Imputation (SI)-based inference is promising in speed and accuracy for BO. This work proposes a bootstrap aggregation-based procedure to effectively utilize the SI-based inference for BO with a DGP surrogate model. The proposed BO algorithm DGP-SI-BO is faster and empirically better than the state-of-the-art BO method in optimizing non-stationary functions. Several analytical test functions and a case study in metal AM simulation demonstrate the applicability of the proposed method.
KW - additive manufacturing
KW - bootstrap aggregation
KW - deep Gaussian process
KW - surrogate modeling
KW - “Black-box” functions
UR - http://www.scopus.com/inward/record.url?scp=85187178181&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85187178181&partnerID=8YFLogxK
U2 - 10.1080/24725854.2024.2312905
DO - 10.1080/24725854.2024.2312905
M3 - Article
AN - SCOPUS:85187178181
SN - 2472-5854
VL - 57
SP - 423
EP - 436
JO - IISE Transactions
JF - IISE Transactions
IS - 4
ER -