Data-driven stochastic robust optimization: General computational framework and algorithm leveraging machine learning for optimization under uncertainty in the big data era

• Published in: Computers & chemical engineering Vol. 111; pp. 115 - 133
• Main Authors: Ning, Chao, You, Fengqi
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 04.03.2018
• Subjects: Bayesian model; Big data; Machine learning; Optimization under uncertainty; Process design and operations; Big data; Bayesian model; Optimization under uncertainty; Process design and operations; Machine learning
• ISSN: 0098-1354; 1873-4375; 1873-4375
• DOI: 10.1016/j.compchemeng.2017.12.015

•Machine learning based uncertainty model is developed.•A data-driven optimization under uncertainty framework is proposed.•Labeled multi-class uncertainty data is leveraged for decision making.•The resulting problem is solved with a decomposition-based algorithm.•Applications to process network design and planning. A novel data-driven stochastic robust optimization (DDSRO) framework is proposed for optimization under uncertainty leveraging labeled multi-class uncertainty data. Uncertainty data in large datasets are often collected from various conditions, which are encoded by class labels. Machine learning methods including Dirichlet process mixture model and maximum likelihood estimation are employed for uncertainty modeling. A DDSRO framework is further proposed based on the data-driven uncertainty model through a bi-level optimization structure. The outer optimization problem follows a two-stage stochastic programming approach to optimize the expected objective across different data classes; adaptive robust optimization is nested as the inner problem to ensure the robustness of the solution while maintaining computational tractability. A decomposition-based algorithm is further developed to solve the resulting multi-level optimization problem efficiently. Case studies on process network design and planning are presented to demonstrate the applicability of the proposed framework and algorithm.