Data Transformation in the Predict-Then-Optimize Framework: Enhancing Decision Making under Uncertainty

Xuecheng Tian, Yanxia Guan, Shuaian Wang

Research output: Journal article publicationJournal articleAcademic researchpeer-review

Abstract

Decision making under uncertainty is pivotal in real-world scenarios, such as selecting the shortest transportation route amidst variable traffic conditions or choosing the best investment portfolio during market fluctuations. In today’s big data age, while the predict-then-optimize framework has become a standard method for tackling uncertain optimization challenges using machine learning tools, many prediction models overlook data intricacies such as outliers and heteroskedasticity. These oversights can degrade decision-making quality. To enhance predictive accuracy and consequent decision-making quality, we introduce a data transformation technique into the predict-then-optimize framework. Our approach transforms target values in linear regression, decision tree, and random forest models using a power function, aiming to boost their predictive prowess and, in turn, drive better decisions. Empirical validation on several datasets reveals marked improvements in decision tree and random forest models. In contrast, the benefits of linear regression are nuanced. Thus, while data transformation can bolster the predict-then-optimize framework, its efficacy is model-dependent. This research underscores the potential of tailoring transformation techniques for specific models to foster reliable and robust decision-making under uncertainty.

Original languageEnglish
Article number3782
JournalMathematics
Volume11
Issue number17
DOIs
Publication statusPublished - Sept 2023

Keywords

  • data transformation
  • data-driven optimization
  • predict-then-optimize
  • uncertain decision making

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • General Mathematics
  • Engineering (miscellaneous)

Fingerprint

Dive into the research topics of 'Data Transformation in the Predict-Then-Optimize Framework: Enhancing Decision Making under Uncertainty'. Together they form a unique fingerprint.

Cite this