TY - JOUR
T1 - A reinforcement learning-based algorithm for the aircraft maintenance routing problem
AU - Ruan, J. H.
AU - Wang, Z. X.
AU - Chan, Felix T.S.
AU - Patnaik, S.
AU - Tiwari, M. K.
N1 - Funding Information:
The work described in this paper was supported by a grant from the National Natural Science Foundation of China (Grant No. 71901052).
Publisher Copyright:
© 2020 Elsevier Ltd
PY - 2021/5/1
Y1 - 2021/5/1
N2 - With recent developments in the airline industry worldwide, the competition among the industry has increased largely with many key players in the market. In order to generate profits, the industry has paid much attention to generate optimal routes that are maintenance feasible. The main aim of operational aircraft maintenance routing problem (OAMRP) is to generate these optimal routes for each aircraft that are maintenance feasible and follow the constraints defined by the Federal Aviation Administration (FAA). In this paper, the OAMRP is studied with two main objectives. First, to propose a formulation of a network flow-based Integer Linear Programming (ILP) framework for the OAMRP that considers three main maintenance constraints simultaneously: maximum flying-hour, limit on the number of take-offs between two consecutive maintenance checks and the work-force capacity. Second, to develop a new reinforcement learning-based algorithm which can be used to solve the problem, quickly and efficiently, as compared to commonly available optimization software. Finally, the evaluation of the proposed algorithm on real case datasets obtained from a major airline located in the Middle East verifies that the algorithm generates high-quality solutions quickly for both medium and large-scale flight schedule dataset.
AB - With recent developments in the airline industry worldwide, the competition among the industry has increased largely with many key players in the market. In order to generate profits, the industry has paid much attention to generate optimal routes that are maintenance feasible. The main aim of operational aircraft maintenance routing problem (OAMRP) is to generate these optimal routes for each aircraft that are maintenance feasible and follow the constraints defined by the Federal Aviation Administration (FAA). In this paper, the OAMRP is studied with two main objectives. First, to propose a formulation of a network flow-based Integer Linear Programming (ILP) framework for the OAMRP that considers three main maintenance constraints simultaneously: maximum flying-hour, limit on the number of take-offs between two consecutive maintenance checks and the work-force capacity. Second, to develop a new reinforcement learning-based algorithm which can be used to solve the problem, quickly and efficiently, as compared to commonly available optimization software. Finally, the evaluation of the proposed algorithm on real case datasets obtained from a major airline located in the Middle East verifies that the algorithm generates high-quality solutions quickly for both medium and large-scale flight schedule dataset.
KW - Aircraft routing problem
KW - Markov Decision Process (MDP)
KW - Reinforcement Learning
KW - Sequential decision-making problem
UR - http://www.scopus.com/inward/record.url?scp=85098682553&partnerID=8YFLogxK
U2 - 10.1016/j.eswa.2020.114399
DO - 10.1016/j.eswa.2020.114399
M3 - Journal article
AN - SCOPUS:85098682553
SN - 0957-4174
VL - 169
JO - Expert Systems with Applications
JF - Expert Systems with Applications
M1 - 114399
ER -