TY - JOUR
T1 - Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approach
AU - Hang, Peng
AU - Lv, Chen
AU - Xing, Yang
AU - Huang, Chao
AU - Hu, Zhongxu
N1 - Funding Information:
Manuscript received May 8, 2020; revised August 8, 2020; accepted September 16, 2020. Date of publication November 17, 2020; date of current version March 31, 2021. This work was supported in part by the Start-Up Grant, Nanyang Assistant Professorship (SUG-NAP) of Nanyang Technological University, Singapore under Grant M4082268.050 and in part by the A∗STAR, Singapore under Grant 1922500046. The Associate Editor for this article was S. Battisti. (Corresponding author: Chen Lv.) The authors are with the School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore 639798 (e-mail: [email protected]; [email protected]; [email protected]; [email protected]; [email protected]). Digital Object Identifier 10.1109/TITS.2020.3036984
Publisher Copyright:
© 2000-2011 IEEE.
PY - 2021/4
Y1 - 2021/4
N2 - Considering that human-driven vehicles and autonomous vehicles (AVs) will coexist on roads in the future for a long time, how to merge AVs into human drivers' traffic ecology and minimize the effect of AVs and their misfit with human drivers, are issues worthy of consideration. Moreover, different passengers have different needs for AVs, thus, how to provide personalized choices for different passengers is another issue for AVs. Therefore, a human-like decision making framework is designed for AVs in this paper. Different driving styles and social interaction characteristics are formulated for AVs regarding driving safety, ride comfort and travel efficiency, which are considered in the modeling process of decision making. Then, Nash equilibrium and Stackelberg game theory are applied to the noncooperative decision making. In addition, potential field method and model predictive control (MPC) are combined to deal with the motion prediction and planning for AVs, which provides predicted motion information for the decision-making module. Finally, two typical testing scenarios of lane change, i.e., merging and overtaking, are carried out to evaluate the feasibility and effectiveness of the proposed decision-making framework considering different human-like behaviors. Testing results indicate that both the two game theoretic approaches can provide reasonable human-like decision making for AVs. Compared with the Nash equilibrium approach, under the normal driving style, the cost value of decision making using the Stackelberg game theoretic approach is reduced by over 20%.
AB - Considering that human-driven vehicles and autonomous vehicles (AVs) will coexist on roads in the future for a long time, how to merge AVs into human drivers' traffic ecology and minimize the effect of AVs and their misfit with human drivers, are issues worthy of consideration. Moreover, different passengers have different needs for AVs, thus, how to provide personalized choices for different passengers is another issue for AVs. Therefore, a human-like decision making framework is designed for AVs in this paper. Different driving styles and social interaction characteristics are formulated for AVs regarding driving safety, ride comfort and travel efficiency, which are considered in the modeling process of decision making. Then, Nash equilibrium and Stackelberg game theory are applied to the noncooperative decision making. In addition, potential field method and model predictive control (MPC) are combined to deal with the motion prediction and planning for AVs, which provides predicted motion information for the decision-making module. Finally, two typical testing scenarios of lane change, i.e., merging and overtaking, are carried out to evaluate the feasibility and effectiveness of the proposed decision-making framework considering different human-like behaviors. Testing results indicate that both the two game theoretic approaches can provide reasonable human-like decision making for AVs. Compared with the Nash equilibrium approach, under the normal driving style, the cost value of decision making using the Stackelberg game theoretic approach is reduced by over 20%.
KW - autonomous vehicle
KW - Decision making
KW - driver model
KW - game theory
KW - human-like
KW - model predictive control
UR - http://www.scopus.com/inward/record.url?scp=85097183005&partnerID=8YFLogxK
U2 - 10.1109/TITS.2020.3036984
DO - 10.1109/TITS.2020.3036984
M3 - Journal article
AN - SCOPUS:85097183005
SN - 1524-9050
VL - 22
SP - 2076
EP - 2087
JO - IEEE Transactions on Intelligent Transportation Systems
JF - IEEE Transactions on Intelligent Transportation Systems
IS - 4
M1 - 9261984
ER -