EV charging station deployment on coupled transportation and power distribution networks via reinforcement learning

Zhonghao Zhao, Carman K.M. Lee, Jiage Huo

Research output: Journal article publicationJournal articleAcademic researchpeer-review

13 Citations (Scopus)

Abstract

This study addresses the optimal electric vehicle (EV) charging station deployment problem (CSDP) on coupled transportation and power distribution networks, which is one of the critical issues with the mass adoption of EVs in the recent years. In contrast to existing works that mainly employ heuristics and exact algorithms, we propose a finite-discrete Markov decision process (MDP) formulation defined in a reinforcement learning (RL) framework to mitigate the curse of dimensionality problem. The RL-based approach aims to determine the location of a set of EV charging stations with limited capacity by minimizing the total investment cost while satisfying the coupled network constraints. Specifically, a long short-term memory (LSTM)-based recurrent neural network (RNN) with an attention mechanism is used to train the model based on an offline strategy. The model parameters are learned by the policy gradient algorithm with a learned baseline function. Numerical experiments on multiple problem sizes are conducted to assess the efficiency and feasibility of the proposed solution method. We experimentally show that our approach is efficient to solve the CSDP and outperforms other baseline approaches in solution quality with competitive computational time.

Original languageEnglish
Article number126555
Number of pages12
JournalEnergy
Volume267
DOIs
Publication statusPublished - 15 Mar 2023

Keywords

  • Charging station deployment
  • Coupled network
  • Electric vehicle
  • Reinforcement learning

ASJC Scopus subject areas

  • Civil and Structural Engineering
  • Modelling and Simulation
  • Renewable Energy, Sustainability and the Environment
  • Building and Construction
  • Fuel Technology
  • Energy Engineering and Power Technology
  • Pollution
  • Mechanical Engineering
  • General Energy
  • Management, Monitoring, Policy and Law
  • Industrial and Manufacturing Engineering
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'EV charging station deployment on coupled transportation and power distribution networks via reinforcement learning'. Together they form a unique fingerprint.

Cite this