Forecast-Aided Q-Learning for Decentralized Game-Theoretic EV Charging and Discharging at Solar-Powered Supply Equipment in Smart Cities: Learning When to Plug In
Electronics · 12.11.2026 · 15 (22) · 5266
DOI: 10.3390/electronics15225266 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 12.11.2026. Verfasst von Turki G. Alghamdi. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Decentralized electric vehicle supply equipment (D-EVSE) powered by photovoltaic (PV) plants and local storage can serve EV charging and vehicle-to-grid discharging in smart cities, but existing decentralized game-theoretic (D-GT) schemes are myopic in time: EVs plug in as soon as they need energy, so the morning demand peak drains the storage before the PV output ramps up, while midday PV energy is curtailed. This paper adds a learning layer that determines when a flexible EV plugs in, while the D-GT best response still determines where. A long short-term memory (LSTM) network trained on six years of measured PV data (NREL PVDAQ) forecasts each station’s PV output one hour ahead; for plug-in demand, the mean daily profile of real charging sessions (Caltech ACN-Data) is used because it is more accurate than an LSTM on validation data. Each station broadcasts the resulting forecast energy balance, and a tabular Q-learning agent, trained on these forecasts rather than on realized values, maps it and the station’s state to a plug-in-now or wait-one-hour decision. On a six-station Ottawa network over 30 unseen days with 3000–8000 EVs per day, the resulting scheme (FQL-DGT) increases the average satisfaction at 8000 EVs from 86.5% to 91.8%, reduces unserved requests from 2.2% to 0.6% and the mean queueing time from 9.8 to 5.3 min, and decreases grid imports by 22% (5000 EVs) and 9% (8000 EVs). At the 60-min horizon used by the decision, the PV forecast has a normalized RMSE of 13.57%, against 20.92% for persistence. Ablations show that learning the congestion dynamics provides most of the gain and forecasting a smaller additional part at high load; a linear autoregressive PV forecast, although less accurate than the LSTM, serves the decision layer equally well. The mean ex post regret of the switching station remains at or below 0.024, and a decision takes approximately 0.11 ms.
Zitieren
APA
Alghamdi, T. G. (2026). Forecast-Aided Q-Learning for Decentralized Game-Theoretic EV Charging and Discharging at Solar-Powered Supply Equipment in Smart Cities: Learning When to Plug In. Electronics, 15(22), 5266. https://doi.org/10.3390/electronics15225266
Vancouver
Alghamdi TG. Forecast-Aided Q-Learning for Decentralized Game-Theoretic EV Charging and Discharging at Solar-Powered Supply Equipment in Smart Cities: Learning When to Plug In. Electronics. 2026;15(22):5266. doi:10.3390/electronics15225266
BibTeX
@article{Alghamdi2026,
author = {Alghamdi, Turki G.},
title = {Forecast-Aided Q-Learning for Decentralized Game-Theoretic EV Charging and Discharging at Solar-Powered Supply Equipment in Smart Cities: Learning When to Plug In},
journal = {Electronics},
year = {2026},
volume = {15},
number = {22},
pages = {5266},
doi = {10.3390/electronics15225266}
}
EUVIMED