Reinforcement Learning-Based Plug-in Electric Vehicle Charging With Forecasted Price

作者: Adriana Chis , Jarmo Lunden , Visa Koivunen

DOI: 10.1109/TVT.2016.2603536

关键词: ElectricityDemand responseReinforcement learningMathematical optimizationMarkov processCost reductionLoad managementMarkov decision processSimulationEngineeringElectric vehicle

摘要: This paper proposes a novel demand response method that aims at reducing the long-term cost of charging battery an individual plug-in electric vehicle (PEV). The problem is cast as daily decision-making for choosing amount energy to be charged in PEV within day. We model Markov decision process (MDP) with unknown transition probabilities. A batch reinforcement-learning (RL) algorithm proposed learning optimum cost-reducing policy from samples and making decisions new situations. In order capture day-to-day differences electricity costs, makes use actual prices current day predicted following Bayesian neural network employed predicting prices. For constructing RL training dataset, we historical linear-programming-based developed creating dataset optimal decisions. Different scenarios are simulated each time frame using set past Simulation results real-world pricing data demonstrate savings 10%–50% owner when method.

参考文章(25)
Adriana Chis, Jarmo Lunden, Visa Koivunen, Optimization of plug-in electric vehicle charging with forecasted price 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). pp. 2086- 2089 ,(2015) , 10.1109/ICASSP.2015.7178338
Jonathan Donadee, Marija Ilic, Orkun Karabasoglu, Optimal Autonomous Charging of Electric Vehicles with Stochastic Driver Behavior vehicle power and propulsion conference. pp. 1- 6 ,(2014) , 10.1109/VPPC.2014.7007115
Pia Grahn, Joakim Munkhammar, Joakim Widen, Karin Alvehag, Lennart Soder, PHEV Home-Charging Model Based on Residential Activity Patterns IEEE Transactions on Power Systems. ,vol. 28, pp. 2507- 2515 ,(2013) , 10.1109/TPWRS.2012.2230193
Mohammad M. Karbasioun, Ioannis Lambadaris, Gennady Shaikhet, Evangelos Kranakis, Optimal charging strategies for electrical vehicles under real time pricing 2014 IEEE International Conference on Smart Grid Communications (SmartGridComm). pp. 746- 751 ,(2014) , 10.1109/SMARTGRIDCOMM.2014.7007737
Mushfiqur R. Sarker, Miguel A. Ortega-Vazquez, Daniel S. Kirschen, Optimal Coordination and Scheduling of Demand Response via Monetary Incentives IEEE Transactions on Smart Grid. ,vol. 6, pp. 1341- 1352 ,(2015) , 10.1109/TSG.2014.2375067
Daniel O'Neill, Marco Levorato, Andrea Goldsmith, Urbashi Mitra, Residential Demand Response Using Reinforcement Learning 2010 First IEEE International Conference on Smart Grid Communications. pp. 409- 414 ,(2010) , 10.1109/SMARTGRID.2010.5622078
Zheng Wen, Daniel O'Neill, Hamid Maei, Optimal Demand Response Using Device-Based Reinforcement Learning IEEE Transactions on Smart Grid. ,vol. 6, pp. 2312- 2324 ,(2015) , 10.1109/TSG.2015.2396993
Jonathan Donadee, Marija D. Ilic, Stochastic Optimization of Grid to Vehicle Frequency Regulation Capacity Bids IEEE Transactions on Smart Grid. ,vol. 5, pp. 1061- 1069 ,(2014) , 10.1109/TSG.2013.2290971
Xiaomin Xi, Ramteen Sioshansi, Using Price-Based Signals to Control Plug-in Electric Vehicle Fleet Charging IEEE Transactions on Smart Grid. ,vol. 5, pp. 1451- 1464 ,(2014) , 10.1109/TSG.2014.2301931
Jouko Lampinen, Aki Vehtari, Bayesian approach for neural networks—review and case studies Neural Networks. ,vol. 14, pp. 257- 274 ,(2001) , 10.1016/S0893-6080(00)00098-8