Continuous Active Power Dispatch Optimization for Virtual Power Plants with Energy Storage Using DDPG
Main Article Content
Abstract
Continuous active power dispatch is a critical task for virtual power plants (VPPs) with energy storage, particularly under the increasing uncertainty of renewable generation and the growing demand for real-time coordination in smart energy systems. This study proposes an improved Deep Deterministic Policy Gradient (DDPG)-based optimization framework to enhance continuous dispatch performance for VPPs integrating wind power, photovoltaic generation, and battery energy storage. A multi-objective scheduling model is established by jointly considering dispatch cost, renewable energy utilization, and operational constraints, while priority experience replay, cross-attention mechanisms, gradient clipping, and cosine learning-rate decay are incorporated to improve training efficiency and policy stability. Simulation results demonstrate that the proposed approach significantly outperforms conventional methods by reducing average daily dispatch costs by 16.6%, achieving a renewable energy utilization rate of 96.8%, and maintaining rapid power balance recovery under highly volatile operating conditions. The optimized dispatch strategy further improves system robustness and dynamic adaptability in scenarios involving renewable fluctuations and sudden load variations. Beyond intelligent energy management, the proposed framework provides a practical optimization methodology for communication-enabled smart grids and distributed electromagnetic sensing infrastructures, where reliable information exchange and adaptive control are essential for coordinated operation of energy and wireless network resources.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
M. Daneshmandi, M. Rahimiyan, and L. Baringo, “Medium-term energy scheduling of virtual power plants in futures markets considering energy and reserve pool participation,” Energy Reports, vol. 15, Art. no. 109087, 2026, doi: 10.1016/J.EGYR.2026.109087.
Z. Bao, S. Yu, and C. Tang, “Optimal dispatch strategy of virtual power plants with asymmetric information based on multi-agent deep reinforcement learning,” Electric Power Systems Research, vol. 254, Art. no. 112580, 2026, doi: 10.1016/J.EPSR.2025.112580.
L. Ðor¯de and Ð. Željko, “Stochastic scheduling of a sector-coupled virtual power plant integrating wind generation and thermal energy storage,” Energy Conversion and Management: X, vol. 30, Art. no. 101638, 2026, doi: 10.1016/J.ECMX.2026.101638.
W. Wang, S. Lin, B. Zhou, L. Qian, Y. Shen, and S. Muyeen, “Day-ahead coordinated operation strategy for a pricemaker virtual power plant with multiple prosumers,” Electric Power Systems Research, vol. 255, Art. no. 112777, 2026, doi: 10.1016/J.EPSR.2026.112777.
T. Gao, X. Wang, J. Zhang, J. Zhang, and A. Parisio, “Optimal scheduling of virtual power plant for short term operating reserve considering EV battery swapping,” International Journal of Electrical Power and Energy Systems, vol. 175, Art. no. 111598, 2026, doi: 10.1016/J.IJEPES.2026.111598.
Z. Peng and T. Heng, “Hierarchical optimization of virtual power plants via sequential Game-Based Multi-Agent reinforcement learning,” Expert Systems With Applications, vol. 310, Art. no. 131263, 2026, doi: 10.1016/J.ESWA.2026.131263.
V. Kumar, A. M. Niazi, U. Aslam, N. Saeed, M. Aurangzeb, and A. A. S. Syed, “A holistic optimization framework for virtual power plants with physics-informed battery degradation and probabilistic stability constraints,” Future Batteries, vol. 9, Art. no. 100146, 2026, doi: 10.1016/J.FUB.2026.100146.
R. Ma, T. Ma, Y. Hou, H. Luo, J. Liu, L. Li, et al., “Optimal Scheduling of a Park-Scale Virtual Power Plant Based on Thermoelectric Coupling and PV–EV Coordination,” Eng, vol. 7, no. 1, pp. 54, 2026, doi: 10.3390/ENG7010054.
Y. Dong, J. Su, Y. Xue, J. Zhao, S. Du, M. Dong, et al., “A Bidding Strategy to Address Risks of Virtual Power Plants in the Day-Ahead Electricity Market,” International Transactions on Electrical Energy Systems, vol. 2026, no. 1, Art. no. 5283425, 2026, doi: 10.1155/ETEP/5283425.
H. Zhang, D. Zhao, H. Pan, and L. Jia, “Optimal Bidding Strategy of Virtual Power Plant Incorporating Vehicle-to-Grid Electric Vehicles,” Energies, vol. 19, no. 2, pp. 465, 2026, doi: 10.3390/EN19020465.
X. Zheng, C. Ju, G. Yang, and J. Chu, “Risk-aware collaborative optimization for quantity–price bidding and energy storage dispatch in virtual power plants,” Journal of Energy Storage, vol. 149, Art. no. 120112, 2026, doi: 10.1016/J.EST.2025.120112.
X. S. Cao, L. Yue, G. Wang, G. C. Duan, K. Li, J. Li, et al., “A novel industrial load scheduling model to balance scheduling with virtual power plant regulation requirements,” Sustainable Energy, Grids and Networks, vol. 45, Art. no. 102109, 2026, doi: 10.1016/J.SEGAN.2025.102109.
X. Guo, Z. Chen, D. Ren, and Y. Liu, “Operation optimization of a virtual power plant integrated with electrical-thermal and electrical-hydrogen systems using nash bargaining: A multi-time scale approach,” International Journal of Hydrogen Energy, vol. 205, Art. no. 153332, 2026, doi: 10.1016/J.IJHYDENE.2025.153332.
M. Yang and T. Yu, “Uncertainty-driven IoT-based management of hydrogen-backed multi-carrier virtual power plants for zero-carbon microgrids,” International Journal of Hydrogen Energy, vol. 205, Art. no. 153247, 2026, doi: 10.1016/J.IJHYDENE.2025.153247.
T. Bowen, M. Blonsky, C. Simeone, R. McIlmoil, A. Alberg, and E. Estreich, “Design trade-offs for residential retail tariffs and virtual power plants,” Applied Energy, vol. 407, Art. no. 127339, 2026, doi: 10.1016/J.APENERGY.2025.127339.
L. Zhang, W. Guan, B. Wang, S. Wu, H. Wang, Y. Chang, et al., “Cost-optimal virtual power plant dispatch with hybrid storage strategy based on frequency-division coordination,” Journal of Energy Storage, vol. 149, Art. no. 120302, 2026, doi: 10.1016/J.EST.2025.120302.
L. Xie, G. Li, M. Xu, X. Dong, and Z. Tan, “Optimizing virtual power plant coordination through locational marginal flexibility under network constraints,” Scientific reports, vol. 16, no. 1, pp. 3789, 2026, doi: 10.1038/S41598-025-33726-9.
Y. Meng, H. Zhang, and X. Li, “Virtual power plant information-physical convergence network construction and its resilience assessment,” Electrical Engineering, vol. 108, no. 2, pp. 78, 2026, doi: 10.1007/S00202-025-03417-9.
F. Liu, Y. Xu, M. X. Zheng, and S. M. Wei, “Low-Carbon Scheduling Strategy for Multi-Virtual Power Plant Cluster Energy Sharing Collaborative Participation in Market Trading,” Journal of Electrical Engineering & Technology, vol. (prepublish), pp. 1-25, 2026, doi: 10.1007/S42835-025-02562-2.
S. Roy, C. D. Das, and N. Sinha, “MBGO-PID Based Frequency Regulation of Virtual Power Plants with Machine Learning Forecasted Day-Ahead Profiles for Diverse DER-Based Storage,” Iranian Journal of Science and Technology, Transactions of Electrical Engineering, vol. (prepublish), pp. 1-35, 2026, doi: 10.1007/S40998-025-00981-5.
S. Mei, X. Lu, and Q. Tan, “Dynamic aggregation optimization model of virtual power plant considering economic and environmental cost equilibrium,” International Journal of Electrical Power and Energy Systems, vol. 174, Art. no. 111531, 2026, doi: 10.1016/J.IJEPES.2025.111531.
P. Zhang and Y. Zheng, “Economical management of virtual power plant source-network-load-storage in the context of electricity-carbon market,” PloS one, vol. 21, no. 1, Art. no. e0338321, 2026, doi: 10.1371/JOURNAL.PONE.0338321.
M. S. Z. Khozaghi, A. Seifi, and B. G. Gharehpetian, “A new decentralized control structure for generation scheduling in a multi-energy virtual power plant considering its interactions with an electric vehicle aggregator and a demand response provider,” International Journal of Electrical Power and Energy Systems, vol. 174, Art. no. 111539, 2026, doi: 10.1016/J.IJEPES.2025.111539.
X. Ma, Z. Yumin, and Y. Jing, “Regulation and optimization of virtual power plants considering reversible energy storage of electricity and hydrogen under the new energy situation,” Engineering Research Express, vol. 8, no. 2, Art. no. 025306, 2026, doi: 10.1088/2631-8695/AE321C.
H. Wei and J. Zhang, “Contribution-driven cooperative trading strategy for multi-energy virtual power plants in the electricity-carbon coupled markets: An asymmetric Nash bargaining model,” Energy Strategy Reviews, vol. 63, Art. no. 102047, 2026, doi: 10.1016/J.ESR.2026.102047.
G. Xu, G. Yang, J. Bao, H. Feng, F. Zhang, and H. Zheng, “AI-enhanced multi-timescale optimization strategy for virtual power plants: Advancing losad forecasting and dynamic demand response integration,” PloS one, vol. 21, no. 1, Art. no. e0339606, 2026, doi: 10.1371/JOURNAL.PONE.0339606.
J. Jin, X. Pang, B. Wang, D. Wang, and Z. Zheng, “Optimal scheduling method of carbon-green certificate trading virtual power plant via Q-learning-enhanced particle swarm algorithm,” Complex & Intelligent Systems, vol. 12, no. 1, pp. 51, 2025, doi: 10.1007/S40747-025-02176-1.
B. Xie, L. Zhang, W. Zhao, Y. Yuan, X. Chen, X. Luo, et al., “A Study on Optimal Scheduling of Low-Carbon Virtual Power Plants Based on Dynamic Carbon Emission Factors,” Sustainability, vol. 18, no. 1, pp. 326, 2025, doi: 10.3390/SU18010326.
H. Qi, W. Sun, Y. Zhao, X. Qian, and X. Jiang, “Optimal Operation of Virtual Power Plants Based on Revenue Distribution and Risk Contribution,” Energy Engineering, vol. 123, no. 1, pp. 1, 2025, doi: 10.32604/EE.2025.069603.
Y. Li, Y. Chen, J. He, G. He, C. Dai, J. Tong, et al., “Optimal Dispatch of Urban Distribution Networks Considering Virtual Power Plant Coordination under Extreme Scenarios,” Energy Engineering, vol. 123, no. 1, pp. 9, 2025, doi: 10.32604/EE.2025.069257.