基于强化学习算法的微电网优化策略
TP18; 分布式能源具有小规模波动和间歇性的特点,导致微电网运行策略难以制定.微电网有效集成多种分布式能源和外部电网,多能源微电网管理正成为一项非常复杂的任务.针对该问题,提出一种在负荷需求、可再生能源和储能设备等综合因素影响下的微电网实时优化运行策略.该策略首先基于强化学习框架,将微电网运行问题建模为马尔可夫决策过程,然后以最小化微电网电压波动和运行损耗为目的构建微电网策略优化模型.为有效利用微电网的互联结构,在近端策略优化算法的基础上,设计一种图注意力近端策略优化算法(graph attention proximal policy optimization,GT-PPO),该算法使用注意...
Saved in:
| Published in | 山东电力技术 Vol. 51; no. 6; pp. 27 - 35 |
|---|---|
| Main Authors | , , , , |
| Format | Journal Article |
| Language | Chinese |
| Published |
国网山东省电力公司临沂供电公司,山东 临沂 2760001%国网(山东)电动汽车服务有限公司,山东 济南 250000
2024
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 1007-9904 |
| DOI | 10.20097/j.cnki.issn1007-9904.2024.06.004 |
Cover
| Abstract | TP18; 分布式能源具有小规模波动和间歇性的特点,导致微电网运行策略难以制定.微电网有效集成多种分布式能源和外部电网,多能源微电网管理正成为一项非常复杂的任务.针对该问题,提出一种在负荷需求、可再生能源和储能设备等综合因素影响下的微电网实时优化运行策略.该策略首先基于强化学习框架,将微电网运行问题建模为马尔可夫决策过程,然后以最小化微电网电压波动和运行损耗为目的构建微电网策略优化模型.为有效利用微电网的互联结构,在近端策略优化算法的基础上,设计一种图注意力近端策略优化算法(graph attention proximal policy optimization,GT-PPO),该算法使用注意力机制和图神经网络学习微电网节点的相关性,以学习各类环境下不同时段多能源微电网最优调度策略.最后,采用改进的IEEE 33节点、IEEE 118节点两种规格的微电网进行仿真实验.实验结果表明,该优化策略可以实现微电网的实时优化,且结果优于传统的近端策略优化(proximal policy optimization,PPO)算法和双深度Q网络(double deep Q network,DDQN)算法. |
|---|---|
| AbstractList | TP18; 分布式能源具有小规模波动和间歇性的特点,导致微电网运行策略难以制定.微电网有效集成多种分布式能源和外部电网,多能源微电网管理正成为一项非常复杂的任务.针对该问题,提出一种在负荷需求、可再生能源和储能设备等综合因素影响下的微电网实时优化运行策略.该策略首先基于强化学习框架,将微电网运行问题建模为马尔可夫决策过程,然后以最小化微电网电压波动和运行损耗为目的构建微电网策略优化模型.为有效利用微电网的互联结构,在近端策略优化算法的基础上,设计一种图注意力近端策略优化算法(graph attention proximal policy optimization,GT-PPO),该算法使用注意力机制和图神经网络学习微电网节点的相关性,以学习各类环境下不同时段多能源微电网最优调度策略.最后,采用改进的IEEE 33节点、IEEE 118节点两种规格的微电网进行仿真实验.实验结果表明,该优化策略可以实现微电网的实时优化,且结果优于传统的近端策略优化(proximal policy optimization,PPO)算法和双深度Q网络(double deep Q network,DDQN)算法. |
| Abstract_FL | Distributed energy has the characteristics of small-scale fluctuations and intermittency,making it difficult to formulate operational strategies for microgrids.As an effective way to integrate multiple distributed energy sources and external grids,multi-energy microgrid management is becoming a very complex task.A microgrid real-time optimal operation strategy was proposed under the influence of comprehensive factors such as load demand,renewable energy sources and energy storage devices.Firstly,based on the reinforcement learning framework,the microgrid operation problem was modeled as a Markov decision process,and then a microgrid strategy optimization model was constructed with the aim of minimizing voltage fluctuations and operational losses in the microgrid.In order to effectively utilize the interconnection structure of the distribution network,a graph attention proximal policy optimization(GT-PPO)algorithm was designed on the basis of the proximal policy optimization algorithm.This algorithm uses an attention mechanism and a graph neural network to learn the correlation of distribution network nodes to formulate the optimal scheduling strategy for multi-energy distribution networks at different times under various environments.Simulation experiments were conducted using two specifications of the improved IEEE 33 node and IEEE 118 node distribution networks.The experimental results show that the optimization strategy can achieve real-time optimization of microgrids,and the results are better than the traditional proximal policy optimization(PPO)algorithm and double deep Q network(DDQN)algorithm. |
| Author | 徐明珠 李子凯 周忠堂 杨波 张健 |
| AuthorAffiliation | 国网山东省电力公司临沂供电公司,山东 临沂 2760001%国网(山东)电动汽车服务有限公司,山东 济南 250000 |
| AuthorAffiliation_xml | – name: 国网山东省电力公司临沂供电公司,山东 临沂 2760001%国网(山东)电动汽车服务有限公司,山东 济南 250000 |
| Author_FL | LI Zikai ZHOU Zhongtang ZHANG Jian XU Mingzhu YANG Bo |
| Author_FL_xml | – sequence: 1 fullname: LI Zikai – sequence: 2 fullname: YANG Bo – sequence: 3 fullname: ZHOU Zhongtang – sequence: 4 fullname: ZHANG Jian – sequence: 5 fullname: XU Mingzhu |
| Author_xml | – sequence: 1 fullname: 李子凯 – sequence: 2 fullname: 杨波 – sequence: 3 fullname: 周忠堂 – sequence: 4 fullname: 张健 – sequence: 5 fullname: 徐明珠 |
| BookMark | eNrjYmDJy89LZWDQNDTQMzIwsDTXz9JLzsvO1MssLs4zNDAw17W0NDABShmZ6BmY6RkYmLAwcMLFORh4i4szkwwMDIzMDUwMDTgZDJ7O3_VkV9_TPbue9kx7unbZk50Lnq-b_mzz1OezWp7uW_d8ytbneyc-2TMDKPt87bTnU5fyMLCmJeYUp_JCaW4GdTfXEGcP3fLEvLTEvPT4rPzSojygTHxxSkpOVjHIJQZmQHcYE68SAAbbUzU |
| ClassificationCodes | TP18 |
| ContentType | Journal Article |
| Copyright | Copyright © Wanfang Data Co. Ltd. All Rights Reserved. |
| Copyright_xml | – notice: Copyright © Wanfang Data Co. Ltd. All Rights Reserved. |
| DBID | 2B. 4A8 92I 93N PSX TCJ |
| DOI | 10.20097/j.cnki.issn1007-9904.2024.06.004 |
| DatabaseName | Wanfang Data Journals - Hong Kong WANFANG Data Centre Wanfang Data Journals 万方数据期刊 - 香港版 China Online Journals (COJ) China Online Journals (COJ) |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| DocumentTitle_FL | Optimization Strategy for Microgrid Based on Reinforcement Learning Algorithm |
| EndPage | 35 |
| ExternalDocumentID | sddljs202406004 |
| GroupedDBID | 2B. 4A8 92I 93N ALMA_UNASSIGNED_HOLDINGS CDYEO PSX TCJ |
| ID | FETCH-wanfang_journals_sddljs2024060043 |
| ISSN | 1007-9904 |
| IngestDate | Thu May 29 04:07:25 EDT 2025 |
| IsPeerReviewed | false |
| IsScholarly | true |
| Issue | 6 |
| Keywords | 图自注意力网络 graph attention networks microgrid strategy optimization proximal policy optimization 策略优化 微电网 近端策略优化 |
| Language | Chinese |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-wanfang_journals_sddljs2024060043 |
| ParticipantIDs | wanfang_journals_sddljs202406004 |
| PublicationCentury | 2000 |
| PublicationDate | 2024 |
| PublicationDateYYYYMMDD | 2024-01-01 |
| PublicationDate_xml | – year: 2024 text: 2024 |
| PublicationDecade | 2020 |
| PublicationTitle | 山东电力技术 |
| PublicationTitle_FL | Shandong Electric Power |
| PublicationYear | 2024 |
| Publisher | 国网山东省电力公司临沂供电公司,山东 临沂 2760001%国网(山东)电动汽车服务有限公司,山东 济南 250000 |
| Publisher_xml | – name: 国网山东省电力公司临沂供电公司,山东 临沂 2760001%国网(山东)电动汽车服务有限公司,山东 济南 250000 |
| SSID | ssib000270410 ssib001129354 ssib006563890 ssib051371771 ssib036436021 |
| Score | 4.7444205 |
| Snippet | TP18;... |
| SourceID | wanfang |
| SourceType | Aggregation Database |
| StartPage | 27 |
| Title | 基于强化学习算法的微电网优化策略 |
| URI | https://d.wanfangdata.com.cn/periodical/sddljs202406004 |
| Volume | 51 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3NixMxFA_LCuJFFBW_6cEgUrpmPpJJjpnplMWDpxX2tnQ6U12VLtjuZc8eRRDcVbzoRW-7F_FgWf1rWuff8L3MTJt-QFehhMfLe7_3klcmL8kkQ8g95iSpJ4TbyDq-aPgdVzaSbjttJFI6PGVJJosXZB-LzSf-o22-vbbetN5a2h8kG52DpedK_ieqwIO44inZf4jsBBQYQEN8oYQIQ3mmGNOYU9Wioaaxj6WMkRNGhsOpjKgSSOgm1cLIKKoZjQOqY6oCGgsaelRx5ChQ9416jLXIAXlTFTapcow6AEoLOUDkggAQze1M10A5-ENFSVVkYQKCpipEB4CQDAkQ0JPXjA2jWTYIjTCjFCyKaFk2Q7vTGo4Oa-Nq2DJN5ljKGRFoTVEjncr3cvnDnS58GqwQu2DaEUsbFiHMkhYCAbYjQ7RQvtAKfeO2Cz4ZTmyEbfVZLTdatFtfxKq7uAWKn0XgSzx35RLnXTXvdtmljtGVWOK_x0RINisZp-KAuqJKVSE6k9sCjRXBBUQV1F38YgazRkhc24YUxreH0PLO4N3F8TCwMqviXpr5MRu35wIzaHd6L3aNkYmNDYy4uV-3tDd7NXo_TV8-76MME-ZS4HPQycKxFlbKvXXm25METHGtJBpmNJ51GtyDHF2waVLLHS9wgmLlpvLrPHlQef5wld_mNGCv2-49tRLXrUvkYjnjrOni8XGZrB08u0LY-PNwNHw7Ph2O3xyNj7-Nfn7JTz78-X6Yf3o9_n2Sv_-R_3o3Ov0ItfnxUX749Sq534q3os1GaWWnfED1d-a6x7tG1nt7vew6qTGedqVsy1RkbT_zlPQcrwuZewZzbQZdeIPUVqHdXC1yi1xAuliwvE3WB6_2szuQwg-SuyZCfwHuqqc- |
| linkProvider | Directory of Open Access Journals |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=%E5%9F%BA%E4%BA%8E%E5%BC%BA%E5%8C%96%E5%AD%A6%E4%B9%A0%E7%AE%97%E6%B3%95%E7%9A%84%E5%BE%AE%E7%94%B5%E7%BD%91%E4%BC%98%E5%8C%96%E7%AD%96%E7%95%A5&rft.jtitle=%E5%B1%B1%E4%B8%9C%E7%94%B5%E5%8A%9B%E6%8A%80%E6%9C%AF&rft.au=%E6%9D%8E%E5%AD%90%E5%87%AF&rft.au=%E6%9D%A8%E6%B3%A2&rft.au=%E5%91%A8%E5%BF%A0%E5%A0%82&rft.au=%E5%BC%A0%E5%81%A5&rft.date=2024&rft.pub=%E5%9B%BD%E7%BD%91%E5%B1%B1%E4%B8%9C%E7%9C%81%E7%94%B5%E5%8A%9B%E5%85%AC%E5%8F%B8%E4%B8%B4%E6%B2%82%E4%BE%9B%E7%94%B5%E5%85%AC%E5%8F%B8%2C%E5%B1%B1%E4%B8%9C+%E4%B8%B4%E6%B2%82+2760001%25%E5%9B%BD%E7%BD%91%28%E5%B1%B1%E4%B8%9C%29%E7%94%B5%E5%8A%A8%E6%B1%BD%E8%BD%A6%E6%9C%8D%E5%8A%A1%E6%9C%89%E9%99%90%E5%85%AC%E5%8F%B8%2C%E5%B1%B1%E4%B8%9C+%E6%B5%8E%E5%8D%97+250000&rft.issn=1007-9904&rft.volume=51&rft.issue=6&rft.spage=27&rft.epage=35&rft_id=info:doi/10.20097%2Fj.cnki.issn1007-9904.2024.06.004&rft.externalDocID=sddljs202406004 |
| thumbnail_s | http://utb.summon.serialssolutions.com/2.0.0/image/custom?url=http%3A%2F%2Fwww.wanfangdata.com.cn%2Fimages%2FPeriodicalImages%2Fsddljs%2Fsddljs.jpg |