• HOME
  • About Journal
    • Historical evolution
    • Journal Honors
  • Editorial Board
    • Members of Committee
    • Director of the Committee
    • President and Editor in chief
  • Submission Guide
    • Instructions for Authors
    • Manuscript Processing Flow
    • Model Text
    • Procedures for Submission
  • Academic Influence
  • Open Access
  • Ethics&Policies
    • Publication Ethics Statement
    • Peer Review Process
    • Academic Misconduct Identification and Treatment
    • Advertising and Marketing
    • Correction and Retraction
    • Conflict of Interest
    • Authorship & Copyright
  • Contact Us
  • Chinese
Site search        
文章摘要
基于分层强化学习的数字化输电线路路径规划研究
Research of digital transmission line path planning method based on hierarchical reinforcement learning
Received:July 26, 2021  Revised:August 05, 2021
DOI:10.19753/j.issn1001-1390.2020.04.014
中文关键词: 数字化输电线路  路径规划  分层强化学习  MAXQ  
英文关键词: Digital transmission line  Path Planning  hierarchical reinforcement learning  MAXQ  
基金项目:国家电网公司科技项目(研综[2020]7号)
Author NameAffiliationE-mail
Song Tao* State Grid DC Engineering Construction Company songtao19820611@163.com 
Li Dan State Grid DC Engineering Construction Company songtao19820611@163.com 
Lu Ning Beijing Daoheng Software Co,Ltd songtao19820611@163.com 
Hits: 1724
Download times: 455
中文摘要:
      在输电线路的设计中,使用三维数字化设计技术可以显著提升地形的划分精度,然而地形划分精度的提升会使得地形栅格矩阵维度呈指数级增加,导致路径规划过程中出现维度灾难问题。为解决该问题,研究了一种基于分层强化学习的数字化输电线路路径规划方法。首先建立输电线路的三维数字化云平台,再使用不同比例尺对地形数据进行重采样,将原始的地形重构为粗粒度和细粒度的两层栅格图,再使用基于MAXQ算法的分层强化学习进行路径规划,从而解决了细粒度栅格单元带来的维度灾难问题,同时又保持了精确性的优势。实际算例表明,在地形划分精度提高、传统方法无法收敛的情况下,提出的方法仍能保持收敛,并相较传统方法不合理的跨越区域更少,降低了路径规划成本。
英文摘要:
      In the domain of transmission lines design, the use of 3D digital design technology can significantly improve the fine-grained terrain division. However, the fine-grained terrain division will make the dimension of terrain grid matrix increase exponentially, which leads to the dimension disaster in the process of path planning. In order to solve the dimension disaster caused by fine-grained terrain division, a digital transmission line path planning method based on hierarchical reinforcement learning is studied. Firstly, a three-dimensional digital cloud platform for transmission lines is established. Then, different scales are used to resample the terrain data, and the original terrain is reconstructed into two layers of coarse-grained and fine-grained grid map. Then, the hierarchical reinforcement learning based on MAXQ algorithm is used for path planning, so as to solve the dimension disaster problem caused by fine-grained grid cells, while maintaining the advantage of accuracy. The practical study shows that the proposed method can still keep convergence when the accuracy of terrain division is improved and the traditional method cannot converge. Compared with the traditional method, the unreasonable crossing area is less and the cost of path planning can be reduced.
View Full Text   View/Add Comment  Download reader
Close
  • Home
  • About Journal
    • Historical evolution
    • Journal Honors
  • Editorial Board
    • Members of Committee
    • Director of the Committee
    • President and Editor in chief
  • Submission Guide
    • Instructions for Authors
    • Manuscript Processing Flow
    • Model Text
    • Procedures for Submission
  • Academic Influence
  • Open Access
  • Ethics&Policies
    • Publication Ethics Statement
    • Peer Review Process
    • Academic Misconduct Identification and Treatment
    • Advertising and Marketing
    • Correction and Retraction
    • Conflict of Interest
    • Authorship & Copyright
  • Contact Us
  • 中文页面
Address: No.2000, Chuangxin Road, Songbei District, Harbin, China    Zip code: 150028
E-mail: dcyb@vip.163.com    Telephone: 0451-86611021
© 2012 Electrical Measurement & Instrumentation
黑ICP备11006624号-1
Support:Beijing Qinyun Technology Development Co., Ltd