Luman Zhao, Myung-Il Roh, Sung-Jun Lee, "Control Method for Path Following and Collision Avoidance of Autonomous Ships Based on Deep Reinforcement Learning", Journal of Marine Science and Technology (Taiwan), Vol. 27, No. 4, pp. 293-310, 2019.08.01
International Journal
2019.05.20 11:22
Luman Zhao, Myung-Il Roh, Sung-Jun Lee, "Control Method for Path Following and Collision Avoidance of Autonomous Ships Based on Deep Reinforcement Learning", Journal of Marine Science and Technology (Taiwan), Vol. 27, No. 4, pp. 293-310, 2019.08.01
조회 수 117
첨부 '1' |
---|
Abstract | Autonomous ships have received increasing attention in the maritime industry. The development of a real-time path following and collision avoidance system complying with the International Regulations for Preventing Collisions at Sea (COLREGs) is crucial to the development of autonomous ships. In this study, we proposed a novel deep reinforcement learning (RL) algorithm to improve the efficacy and efficiency of the path following and collision avoidance system. To verify the proposed algorithm, we conducted simulations of an autonomous ship under unknown environmental disturbances to adjust its heading in real time. A three-degree-of-freedom dynamic model for the autonomous ship was developed, and a line-of-sight (LOS) guidance system was used to guide the autonomous ship along a predefined path. Then, a proximal policy optimization (PPO) algorithm was implemented for the problem. We found that, after applying the advanced deep-RL method, an autonomous ship could learn the safest and most economical avoidance behavior through repeated trials. The simulation results showed that the proposed algorithm guaranteed collision avoidance with encountered moving ships while ensuring that the ship followed a predefined path. Additionally, the algorithm demonstrated that it could manage complex scenarios with various encountered ships in compliance with COLREGs, showing excellent adaptability to unknown complex environments. |
---|---|
Publication Date | 2019-08-01 |
Role | Corresponding Author |
Category | SCIE |
Impact Factor | 0.372 |
Prev 조영인, 오민재, 석영수, 이성준, 노명일, “딥러닝을 이용한 선형 설계 초기 단계에서의 저항 추정”, 한국CDE학회 논문집, Vol. 24, No. 2, pp. 1-8, 2019.06.01
조영인, 오민재, 석영수, 이성준, 노명일, “딥러닝을 이용한 선형 설계 초기 단계에서의 저항 추정”, 한국CDE학회 논문집, Vol. 24, No. 2, pp. 1-8, 2019.06.01
2019.05.23by SyDLab
Xing Li, Myung-Il Roh, Seung-Ho Ham, "A Collaborative Si... Next
Xing Li, Myung-Il Roh, Seung-Ho Ham, "A Collaborative Si...
2019.02.19by