International Journal

Luman Zhao, Myung-Il Roh, Sung-Jun Lee, "Control Method for Path Following and Collision Avoidance of Autonomous Ships Based on Deep Reinforcement Learning", Journal of Marine Science and Technology (Taiwan), Vol. 27, No. 4, pp. 293-310, 2019.08.01

by SyDLab posted May 20, 2019
?

단축키

Prev이전 문서

Next다음 문서

ESC닫기

크게 작게 위로 아래로 댓글로 가기 인쇄
Extra Form
Abstract Autonomous ships have received increasing attention in the maritime industry. The development of a real-time path following and collision avoidance system complying with the International Regulations for Preventing Collisions at Sea (COLREGs) is crucial to the development of autonomous ships. In this study, we proposed a novel deep reinforcement learning (RL) algorithm to improve the efficacy and efficiency of the path following and collision avoidance system. To verify the proposed algorithm, we conducted simulations of an autonomous ship under unknown environmental disturbances to adjust its heading in real time. A three-degree-of-freedom dynamic model for the autonomous ship was developed, and a line-of-sight (LOS) guidance system was used to guide the autonomous ship along a predefined path. Then, a proximal policy optimization (PPO) algorithm was implemented for the problem. We found that, after applying the advanced deep-RL method, an autonomous ship could learn the safest and most economical avoidance behavior through repeated trials. The simulation results showed that the proposed algorithm guaranteed collision avoidance with encountered moving ships while ensuring that the ship followed a predefined path. Additionally, the algorithm demonstrated that it could manage complex scenarios with various encountered ships in compliance with COLREGs, showing excellent adaptability to unknown complex environments.
Publication Date 2019-08-01
Role Corresponding Author
Category SCIE
Impact Factor 0.372

Luman Zhao, Myung-Il Roh, Sung-Jun Lee, "Control Method for Path Following and Collision Avoidance of Autonomous Ships Based on Deep Reinforcement Learning", Journal of Marine Science and Technology (Taiwan), Vol. 27, No. 4, pp. 293-310, 2019.08.01


Articles

1 2 3 4 5 6 7