Skip to content
Extra Form
Abstract Autonomous ships have received increasing attention in the maritime industry. The development of a real-time path following and collision avoidance system complying with the International Regulations for Preventing Collisions at Sea (COLREGs) is crucial to the development of autonomous ships. In this study, we proposed a novel deep reinforcement learning (RL) algorithm to improve the efficacy and efficiency of the path following and collision avoidance system. To verify the proposed algorithm, we conducted simulations of an autonomous ship under unknown environmental disturbances to adjust its heading in real time. A three-degree-of-freedom dynamic model for the autonomous ship was developed, and a line-of-sight (LOS) guidance system was used to guide the autonomous ship along a predefined path. Then, a proximal policy optimization (PPO) algorithm was implemented for the problem. We found that, after applying the advanced deep-RL method, an autonomous ship could learn the safest and most economical avoidance behavior through repeated trials. The simulation results showed that the proposed algorithm guaranteed collision avoidance with encountered moving ships while ensuring that the ship followed a predefined path. Additionally, the algorithm demonstrated that it could manage complex scenarios with various encountered ships in compliance with COLREGs, showing excellent adaptability to unknown complex environments.
Publication Date 2019-08-01
Role Corresponding Author
Category SCIE
Impact Factor 0.372

Luman Zhao, Myung-Il Roh, Sung-Jun Lee, "Control Method for Path Following and Collision Avoidance of Autonomous Ships Based on Deep Reinforcement Learning", Journal of Marine Science and Technology (Taiwan), Vol. 27, No. 4, pp. 293-310, 2019.08.01


List of Articles
번호 분류 제목 Publication Date
54 International Journal Sol Ha, Tae-Sub Um, Myung-Il Roh, Hyun-Kyoung Shin, “A Structural Weight Estimation Model of FPSO Topsides Using an Improved Genetic Programming Method”, Ships and Offshore Structures, Vol. 12, No. 1, pp. 43-55, 2017.01.01 file 2017-01-01
53 International Journal John-Kyu Hwang, Myung-Il Roh, Ju-Hwan Cha, “Design Modification of a Damaged Free-Fall Lifeboat for FPSO Through Free-Fall Tests”, International Journal of Offshore and Polar Engineering, Vol. 26, No. 4, pp. 417-422, 2016.12.01 file 2016-12-01
52 International Journal Sol Ha, Seong-Ho Seo, Myung-Il Roh, Hyun-Kyoung Shin, "Simplified Nonlinear Model for the Weight Estimation of FPSO Plant Topside Using the Statistical Method", Ships and Offshore Structures, Vol. 11, No. 6, pp. 603-619, 2016.09.01 file 2016-09-01
51 International Journal Jeong-Woo Hong, Myung-Il Roh, Seung-Ho Ham, Sol Ha, "Dynamic Simulation of Subsea Equipment Installation Using an Offshore Support Vessel Based on Flexible Multibody System Dynamics", Journal of Marine Science and Technology (Taiwan), Vol. 24, No. 4 file 2016-08-01
50 International Journal Ki-Su Kim, Myung-Il Roh, "A Submarine Arrangement Design Program Based on the Expert System and the Multistage Optimization", Advances In Engineering Software, Vol. 98, No. 97-111, 2016.08.01 file 2016-08-01
49 International Journal Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Block Turnover Simulation Considering the Interferences between the Block and Wire Ropes in Shipbuilding", Automation in Construction, Vol. 67, pp. 60-75, 2016.07.01 file 2016-07-01
48 International Journal Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, "Lifting Simulation of an Offshore Supply Vessel Considering Various Operating Conditions", Advances in Mechanical Engineering, Vol. 8, No. 6, pp. 1-13, 2016.06.16 file 2016-06-16
47 International Journal Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, "Simulation of Load Lifting with Equalizers Used in Shipyards", Automation in Construction, Vol. 61, pp. 98-111, 2016.02.01 file 2016-02-01
46 International Journal Sol Ha, Nam-Kug Ku, Myung-Il Roh, "Event-based Scenario Manager for Multibody Dynamics Simulation of Heavy Load Lifting Operations in Shipyards", International Journal of Naval Architecture and Ocean Engineering, Vol. 8, No. 1, pp. 83-101, 2016.01.01 file 2016-01-01
45 International Journal Ki-Su Kim, Myung-Il Roh, Sol Ha, "Expert System Based on the Arrangement Evaluation Model for the Arrangement Design of a Submarine", Expert Systems with Applications, Vol. 42, No. 22, pp. 8731-8744, 2015.12.01 file 2015-12-01
44 International Journal Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, Sol Ha, "Multibody Dynamic Analysis of a Heavy Load Suspended by a Floating Crane with Constraint-based Wire Rope", Ocean Engineering, Vol. 109, pp. 145-160, 2015.11.15 file 2015-11-15
43 International Journal Nam-Kug Ku, Myung-Il Roh, "Dynamic Response Simulation of an Offshore Wind Turbine Suspended by a Floating Crane", Ships and Offshore Structures, Vol. 10, No. 6, pp. 621-634, 2015.11.01 file 2015-11-01
42 International Journal Luman Zhao, Myung-Il Roh, “A Thrust Allocation Method for Efficient Dynamic Positioning of a Semisubmersible Drilling Rig Based on the Hybrid Optimization Algorithm”, Mathematical Problems in Engineering, Vol. 2015, pp. 1-12, 2015.10.01 file 2015-10-01
41 International Journal Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Sol Ha, "Dynamic Simulation of the Wireline Riser Tensioner System for a Mobile Offshore Drilling Unit Based on Multibody System Dynamics", Ocean Engineering, Vol. 106, pp. 485-495, 2015.09.15 file 2015-09-15
40 International Journal Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, "Lifting Off Simulation of an Offshore Supply Vessel Considering Ocean Environmental Loads and Lifting Off Velocity", Ocean Systems Engineering, Vol. 5, No. 3, pp. 181-198, 2015.09.01 file 2015-09-01
39 International Journal Sol Ha, Nam-Kug Ku, Myung-Il Roh, Ho-Jin Hwang, "Multibody System Dynamics Simulator for Process Simulation of Ships and Offshore Plants in Shipyards", Advances In Engineering Software, Vol. 85, pp. 12-25, 2015.07.01 file 2015-07-01
38 International Journal Luman Zhao, Myung-Il Roh, Jeong-Woo Hong, "Optimal Thrust Allocation for Dynamic Positioning of Deep-sea Working Vessel", Journal of Advanced Research in Ocean Engineering, Vol. 1, No. 2, pp. 94-105, 2015.06.01 file 2015-06-01
37 International Journal Tae-Sub Um, Myung-Il Roh, "Optimal Dimension Design of a Hatch Cover for Lightening a Bulk Carrier", International Journal of Naval Architecture and Ocean Engineering, Vol. 7, No. 2, pp. 270-287, 2015.03.01 file 2015-03-01
36 International Journal Nam-Kug Ku, Sol Ha, Myung-Il Roh, "Design of Controller for Mobile Robot in Welding Process of Shipbuilding Engineering", Journal of Computational Design and Engineering, Vol. 1, No. 4, pp. 243-255, 2014.10.01 file 2014-10-01
35 International Journal Nam-Kug Ku, Sol Ha, Myung-Il Roh, "Crane Modeling and Simulation in Offshore Structure Building Industry", International Journal of Computer Theory and Engineering, Vol. 6, No. 3, pp. 278-284, 2014.06.01 file 2014-06-01
Board Pagination Prev 1 2 3 4 5 6 Next
/ 6

Powered by Xpress Engine / Designed by Sketchbook

sketchbook5, 스케치북5

sketchbook5, 스케치북5

나눔글꼴 설치 안내


이 PC에는 나눔글꼴이 설치되어 있지 않습니다.

이 사이트를 나눔글꼴로 보기 위해서는
나눔글꼴을 설치해야 합니다.

설치 취소