Skip to content
Extra Form
Abstract Autonomous ships have received increasing attention in the maritime industry. The development of a real-time path following and collision avoidance system complying with the International Regulations for Preventing Collisions at Sea (COLREGs) is crucial to the development of autonomous ships. In this study, we proposed a novel deep reinforcement learning (RL) algorithm to improve the efficacy and efficiency of the path following and collision avoidance system. To verify the proposed algorithm, we conducted simulations of an autonomous ship under unknown environmental disturbances to adjust its heading in real time. A three-degree-of-freedom dynamic model for the autonomous ship was developed, and a line-of-sight (LOS) guidance system was used to guide the autonomous ship along a predefined path. Then, a proximal policy optimization (PPO) algorithm was implemented for the problem. We found that, after applying the advanced deep-RL method, an autonomous ship could learn the safest and most economical avoidance behavior through repeated trials. The simulation results showed that the proposed algorithm guaranteed collision avoidance with encountered moving ships while ensuring that the ship followed a predefined path. Additionally, the algorithm demonstrated that it could manage complex scenarios with various encountered ships in compliance with COLREGs, showing excellent adaptability to unknown complex environments.
Publication Date 2019-08-01
Role Corresponding Author
Category SCIE
Impact Factor 0.372

Luman Zhao, Myung-Il Roh, Sung-Jun Lee, "Control Method for Path Following and Collision Avoidance of Autonomous Ships Based on Deep Reinforcement Learning", Journal of Marine Science and Technology (Taiwan), Vol. 27, No. 4, pp. 293-310, 2019.08.01


List of Articles
번호 분류 제목 Publication Date
62 International Journal Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, Jin-Wuk Hong, Hong-Rae Lee, "Development and Validation of a Simulation-based Safety Evaluation Program for a Mega Floating Crane", Advances In Engineering Software, Vol. 112, pp. 101-116, 2017.10.01 file 2017-10-01
61 International Journal Seung-Ho Ham, Myung-Il Roh, Jung-Woo Hong, “Dynamic Effect of a Flexible Riser in a Fully Connected Semisubmersible Drilling Rig Using the Absolute Nodal Coordinate Formulation”, Journal of Offshore Mechanics and Arctic Engineering, 2017.10.01 file 2017-10-01
60 International Journal Ki-Su Kim, Myung-Il Roh, Sung-Min Lee, Han-Sung Kim, Hyunsik Ahn, "Weight-estimation Method of FPSO Topsides Considering the Work Breakdown Structure", Journal of Offshore Mechanics and Arctic Engineering, Vol. 40, No. 1, pp. 1-10, 2018.02.01 file 2018-02-01
59 International Journal Sun-Kyung Jung, Myung-Il Roh, Ki-Su Kim, "Arrangement Method of a Naval Surface Ship Considering Stability, Operability, and Survivability", Ocean Engineering, Vol. 152, pp. 316-333, 2018.02.23 file 2018-02-23
58 International Journal Sung-Min Lee, Myung-Il Roh, Ki-Su Kim, Seung-Ho Ham, "Optimum Design of Lug Arrangement Based on Static and Dynamic Analyses for Block Lifting", Journal of Ship Production and Design, Vol. 34, No. 2, pp. 119-133, 2018.05.01 file 2018-05-01
57 International Journal Luman Zhao, Myung-Il Roh, Seung-Ho Ham, "Anti-Sway Control of the Crane on an Offshore Support Vessel Based on the Hardware-In-The-Loop Simulation", International Journal of Offshore and Polar Engineering, Vol. 28, No. 2, pp. 182-189, 2018.06.01 file 2018-06-01
56 International Journal Sung-Min Lee, Myung-Il Roh, Ki-Su Kim, Hoe-Ryong Jung, Jong-Jin Park, "Method for a Simultaneous Determination of the Path and the Speed for Ship Route Planning Problems", Ocean Engineering, Vol. 157, pp. 301-312, 2018.06.01 file 2018-06-01
55 International Journal Seung-Ho Ham, Myung-Il Roh, Luman Zhao, "Integrated Method of Analysis, Visualization, and Hardware for Ship Motion Simulation", Journal of Computational Design and Engineering, Vol. 5, No. 3, pp. 285-298, 2018.07.01 file 2018-07-01
54 International Journal Seung-Ho Ham, Myung-Il Roh, Ju-Sung Kim, "Numerical Analysis of Wreck Removal Based on Multibody System Dynamics", Journal of Marine Science and Technology, Vol. 23, No. 3, pp. 521-535, 2018.09.01 file 2018-09-01
53 International Journal Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Nam-Kug Ku, "Coupled Analysis Method of a Mooring System and a Floating Crane Based on Flexible Multibody Dynamics Considering Contact with the Seabed", Ocean Engineering, Vol. 163, pp. 555-569, 2018.09.01 file 2018-09-01
52 International Journal Luman Zhao, Myung-Il Roh, Seung-Ho Ham, "Performance Analysis of an Active Heave Compensation System on an Offshore Supply Vessel Using the Hardware-In-The-Loop Simulation", Journal of Marine Science and Technology (Taiwan), Vol. 26, No. 5 file 2018-10-01
51 International Journal Min-Jae Oh, Myung-Il Roh, Tae-Wan Kim, "Local T-spline Surface Skinning with Shape Preservation", Computer-Aided Design, Vol. 104, pp. 15-26, 2018.11.01 file 2018-11-01
50 International Journal Hye-Won Lee, Myung-Il Roh, "Review of the Multibody Dynamics in the Applications of Ships and Offshore Structures", Ocean Engineering, Vol. 167, pp. 65-76, 2018.11.01 file 2018-11-01
49 International Journal Min-Jae Oh, Taw-Wan Kim, Myung-Il Roh, "G1 Bezier Surface Interpolation with T-junctions at a 3-Valent Singular Vertex", Computer Aided Geometric Design, Vol. 67, pp. 79-95, 2018.12.01 file 2018-12-01
48 International Journal Seung-Ho Ham, Myung-Il Roh, "Dynamic Analysis of Block Offloading Using Self-propelled Modular Transporters", Automation in Construction, Vol. 96, pp. 411-432, 2018.12.01 file 2018-12-01
47 International Journal Hyun-Cheol Kim, Myung-Il Roh, Soon-Hung Han, "Passenger Evacuation Simulation of MV SEWOL Considering the Heeling Angle Change During Sinking", International Journal of Naval Architecture and Ocean Engineering, Vol. 11, No. 1, pp. 329-343, 2019.01.01 file 2019-01-01
46 International Journal Min-Jae Oh, Myung-Il Roh, Sung-Woo Park, Do-Hyun Chun, Se-Hyun Myung, "Big Data-based Piping Material Analysis Framework in Offshore Structure for Contract Design", Ocean Systems Engineering, Vol. 9, No. 1, pp. 79-95, 2019.01.01 file 2019-01-01
45 International Journal Xing Li, Myung-Il Roh, Seung-Ho Ham, "A Collaborative Simulation in Shipbuilding and the Offshore Installation Based on the Integration of the Dynamic Analysis, Virtual Reality, and Control Devices", IJNAOE, Vol. 11, No. 2, pp. 699-722, 2019.07.01 file 2019-07-01
44 International Journal Sung-Woo Park, Myung-Il Roh, Min-Jae Oh, Seong-Hoon Kim, "Association Analysis of Piping Materials of an Offshore Structure Using Big Data Technology", Journal of Ship Production and Design, Vol. 35, No. 3, pp. 220-230, 2019.08.01 file 2019-08-01
» International Journal Luman Zhao, Myung-Il Roh, Sung-Jun Lee, "Control Method for Path Following and Collision Avoidance of Autonomous Ships Based on Deep Reinforcement Learning", Journal of Marine Science and Technology (Taiwan), Vol. 27, No. 4, pp. 293-310, 2019.08.01 file 2019-08-01
Board Pagination Prev 1 2 3 4 5 6 7 Next
/ 7

Powered by Xpress Engine / Designed by Sketchbook

sketchbook5, 스케치북5

sketchbook5, 스케치북5

나눔글꼴 설치 안내


이 PC에는 나눔글꼴이 설치되어 있지 않습니다.

이 사이트를 나눔글꼴로 보기 위해서는
나눔글꼴을 설치해야 합니다.

설치 취소