Skip to content
Extra Form
Abstract Developing a high-level autonomous collision avoidance system for ships that can operate in an unstructured and unpredictable environment is challenging. Particularly in congested sea areas, each ship should make decisions continuously to avoid collisions with other ships in a busy and complex waterway. Furthermore, recent reports indicate that a large number of marine collision accidents are caused by or are related to human decision failures concerning a lack of situational awareness and failure to comply with the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose an efficient method to overcome multiship collision avoidance problems based on the Deep Reinforcement Learning (DRL) algorithm by expanding our previous study (Zhao et al., 2019). The proposed method directly maps the states of encountered ships to an ownship's steering commands in terms of rudder angle using the Deep Neural Network (DNN). This DNN is trained over multiple ships in rich encountering situations using the policy-gradient based DRL algorithm. To address multiple encountered ships, we classify them into four regions based on COLREGs, and consider only the nearest ship in each region. We validate the proposed collision avoidance method in a variety of simulated scenarios with thorough performance evaluations, and demonstrate that the final DRL controller can obtain time efficient and collision-free paths for multiple ships. Simulation results indicate that multiple ships can avoid collisions with each other while following their own predefined paths simultaneously. In addition, the proposed approach demonstrates its excellent adaptability to unknown complex environments with various encountered ships.
Publication Date 2019-11-01
Role Corresponding Author
Category SCI
Impact Factor 1.894

Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01


List of Articles
번호 분류 제목 Publication Date
86 International Journal Ju-Hwan Cha, Myung-Il Roh, Kyu-Yeul Lee, "Dynamic Response Simulation of a Heavy Cargo Suspended by a Floating Crane Based on Multibody System Dynamics", Ocean Engineering, Vol. 37, No. 14-15, pp. 1273-1291, 2010.10.01 file 2010-10-01
85 International Journal Ju-Hwan Cha, Seung-Ho Ham, Kyu-Yeul Lee, Myung-Il Roh, "Application of a Topological Modelling Approach of Multi-body System Dynamics to Simulation of Multi-floating Cranes in Shipyards", Journal of Multi-body Dynamics, Vol. 224, No. 4, pp. 365-373, 2010.12.01 file 2010-12-01
84 International Journal Myung-Il Roh, Ju-Hwan Cha, "A Block Transportation Scheduling System Considering a Minimization of Travel Distance without Loading of and Interference between Multiple Transporters", International Journal of Production Research, Vol. 49, No. 11, pp. 3231-3250, 2011.06.01 file 2011-06-01
83 International Journal Nam-Kug Ku, Ara Jo, Sol Ha, Myung-Il Roh, Kyu-Yeul Lee, "Automatic Generation of Equations of Motion for Multibody System in Discrete Event Simulation Framework", Procedia Technology, Vol. 1, No. 1, pp. 55-64, 2012.02.01 file 2012-02-01
82 International Journal Ji-Hyun Hwang, Myung-Il Roh, Kyu-Yeul Lee, "Integrated Engineering Environment for the Process FEED of Offshore Oil and Gas Production Plants", Ocean Systems Engineering, Vol. 2, No. 1, pp. 49-68, 2012.03.01 file 2012-03-01
81 International Journal Sol Ha, Ju-Hwan Cha, Myung-Il Roh, Kyu-Yeul Lee, "Implementation of the Submarine Diving Simulation in a Distributed Environment", International Journal of Naval Architecture and Ocean Engineering, Vol. 4, No. 3, pp. 211-227, 2012.09.01 file 2012-09-01
80 International Journal Sol Ha, Nam-Kug Ku, Myung-Il Roh, Kyu-Yeul Lee, "Cell-Based Evacuation Simulation Considering Human Behavior in a Passenger Ship", Ocean Engineering, Vol. 53, pp. 138-152, 2012.10.01 file 2012-10-01
79 International Journal Myung-Il Roh, "Block Layout Method in the Block Stockyard Based on the Genetic Algorithm", Ocean Systems Engineering, Vol. 2, No. 4, pp. 271-287, 2012.12.01 file 2012-12-01
78 International Journal Myung-Il Roh, Sol Ha, "Advanced Ship Evacuation Analysis Using a Cell-Based Simulation Model", Computers In Industry, Vol. 64, No. 1, pp. 80-89, 2013.01.01 file 2013-01-01
77 International Journal Ji-Hyun Hwang, Myung-Il Roh, Kyu-Yeul Lee, "Determination of the Optimal Operating Condition of the Dual Mixed Refrigerant Cycle for the LNG FPSO Topside Liquefaction Process", Computers and Chemical Engineering, Vol. 49, pp. 25-36, 2013.02.01 file 2013-02-01
76 International Journal Ji-Hyun Hwang, Nam-Kug Ku, Myung-Il Roh, Kyu-Yeul Lee, "Optimal Design of Liquefaction Cycles of Liquefied Natural Gas", Industrial & Engineering Chemistry Research, Vol. 52, No. 15, pp. 5341-5356, 2013.03.01 file 2013-03-01
75 International Journal Myung-Il Roh, "Determination of an Economical Shipping Route Considering the Effects of Sea State for Lower Fuel Consumption", International Journal of Naval Architecture and Ocean Engineering, Vol. 5, No. 2, pp. 246-262, 2013.06.01 file 2013-06-01
74 International Journal Nam-Kug Ku, Ju-Hwan Cha, Myung-Il Roh, Kyu-Yeul Lee, "A Tagline Proportional-Derivative Control Method for the Anti-Swing Motion of a Heavy Load Suspended by a Floating Crane in Waves", Journal of Engineering for the Maritime Environment, Vol. 227, No. 4, pp. 357-366, 2013.11.01 file 2013-11-01
73 International Journal Nam-Kug Ku, Ji-Hyun Hwang, Joon-Chae Lee, Myung-Il Roh, Kyu-Yeul Lee, "Optimal Module Layout for a Generic Offshore LNG Liquefaction Process of LNG-FPSO", Ships and Offshore Structures, Vol. 9, No. 3, pp. 311-332, 2014.05.01 file 2014-05-01
72 International Journal Nam-Kug Ku, Sol Ha, Myung-Il Roh, "Crane Modeling and Simulation in Offshore Structure Building Industry", International Journal of Computer Theory and Engineering, Vol. 6, No. 3, pp. 278-284, 2014.06.01 file 2014-06-01
71 International Journal Nam-Kug Ku, Sol Ha, Myung-Il Roh, "Design of Controller for Mobile Robot in Welding Process of Shipbuilding Engineering", Journal of Computational Design and Engineering, Vol. 1, No. 4, pp. 243-255, 2014.10.01 file 2014-10-01
70 International Journal Tae-Sub Um, Myung-Il Roh, "Optimal Dimension Design of a Hatch Cover for Lightening a Bulk Carrier", International Journal of Naval Architecture and Ocean Engineering, Vol. 7, No. 2, pp. 270-287, 2015.03.01 file 2015-03-01
69 International Journal Luman Zhao, Myung-Il Roh, Jeong-Woo Hong, "Optimal Thrust Allocation for Dynamic Positioning of Deep-sea Working Vessel", Journal of Advanced Research in Ocean Engineering, Vol. 1, No. 2, pp. 94-105, 2015.06.01 file 2015-06-01
68 International Journal Sol Ha, Nam-Kug Ku, Myung-Il Roh, Ho-Jin Hwang, "Multibody System Dynamics Simulator for Process Simulation of Ships and Offshore Plants in Shipyards", Advances In Engineering Software, Vol. 85, pp. 12-25, 2015.07.01 file 2015-07-01
67 International Journal Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, "Lifting Off Simulation of an Offshore Supply Vessel Considering Ocean Environmental Loads and Lifting Off Velocity", Ocean Systems Engineering, Vol. 5, No. 3, pp. 181-198, 2015.09.01 file 2015-09-01
Board Pagination Prev 1 2 3 4 5 6 Next
/ 6

Powered by Xpress Engine / Designed by Sketchbook

sketchbook5, 스케치북5

sketchbook5, 스케치북5

나눔글꼴 설치 안내


이 PC에는 나눔글꼴이 설치되어 있지 않습니다.

이 사이트를 나눔글꼴로 보기 위해서는
나눔글꼴을 설치해야 합니다.

설치 취소