Skip to content
Extra Form
Abstract Developing a high-level autonomous collision avoidance system for ships that can operate in an unstructured and unpredictable environment is challenging. Particularly in congested sea areas, each ship should make decisions continuously to avoid collisions with other ships in a busy and complex waterway. Furthermore, recent reports indicate that a large number of marine collision accidents are caused by or are related to human decision failures concerning a lack of situational awareness and failure to comply with the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose an efficient method to overcome multiship collision avoidance problems based on the Deep Reinforcement Learning (DRL) algorithm by expanding our previous study (Zhao et al., 2019). The proposed method directly maps the states of encountered ships to an ownship's steering commands in terms of rudder angle using the Deep Neural Network (DNN). This DNN is trained over multiple ships in rich encountering situations using the policy-gradient based DRL algorithm. To address multiple encountered ships, we classify them into four regions based on COLREGs, and consider only the nearest ship in each region. We validate the proposed collision avoidance method in a variety of simulated scenarios with thorough performance evaluations, and demonstrate that the final DRL controller can obtain time efficient and collision-free paths for multiple ships. Simulation results indicate that multiple ships can avoid collisions with each other while following their own predefined paths simultaneously. In addition, the proposed approach demonstrates its excellent adaptability to unknown complex environments with various encountered ships.
Publication Date 2019-11-01
Role Corresponding Author
Category SCI
Impact Factor 1.894

Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01


List of Articles
번호 분류 제목 Publication Date
86 International Journal Ji-Hyun Hwang, Nam-Kug Ku, Myung-Il Roh, Kyu-Yeul Lee, "Optimal Design of Liquefaction Cycles of Liquefied Natural Gas", Industrial & Engineering Chemistry Research, Vol. 52, No. 15, pp. 5341-5356, 2013.03.01 file 2013-03-01
85 International Journal Jisang Ha, Myung-Il Roh, Hye-Won Lee, “Quantitative Calculation Method of the Collision Risk for Collision Avoidance in Ship Navigation Using the CPA and Ship Domain”, Journal of Computational Design and Engineering, Vol. 8, No. 3, 2021.06.01 file 2021-06-01
84 International Journal Jisang Ha, Myung-Il Roh, Seung-Ho Ham, Sung-Jun Lee, “Optimum Design of the Underwater Discharge System Based on Surrogate Modeling”, Journal of Marine Science and Technology (Taiwan), Vol. 29, No. 3, pp. 338-353, 2021.06.01 file 2021-06-01
83 International Journal John-Kyu Hwang, Myung-Il Roh, Ju-Hwan Cha, “Design Modification of a Damaged Free-Fall Lifeboat for FPSO Through Free-Fall Tests”, International Journal of Offshore and Polar Engineering, Vol. 26, No. 4, pp. 417-422, 2016.12.01 file 2016-12-01
82 International Journal John-Kyu Hwang, Myung-Il Roh, Kyu-Yeul Lee, "Detailed Design and Construction of the Hull of an FPSO(Floating, Production, Storage, and Off-loading unit)", Ships and Offshore Structures, Vol. 5, No. 2, pp. 93-104, 2010.06.01 file 2010-06-01
81 International Journal Joo-Pil Lee, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "Design of a Wreck Removal Method Considering Safety and Economy", Ships and Offshore Structures, Vol. 15, No. 10, pp. 1037-1056, 2020.12.01 file 2020-12-01
80 International Journal Ju-Hwan Cha, Myung-Il Roh, Kyu-Yeul Lee, "Combined Discrete Event and Discrete Time Simulation Framework and Its Application to the Block Erection Process in Shipbuilding", Advances In Engineering Software, Vol. 41, No. 4, pp. 656-665, 2010.04.01 file 2010-04-01
79 International Journal Ju-Hwan Cha, Myung-Il Roh, Kyu-Yeul Lee, "Dynamic Response Simulation of a Heavy Cargo Suspended by a Floating Crane Based on Multibody System Dynamics", Ocean Engineering, Vol. 37, No. 14-15, pp. 1273-1291, 2010.10.01 file 2010-10-01
78 International Journal Ju-Hwan Cha, Myung-Il Roh, Kyu-Yeul Lee, "Integrated Simulation Framework for the Process Planning of Ships and Offshore Structures", Robotics and Computer-Integrated Manufacturing Journal, Vol, 26, No. 5, pp. 430-453, 2010.10.01 file 2010-10-01
77 International Journal Ju-Hwan Cha, Seung-Ho Ham, Kyu-Yeul Lee, Myung-Il Roh, "Application of a Topological Modelling Approach of Multi-body System Dynamics to Simulation of Multi-floating Cranes in Shipyards", Journal of Multi-body Dynamics, Vol. 224, No. 4, pp. 365-373, 2010.12.01 file 2010-12-01
76 International Journal Ju-Sung Kim, Myung-Il Roh, Seung-Ho Ham, “A Method for Intermediate Flooding and Sinking Simulation of a Damaged Floater in Time Domain”, Journal of Computational Design and Engineering, Vol. 4, No. 1, pp. 1-13, 2017.01.01 file 2017-01-01
75 International Journal June-Beom Lee, Myung-Il Roh, Ki-Su Kim, “Prediction of Ship Power Based on Variation in Deep Feed-forward Neural Network”, International Journal of Naval Architecture and Ocean Engineering, 2021.08.07 file 2021-08-12
74 International Journal Ki-Su Kim, June-Beom Lee, Myung-Il Roh, Ki-Min Han, Gap-Heon Lee, "Prediction of Ocean Weather Based on Denoising AutoEncoder and Convolutional LSTM", Journal of Marine Science and Engineering, Vol. 8, No. 10, pp. 805:1-24, 2020.10.14 file 2020-10-14
73 International Journal Ki-Su Kim, Myung-Il Roh, "A Submarine Arrangement Design Program Based on the Expert System and the Multistage Optimization", Advances In Engineering Software, Vol. 98, No. 97-111, 2016.08.01 file 2016-08-01
72 International Journal Ki-Su Kim, Myung-Il Roh, "Dynamic Flooding Analysis Method for Intermediate Flooding Process of a Ship", Ocean Engineering, Vol. 218, pp. 108173.1-33, 2020.12.15 file 2020-12-15
71 International Journal Ki-Su Kim, Myung-Il Roh, Seung-Min Lee, "Quasi-static Flooding Analysis Method of a Damaged Ship Considering Oil Spill and Cargo Load", Journal of Ship Production and Design, 2022.02.10 file 2022-02-10
70 International Journal Ki-Su Kim, Myung-Il Roh, Sol Ha, "Expert System Based on the Arrangement Evaluation Model for the Arrangement Design of a Submarine", Expert Systems with Applications, Vol. 42, No. 22, pp. 8731-8744, 2015.12.01 file 2015-12-01
69 International Journal Ki-Su Kim, Myung-Il Roh, Sung-Min Lee, Han-Sung Kim, Hyunsik Ahn, "Weight-estimation Method of FPSO Topsides Considering the Work Breakdown Structure", Journal of Offshore Mechanics and Arctic Engineering, Vol. 40, No. 1, pp. 1-10, 2018.02.01 file 2018-02-01
68 International Journal Ki-Su Kim, Myung-Il Roh, “ISO 15016:2015-based Method for Estimating the Fuel Oil Consumption of a Ship”, Journal of Marine Science and Engineering, Vol. 8, No. 10, pp. 791:1-18, 2020.10.12 file 2020-10-12
67 International Journal Kyu-Yeul Lee, Myung-Il Roh, "A Hybrid Optimization Method for Multidisciplinary Ship Design", Journal of Ship Technology Research, Vol. 47, No. 4, pp. 181-185, 2000.10.01 file 2000-10-01
Board Pagination Prev 1 2 3 4 5 6 Next
/ 6

Powered by Xpress Engine / Designed by Sketchbook

sketchbook5, 스케치북5

sketchbook5, 스케치북5

나눔글꼴 설치 안내


이 PC에는 나눔글꼴이 설치되어 있지 않습니다.

이 사이트를 나눔글꼴로 보기 위해서는
나눔글꼴을 설치해야 합니다.

설치 취소