Skip to content
Extra Form
Abstract Developing a high-level autonomous collision avoidance system for ships that can operate in an unstructured and unpredictable environment is challenging. Particularly in congested sea areas, each ship should make decisions continuously to avoid collisions with other ships in a busy and complex waterway. Furthermore, recent reports indicate that a large number of marine collision accidents are caused by or are related to human decision failures concerning a lack of situational awareness and failure to comply with the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose an efficient method to overcome multiship collision avoidance problems based on the Deep Reinforcement Learning (DRL) algorithm by expanding our previous study (Zhao et al., 2019). The proposed method directly maps the states of encountered ships to an ownship's steering commands in terms of rudder angle using the Deep Neural Network (DNN). This DNN is trained over multiple ships in rich encountering situations using the policy-gradient based DRL algorithm. To address multiple encountered ships, we classify them into four regions based on COLREGs, and consider only the nearest ship in each region. We validate the proposed collision avoidance method in a variety of simulated scenarios with thorough performance evaluations, and demonstrate that the final DRL controller can obtain time efficient and collision-free paths for multiple ships. Simulation results indicate that multiple ships can avoid collisions with each other while following their own predefined paths simultaneously. In addition, the proposed approach demonstrates its excellent adaptability to unknown complex environments with various encountered ships.
Publication Date 2019-11-01
Role Corresponding Author
Category SCI
Impact Factor 1.894

Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01


List of Articles
번호 분류 제목 Publication Date
174 International Journal Beom-Soo Kim, Min-Jae Oh, Jae-Hoon Lee, Yonghwan Kim, Myung-Il Roh, "Study on Hull Optimization Process Considering Operational Efficiency in Waves", Processes, Vol. 9, No. 5, pp. 898.1-21, 2021.05.19 file 2021-05-19
173 International Journal Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, "Automation of Crane Control for Block Lifting Based on Deep Reinforcement Learning", Journal of Computational Design and Engineering, Vol. 9, No. 4, pp. 1430- 1448, 2022.07.23 file 2022-07-23
172 International Journal Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Donghun Yu, “Deep Reinforcement Learning-based Collision Avoidance for an Autonomous Ship”, Ocean Engineering, Vol. 234, pp. 1-20, 2021.08.15 file 2021-08-15
171 International Journal Do-Hyun Chun, Myung-Il Roh, Seung-Ho Ham, “Optimum Arrangement Design of Mastic Ropes for Membrane-type LNG Tanks Considering the Flatness of Thermal Insulation Panel and Production Cost”, Journal of Marine Science and Engineering, Vol. 8, No. 5 file 2020-05-16
170 International Journal Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, "Lifting Simulation of an Offshore Supply Vessel Considering Various Operating Conditions", Advances in Mechanical Engineering, Vol. 8, No. 6, pp. 1-13, 2016.06.16 file 2016-06-16
169 International Journal Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, Chan-Young Lee, “Performance Analyses of Naval Ships Based on Engineering Level of Simulation at the Initial Design Stage”, IJNAOE, Vol. 9, No. 4, pp. 446-459, 2017.07.01 file 2017-07-01
168 International Journal Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, “Case Study of Detection and Maneuvering Performance of Naval Ships Using Engagement Simulation of Engineering Level”, Ocean Systems Engineering, Vol. 7, No. 3, pp. 247-273, 2017.09.01 file 2017-09-01
167 International Journal Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, "Lifting Off Simulation of an Offshore Supply Vessel Considering Ocean Environmental Loads and Lifting Off Velocity", Ocean Systems Engineering, Vol. 5, No. 3, pp. 181-198, 2015.09.01 file 2015-09-01
166 International Journal Hye-Won Lee, Joo-Hyun Woo, Myung-Il Roh, Seung-Ho Ham, et al., "Integrated Simulation of Virtual Prototypes and Control Algorithms of Unmanned Surface Vehicles Based on a Robot Operating System", Journal of Marine Science and Technology (Taiwan) file 2021-09-03
165 International Journal Hye-Won Lee, Myung-Il Roh, "Review of the Multibody Dynamics in the Applications of Ships and Offshore Structures", Ocean Engineering, Vol. 167, pp. 65-76, 2018.11.01 file 2018-11-01
164 International Journal Hye-Won Lee, Myung-Il Roh, Ki-Su Kim, “Ship Route Planning in Arctic Ocean Based on POLARIS”, Ocean Engineering, Vol. 234, pp. 109297.1-14, 2021.08.15 file 2021-08-15
163 International Journal Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Block Turnover Simulation Considering the Interferences between the Block and Wire Ropes in Shipbuilding", Automation in Construction, Vol. 67, pp. 60-75, 2016.07.01 file 2016-07-01
162 International Journal Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Block Erection Simulation Considering Frictional Contact with Wire Ropes", Ocean Engineering, Vol. 217, pp. 1-24, 2020.12.01 file 2020-12-01
161 International Journal Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Underactuated Crane Control for the Automation of Block Erection in Shipbuilding", Automation in Construction, Vol. 124, pp. 1-28, 2021.04.01 file 2021-04-01
160 International Journal Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Nam-Kug Ku, "Coupled Analysis Method of a Mooring System and a Floating Crane Based on Flexible Multibody Dynamics Considering Contact with the Seabed", Ocean Engineering, Vol. 163, pp. 555-569, 2018.09.01 file 2018-09-01
159 International Journal Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Sol Ha, "Dynamic Simulation of the Wireline Riser Tensioner System for a Mobile Offshore Drilling Unit Based on Multibody System Dynamics", Ocean Engineering, Vol. 106, pp. 485-495, 2015.09.15 file 2015-09-15
158 International Journal Hyun-Cheol Kim, Myung-Il Roh, Soon-Hung Han, "Passenger Evacuation Simulation of MV SEWOL Considering the Heeling Angle Change During Sinking", International Journal of Naval Architecture and Ocean Engineering, Vol. 11, No. 1, pp. 329-343, 2019.01.01 file 2019-01-01
157 International Journal Jeong-Woo Hong, Myung-Il Roh, Seung-Ho Ham, Sol Ha, "Dynamic Simulation of Subsea Equipment Installation Using an Offshore Support Vessel Based on Flexible Multibody System Dynamics", Journal of Marine Science and Technology (Taiwan), Vol. 24, No. 4 file 2016-08-01
156 International Journal Ji-Hyun Hwang, Myung-Il Roh, Kyu-Yeul Lee, "Determination of the Optimal Operating Condition of the Dual Mixed Refrigerant Cycle for the LNG FPSO Topside Liquefaction Process", Computers and Chemical Engineering, Vol. 49, pp. 25-36, 2013.02.01 file 2013-02-01
155 International Journal Ji-Hyun Hwang, Myung-Il Roh, Kyu-Yeul Lee, "Integrated Engineering Environment for the Process FEED of Offshore Oil and Gas Production Plants", Ocean Systems Engineering, Vol. 2, No. 1, pp. 49-68, 2012.03.01 file 2012-03-01
Board Pagination Prev 1 2 3 4 5 6 7 8 9 Next
/ 9

Powered by Xpress Engine / Designed by Sketchbook

sketchbook5, 스케치북5

sketchbook5, 스케치북5

나눔글꼴 설치 안내


이 PC에는 나눔글꼴이 설치되어 있지 않습니다.

이 사이트를 나눔글꼴로 보기 위해서는
나눔글꼴을 설치해야 합니다.

설치 취소