Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Donghun Yu, “Deep Reinforcement Learning-based Collision Avoidance for an Autonomous Ship”, Ocean Engineering, Vol. 234, pp. 1-20, 2021.08.15
https://doi.org/10.1016/j.oceaneng.2021.109216
International Journal
2021.05.22 19:25
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Donghun Yu, “Deep Reinforcement Learning-based Collision Avoidance for an Autonomous Ship”, Ocean Engineering, Vol. 234, pp. 1-20, 2021.08.15
조회 수 1665
| 첨부 '1' |
|---|
| Abstract | Social interest in autonomous navigation systems for autonomous ships is also increasing. For a robust autonomous navigation system, the location, speed, and direction of the ship and other ships must be identified in real time, and collision avoidance should be performed at an appropriate time by considering the collision risk. In this study, we proposed a collision avoidance method that quantitatively assesses the collision risk and then generates an avoidance path. First, to assess the collision risk, a collision risk assessment method based on the ship domain and the closest point of approach (CPA) was proposed. The ship domain is created with an asymmetric shape considering manoeuvring performance and the COLREGs. The CPA is used to assess quantitative collision risk value. Subsequently, a path generation algorithm based on deep reinforcement learning (DRL) was proposed to determine the avoidance time and to generate an avoidance path complying the COLREGs for the most dangerous ship in terms of collision risk. The information of own ship and target ship such as location, speed, heading, collision risk is used as the input state, and the rudder angle of own ship is set as the output action of the DRL. The cost function related to the path following and the collision avoidance is defined as the reward of the DRL-based collision avoidance method. Additionally, the DRL modes are defined to navigate the flexible avoidance path by changing the ratio between the path following and the collision avoidance. To verify the proposed method, we compared the collision avoidance method with the A* algorithm, which is a traditional path planning algorithm, and analyzed the results for various scenarios. The proposed method reliably avoided collisions through flexible paths for complex and unexpected changes in situations compared to the A* algorithm. |
|---|---|
| Publication Date | 2021-08-15 |
| Role | Corresponding Author |
| Category | SCI |
-
Jeong-Woo Hong, Myung-Il Roh, Seung-Ho Ham, Sol Ha, "Dynamic Simulation of Subsea Equipment Installation Using an Offshore Support Vessel Based on Flexible Multibody System Dynamics", Journal of Marine Science and Technology (Taiwan), Vol. 24, No. 4
-
Jeong-Ho Park, Myung-Il Roh, Hye-Won Lee, Yeong-Min Jo, Jisang Ha, Nam-Sun Son, "Multi-vessel Target Tracking with Camera Fusion for Unmanned Surface Vehicles", International Journal of Naval Architecture and Ocean Engineering, Vol. 16, 2024.07.14
-
In-Su Han, Myung-Il Roh, Min-Chul Kong, “An Automated Method for Converting P&IDs in Shipbuilding to Structured Graphs”, International Journal of Naval Architecture and Ocean Engineering, Vol. 17, pp. 100696.1-20, 2025.10.04
-
In-Su Han, Myung-Il Roh, Min-Chul Kong, Seoyoon Park, Jeongyoul Lee, "Search Method for Ship Regulations Based on Semantic Similarity Using Natural Language Processing", Ships and Offshore Structures, 2025.05.12
-
In-Chang Yeo, Myung-Il Roh, Yun-Sik Kim, Ha-Yun Kim, Do-Hyeok Ahn, Nam-Sun Son, "A Localization Method of Nearby Ships Based on 3D Object Detection Using a Camera", International Journal of Naval Architecture and Ocean Engineering, 2025.11.12
-
In-Chang Yeo, Myung-Il Roh, Dong-Guen Jeong, Jun-Sik Lee, "A Route Planning Method for Small Ships Inside the Marina", International Journal of Naval Architecture and Ocean Engineering, Vol. 17, pp. 100684.1-16, 2025.08.13
-
In-Chang Yeo, Myung-Il Roh, Do-Hyun Chun, Seok Ho Jang, Jae Won Heo, "Optimal Arrangement Design of Pipeline Support by Considering Safety and Production Cost", International Journal of Naval Architecture and Ocean Engineering, 2023.05.10
-
Hyun-Soo Kim, Myung-Il Roh, “Interpretable, Data-driven Models for Predicting Shaft Power, Fuel Consumption, and Speed Considering the Effects of Hull Fouling and Weather Conditions”, IJNAOE, 2024.04.14
-
Hyun-Cheol Kim, Myung-Il Roh, Soon-Hung Han, "Passenger Evacuation Simulation of MV SEWOL Considering the Heeling Angle Change During Sinking", International Journal of Naval Architecture and Ocean Engineering, Vol. 11, No. 1, pp. 329-343, 2019.01.01
-
Hyun Soo Kim, Myung-Il Roh, "Data-driven Model for Predicting Tank Pressure of an LNG Carrier Considering Environmental Effects", International Journal of Naval Architecture and Ocean Engineering, Vo.l. 18, 2026.01.01
-
Hye-Won Lee, Myung-Il Roh, Yeong-Min Cho, Jeong-Ho Park, "Data Association for Autonomous Ships Based on the Virtual Simulation Environment", Ocean Engineering, Vol. 281, pp. 114646.1-17, 2023.08.01
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Sol Ha, "Dynamic Simulation of the Wireline Riser Tensioner System for a Mobile Offshore Drilling Unit Based on Multibody System Dynamics", Ocean Engineering, Vol. 106, pp. 485-495, 2015.09.15
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Nam-Kug Ku, "Coupled Analysis Method of a Mooring System and a Floating Crane Based on Flexible Multibody Dynamics Considering Contact with the Seabed", Ocean Engineering, Vol. 163, pp. 555-569, 2018.09.01
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Underactuated Crane Control for the Automation of Block Erection in Shipbuilding", Automation in Construction, Vol. 124, pp. 1-28, 2021.04.01
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Block Erection Simulation Considering Frictional Contact with Wire Ropes", Ocean Engineering, Vol. 217, pp. 1-24, 2020.12.01
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Block Turnover Simulation Considering the Interferences between the Block and Wire Ropes in Shipbuilding", Automation in Construction, Vol. 67, pp. 60-75, 2016.07.01
-
Hye-Won Lee, Myung-Il Roh, Ki-Su Kim, “Ship Route Planning in Arctic Ocean Based on POLARIS”, Ocean Engineering, Vol. 234, pp. 109297.1-14, 2021.08.15
-
Hye-Won Lee, Myung-Il Roh, "Review of the Multibody Dynamics in the Applications of Ships and Offshore Structures", Ocean Engineering, Vol. 167, pp. 65-76, 2018.11.01
-
Hye-Won Lee, Joo-Hyun Woo, Myung-Il Roh, Seung-Ho Ham, et al., "Integrated Simulation of Virtual Prototypes and Control Algorithms of Unmanned Surface Vehicles Based on a Robot Operating System", Journal of Marine Science and Technology (Taiwan)
-
Ha-Yun Kim, Myung-Il Roh, Hye-Won Lee, In-Chang Yeo, Yeong-Min Jo, Jisang Ha, Nam-Sun Son, “A Hybrid Tracking Method for Maritime Obstacles Using Sensor Data”, Ocean Engineering, Vol. 312, Part 2, 2024.09.16
