Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Donghun Yu, “Deep Reinforcement Learning-based Collision Avoidance for an Autonomous Ship”, Ocean Engineering, Vol. 234, pp. 1-20, 2021.08.15
https://doi.org/10.1016/j.oceaneng.2021.109216
International Journal
2021.05.22 19:25
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Donghun Yu, “Deep Reinforcement Learning-based Collision Avoidance for an Autonomous Ship”, Ocean Engineering, Vol. 234, pp. 1-20, 2021.08.15
조회 수 412
| 첨부 '1' |
|---|
| Abstract | Social interest in autonomous navigation systems for autonomous ships is also increasing. For a robust autonomous navigation system, the location, speed, and direction of the ship and other ships must be identified in real time, and collision avoidance should be performed at an appropriate time by considering the collision risk. In this study, we proposed a collision avoidance method that quantitatively assesses the collision risk and then generates an avoidance path. First, to assess the collision risk, a collision risk assessment method based on the ship domain and the closest point of approach (CPA) was proposed. The ship domain is created with an asymmetric shape considering manoeuvring performance and the COLREGs. The CPA is used to assess quantitative collision risk value. Subsequently, a path generation algorithm based on deep reinforcement learning (DRL) was proposed to determine the avoidance time and to generate an avoidance path complying the COLREGs for the most dangerous ship in terms of collision risk. The information of own ship and target ship such as location, speed, heading, collision risk is used as the input state, and the rudder angle of own ship is set as the output action of the DRL. The cost function related to the path following and the collision avoidance is defined as the reward of the DRL-based collision avoidance method. Additionally, the DRL modes are defined to navigate the flexible avoidance path by changing the ratio between the path following and the collision avoidance. To verify the proposed method, we compared the collision avoidance method with the A* algorithm, which is a traditional path planning algorithm, and analyzed the results for various scenarios. The proposed method reliably avoided collisions through flexible paths for complex and unexpected changes in situations compared to the A* algorithm. |
|---|---|
| Publication Date | 2021-08-15 |
| Role | Corresponding Author |
| Category | SCI |
-
Min-Chul Kong, Myung-Il Roh, Ki-Su Kim, Ho-Gyun Park, Jong-Oh Kim, "Variable Indexing Method in Rule Documents for Ship Design Using Extraction of PDF Elements", Journal of Computational Design and Engineering, Vol. 9, No. 6, 2022.11.16
-
Jin-Hyeok Kim, Myung-Il Roh et al., "Prediction of the Superiority of the Hydrodynamic Performance of Hull Forms Using Deep Learning", International Journal of Naval Architecture and Ocean Engineering, Vol. 49, pp. 100490.1-15, pp. 2022.11.01
-
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, "Automation of Crane Control for Block Lifting Based on Deep Reinforcement Learning", Journal of Computational Design and Engineering, Vol. 9, No. 4, pp. 1430- 1448, 2022.07.23
-
Min-Chul Kong, Myung-Il Roh, Ki-Su Kim, Jeongyoul Lee, Jongoh Kim, Gapheon Lee, "Object Detection Method for Ship Safety Plans Using Deep Learning", Ocean Engineering, 2022.02.15
-
Ki-Su Kim, Myung-Il Roh, Seung-Min Lee, "Quasi-static Flooding Analysis Method of a Damaged Ship Considering Oil Spill and Cargo Load", Journal of Ship Production and Design, 2022.02.10
-
Won-Jae Lee, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Yeong-Min Cho, Nam-Sun Son, “Detection and Tracking for the Awareness of Surroundings of a Ship Based on Deep Learning”, Journal of Computational Design and Engineering, Vo. 8, No. 5
-
June-Beom Lee, Myung-Il Roh, Ki-Su Kim, “Prediction of Ship Power Based on Variation in Deep Feed-forward Neural Network”, International Journal of Naval Architecture and Ocean Engineering, 2021.08.07
-
Hye-Won Lee, Myung-Il Roh, Ki-Su Kim, “Ship Route Planning in Arctic Ocean Based on POLARIS”, Ocean Engineering, Vol. 234, pp. 109297.1-14, 2021.08.15
-
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Donghun Yu, “Deep Reinforcement Learning-based Collision Avoidance for an Autonomous Ship”, Ocean Engineering, Vol. 234, pp. 1-20, 2021.08.15
-
Beom-Soo Kim, Min-Jae Oh, Jae-Hoon Lee, Yonghwan Kim, Myung-Il Roh, "Study on Hull Optimization Process Considering Operational Efficiency in Waves", Processes, Vol. 9, No. 5, pp. 898.1-21, 2021.05.19
-
Min-Jae Oh, Myung-Il Roh, Sung-Woo Park, Do-Hyun Chun, Myeong-Jo Son, Jeong-Youl Lee, “Operational Analysis of Container Ships by Using Maritime Big Data”, Journal of Marine Science and Engineering, Vol. 9, No. 4, pp. 438: 1-21, 2021.04.18
-
Jisang Ha, Myung-Il Roh, Hye-Won Lee, “Quantitative Calculation Method of the Collision Risk for Collision Avoidance in Ship Navigation Using the CPA and Ship Domain”, Journal of Computational Design and Engineering, Vol. 8, No. 3, 2021.06.01
-
Seung-Min Lee, Jong-Hyeok Lee, Myung-Il Roh, Ki-Su Kim, Seung-Ho Ham, Hye-Won Lee, "An Optimization Model of Tugboat Operation for Conveying a Large Surface Vessel", Journal of Computational Design and Engineering, Vol. 8, No. 2, 2021.04.01
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Underactuated Crane Control for the Automation of Block Erection in Shipbuilding", Automation in Construction, Vol. 124, pp. 1-28, 2021.04.01
-
Hye-Won Lee, Joo-Hyun Woo, Myung-Il Roh, Seung-Ho Ham, et al., "Integrated Simulation of Virtual Prototypes and Control Algorithms of Unmanned Surface Vehicles Based on a Robot Operating System", Journal of Marine Science and Technology (Taiwan)
-
Jisang Ha, Myung-Il Roh, Seung-Ho Ham, Sung-Jun Lee, “Optimum Design of the Underwater Discharge System Based on Surrogate Modeling”, Journal of Marine Science and Technology (Taiwan), Vol. 29, No. 3, pp. 338-353, 2021.06.01
-
Ki-Su Kim, June-Beom Lee, Myung-Il Roh, Ki-Min Han, Gap-Heon Lee, "Prediction of Ocean Weather Based on Denoising AutoEncoder and Convolutional LSTM", Journal of Marine Science and Engineering, Vol. 8, No. 10, pp. 805:1-24, 2020.10.14
-
Ki-Su Kim, Myung-Il Roh, “ISO 15016:2015-based Method for Estimating the Fuel Oil Consumption of a Ship”, Journal of Marine Science and Engineering, Vol. 8, No. 10, pp. 791:1-18, 2020.10.12
-
Sung-Jun Lee, Myung-Il Roh, Min-Jae Oh, "Image-based Ship Detection Using Deep Learning", Ocean Systems Engineering, Vol. 10, No. 4, pp. 415-434, 2020.12.01
-
Ki-Su Kim, Myung-Il Roh, "Dynamic Flooding Analysis Method for Intermediate Flooding Process of a Ship", Ocean Engineering, Vol. 218, pp. 108173.1-33, 2020.12.15
