Luman Zhao, Myung-Il Roh, Hye-Won Lee, Do-Hyun Chun, Sung-Jun Lee, "A Collision Avoidance Method of Multi-ships Based on Deep Reinforcement Learning Considering COLREGs", Proceedings of ICCAS(International Conference on Computer Applications in Shipbuilding) 2019, Rotterdam, Netherlands, pp. 85-88, 2019.09.24-26
International Conference
2019.08.06 15:07
Luman Zhao, Myung-Il Roh, Hye-Won Lee, Do-Hyun Chun, Sung-Jun Lee, "A Collision Avoidance Method of Multi-ships Based on Deep Reinforcement Learning Considering COLREGs," Proceedings of ICCAS 2019, Rotterdam, Netherlands, pp. 85-88, 2019.09.24-26
조회 수 272
첨부 '1' |
---|
Abstract | Developing a high-level autonomous collision avoidance system for ships which can operate in an unstructured and unpredictable environment is a challenging task. Especially in the congested sea areas, each ship should continuously make decisions to avoid collisions with many other ships in the busy and complex waterway. Furthermore, recent reports indicate that a large number of collision accidents at sea are caused by or related to human decision failures with lack of situational awareness and failure to comply with International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose a robust and efficient method to collision avoidance problems of multi-ships based on the deep reinforcement learning (DRL) algorithm. The proposed method directly maps the states of encountered ships to an ownship’s steering commands in terms of the rudder angle using a deep neural network (DNN). This DNN is trained over multi-ships on rich encountering situations using the policy gradient based DRL algorithm. To handle multiple encountered ships, we classify them into four regions based on COLREGs, and only consider the nearest ship in each region. We validate the proposed method in a variety of simulated scenarios thorough performance evaluations. The result shows that the proposed method can find time efficient, collision-free paths for multi-ships. Also, it shows that the proposed method has excellent adaptability to unknown complex environments. |
---|---|
Publication Date | 2019-09-24 |
-
Myung-Il Roh, "Applications of Deep Learning in Ship Design, Production, and Operation Stages", Proceedings of ICDM(International Conference on Decarbonization and Digitalization in Marine Engineering) 2022, Siheung, Korea, 2022.04.28-29
CategoryInternational Conference -
Jeong-Ho Park, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Yeong-Min Jo, Nam-Sun Son, "Detection and Tracking Methods of Maritime Obstacles Using Multiple Cameras", Proceedings of ICDM 2022, Siheung, Korea, 2022.04.28-29
CategoryInternational Conference -
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "A Block Lifting Method with Wire Ropes Based on Deep Reinforcement Learning", Proceedings of ICDM 2022, Si-Heung, Korea, 2022.04.28-29
CategoryInternational Conference -
Dong-Guen Jeong, Myung-Il Roh, Ki-Su Kim, Jun-Sik Lee, Dae-Hyuk Kim, Wang-Seok Jang, "A Method for Route Planning of Small Ships in Coastal Areas", Proceedings of ICDM 2022, Si-Heung, Korea, 2022.04.28-29
CategoryInternational Conference -
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, "Deep Reinforcement Learning-Based Ship Collision Avoidance Considering Collision Risk", Proceedings of TEAM 2022, Istanbul, Turkey, pp. 268, 2021.12.06-07
CategoryInternational Conference -
Ki-Su Kim, Myung-Il Roh, "Optimization of the Arrangement Design of a Ship Considering the Multiple Performance", Proceedings of ACSMO 2020, Seoul, Korea, pp. 167, 2020.11.23-25
CategoryInternational Conference -
Jisang Ha, Myung-Il Roh, Hye-Won Lee, Jong-Ho Eun, Jong-Jin Park, Hyun-Joe Kim, "A Method of the Collision Avoidance of a Ship Using Real-time AIS Data", Proceedings of ACSMO 2020, Seoul, Korea, pp. 106, 2020.11.23-25
CategoryInternational Conference -
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Method for the Accurate and Automatic Operation of Offshore Floating Cranes for the Block Erection in Shipyards", Proceedings of OMAE 2020, Held in Virtual Conference, 2020.08.03-07
CategoryInternational Conference -
Jisang Ha, Myung-Il Roh, Jong-Hyeok Lee, Jin-Hyeok Kim, Min-Chul Kong, Seung-Ho Ham, "Integrated Ship Remote Operating System Based on Digital Twin Technology", Proceedings of TEAM 2019, Tainan, Taiwan, pp. 106, 2019.10.14-17
CategoryInternational Conference -
Luman Zhao, Myung-Il Roh, Hye-Won Lee, Do-Hyun Chun, Sung-Jun Lee, "A Collision Avoidance Method of Multi-ships Based on Deep Reinforcement Learning Considering COLREGs," Proceedings of ICCAS 2019, Rotterdam, Netherlands, pp. 85-88, 2019.09.24-26
CategoryInternational Conference