Luman Zhao, Myung-Il Roh, Hye-Won Lee, Do-Hyun Chun, Sung-Jun Lee, "A Collision Avoidance Method of Multi-ships Based on Deep Reinforcement Learning Considering COLREGs", Proceedings of ICCAS(International Conference on Computer Applications in Shipbuilding) 2019, Rotterdam, Netherlands, pp. 85-88, 2019.09.24-26
Luman Zhao, Myung-Il Roh, Hye-Won Lee, Do-Hyun Chun, Sung-Jun Lee, "A Collision Avoidance Method of Multi-ships Based on Deep Reinforcement Learning Considering COLREGs," Proceedings of ICCAS 2019, Rotterdam, Netherlands, pp. 85-88, 2019.09.24-26
첨부 '1' |
---|
Abstract | Developing a high-level autonomous collision avoidance system for ships which can operate in an unstructured and unpredictable environment is a challenging task. Especially in the congested sea areas, each ship should continuously make decisions to avoid collisions with many other ships in the busy and complex waterway. Furthermore, recent reports indicate that a large number of collision accidents at sea are caused by or related to human decision failures with lack of situational awareness and failure to comply with International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose a robust and efficient method to collision avoidance problems of multi-ships based on the deep reinforcement learning (DRL) algorithm. The proposed method directly maps the states of encountered ships to an ownship’s steering commands in terms of the rudder angle using a deep neural network (DNN). This DNN is trained over multi-ships on rich encountering situations using the policy gradient based DRL algorithm. To handle multiple encountered ships, we classify them into four regions based on COLREGs, and only consider the nearest ship in each region. We validate the proposed method in a variety of simulated scenarios thorough performance evaluations. The result shows that the proposed method can find time efficient, collision-free paths for multi-ships. Also, it shows that the proposed method has excellent adaptability to unknown complex environments. |
---|---|
Publication Date | 2019-09-24 |
-
Ki-Su Kim, Myung-Il Roh, "Optimization of the Arrangement Design of a Ship Considering the Multiple Performance", Proceedings of ACSMO 2020, Seoul, Korea, pp. 167, 2020.11.23-25
-
Jisang Ha, Myung-Il Roh, Hye-Won Lee, Jong-Ho Eun, Jong-Jin Park, Hyun-Joe Kim, "A Method of the Collision Avoidance of a Ship Using Real-time AIS Data", Proceedings of ACSMO 2020, Seoul, Korea, pp. 106, 2020.11.23-25
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Method for the Accurate and Automatic Operation of Offshore Floating Cranes for the Block Erection in Shipyards", Proceedings of OMAE 2020, Held in Virtual Conference, 2020.08.03-07
-
Jisang Ha, Myung-Il Roh, Jong-Hyeok Lee, Jin-Hyeok Kim, Min-Chul Kong, Seung-Ho Ham, "Integrated Ship Remote Operating System Based on Digital Twin Technology", Proceedings of TEAM 2019, Tainan, Taiwan, pp. 106, 2019.10.14-17
-
Luman Zhao, Myung-Il Roh, Hye-Won Lee, Do-Hyun Chun, Sung-Jun Lee, "A Collision Avoidance Method of Multi-ships Based on Deep Reinforcement Learning Considering COLREGs," Proceedings of ICCAS 2019, Rotterdam, Netherlands, pp. 85-88, 2019.09.24-26
-
Sung-Jun Lee, Myung-Il Roh, Min-Jae Oh, Youngsoo Seok, Won-Jae Lee, June-Beom Lee, Hyun Soo Kim, "Image-based Object Detection and Tracking Method for Ship Navigation," Proceedings of ICCAS 2019, Rotterdam, Netherlands, pp. 89-92, 2019.09.24-26
-
Ki-Su Kim, Myung-Il Roh, "Optimal Arrangement Method of a Ship Considering the Performance against Flooding", Proceedings of PRADS 2019, Yokohama, Japan, 2019.09.22-26
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Do-Hyun Chun, "Controller Design of a Gantry Crane for the Safe Erection of Blocks in Shipyards", Proceedings of PRADS 2019, Yokohama, Japan, 2019.09.22-26
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Control of the Underactuated Gantry Crane for the Block Erection Operation in the Shipyard", MIM 2019, Berlin, Germany, 2019.08.28-30
-
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "A Crane Movement Control for Stability of Block Erection Based on Deep Reinforcement Learning", MIM 2019, Berlin, Germany, 2019.08.28-30