Luman Zhao, Myung-Il Roh, Hye-Won Lee, Do-Hyun Chun, Sung-Jun Lee, "A Collision Avoidance Method of Multi-ships Based on Deep Reinforcement Learning Considering COLREGs", Proceedings of ICCAS(International Conference on Computer Applications in Shipbuilding) 2019, Rotterdam, Netherlands, pp. 85-88, 2019.09.24-26
International Conference
2019.08.06 15:07
Luman Zhao, Myung-Il Roh, Hye-Won Lee, Do-Hyun Chun, Sung-Jun Lee, "A Collision Avoidance Method of Multi-ships Based on Deep Reinforcement Learning Considering COLREGs," Proceedings of ICCAS 2019, Rotterdam, Netherlands, pp. 85-88, 2019.09.24-26
조회 수 272
| 첨부 '1' |
|---|
| Abstract | Developing a high-level autonomous collision avoidance system for ships which can operate in an unstructured and unpredictable environment is a challenging task. Especially in the congested sea areas, each ship should continuously make decisions to avoid collisions with many other ships in the busy and complex waterway. Furthermore, recent reports indicate that a large number of collision accidents at sea are caused by or related to human decision failures with lack of situational awareness and failure to comply with International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose a robust and efficient method to collision avoidance problems of multi-ships based on the deep reinforcement learning (DRL) algorithm. The proposed method directly maps the states of encountered ships to an ownship’s steering commands in terms of the rudder angle using a deep neural network (DNN). This DNN is trained over multi-ships on rich encountering situations using the policy gradient based DRL algorithm. To handle multiple encountered ships, we classify them into four regions based on COLREGs, and only consider the nearest ship in each region. We validate the proposed method in a variety of simulated scenarios thorough performance evaluations. The result shows that the proposed method can find time efficient, collision-free paths for multi-ships. Also, it shows that the proposed method has excellent adaptability to unknown complex environments. |
|---|---|
| Publication Date | 2019-09-24 |
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Do-Hyun Chun, "Controller Design of a Gantry Crane for the Safe Erection of Blocks in Shipyards", Proceedings of PRADS 2019, Yokohama, Japan, 2019.09.22-26
-
Luman Zhao, Myung-Il Roh, Hye-Won Lee, Do-Hyun Chun, Sung-Jun Lee, "A Collision Avoidance Method of Multi-ships Based on Deep Reinforcement Learning Considering COLREGs," Proceedings of ICCAS 2019, Rotterdam, Netherlands, pp. 85-88, 2019.09.24-26
-
Sung-Jun Lee, Myung-Il Roh, Min-Jae Oh, Youngsoo Seok, Won-Jae Lee, June-Beom Lee, Hyun Soo Kim, "Image-based Object Detection and Tracking Method for Ship Navigation," Proceedings of ICCAS 2019, Rotterdam, Netherlands, pp. 89-92, 2019.09.24-26
-
Jisang Ha, Myung-Il Roh, Jong-Hyeok Lee, Jin-Hyeok Kim, Min-Chul Kong, Seung-Ho Ham, "Integrated Ship Remote Operating System Based on Digital Twin Technology", Proceedings of TEAM 2019, Tainan, Taiwan, pp. 106, 2019.10.14-17
-
이원재, 노명일, 이성준, 하지상, 석영수, 오민재, "선박 운항 시 주변 인지를 위한 물체 탐지, 추적 및 거리 추정 방법", 2019년도 대한조선학회 추계학술발표회, 경주, pp. 431, 2019.10.24-26
-
김진혁, 노명일, 공민철, "증강 현실 기술을 이용한 장비의 원격 운영 및 유지 보수 방법", 2019년도 대한조선학회 추계학술발표회, 경주, pp. 196, 2019.10.24-26
-
오민재, 노명일, 김범수, 김용환, "선박의 운항 효율을 고려한 선형 변환 방법", 2019년도 대한조선학회 추계학술발표회, 경주, pp. 480, 2019.10.24-2019.10.25
-
전도현, 노명일, 이혜원, 하지상, 진은석, 김인일, "딥 러닝 기반 자율 운항 선박의 충돌 회피 방법 연구", 2019년도 대한조선학회 추계학술발표회, 경주, pp. 429, 2019.10.24-26
-
이혜원, 노명일, 함승호, 전도현 "블록의 탑재 제어를 위한 갠트리 크레인의 제어기 설계 고도화", 2019년도 대한조선학회 추계학술발표회, 경주, pp. 139, 2019.10.24-26
-
하지상, 노명일, 이혜원, 은종호, 박종진, "실시간 AIS 데이터를 이용한 해상 충돌 회피 알고리즘 연구", 2019년도 대한조선학회 추계학술발표회, 경주, pp. 430, 2019.10.24-26
