Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Donghun Yu, “Deep Reinforcement Learning-based Collision Avoidance for an Autonomous Ship”, Ocean Engineering, Vol. 234, pp. 1-20, 2021.08.15
https://doi.org/10.1016/j.oceaneng.2021.109216
International Journal
2021.05.22 19:25
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Donghun Yu, “Deep Reinforcement Learning-based Collision Avoidance for an Autonomous Ship”, Ocean Engineering, Vol. 234, pp. 1-20, 2021.08.15
조회 수 912
| 첨부 '1' |
|---|
| Abstract | Social interest in autonomous navigation systems for autonomous ships is also increasing. For a robust autonomous navigation system, the location, speed, and direction of the ship and other ships must be identified in real time, and collision avoidance should be performed at an appropriate time by considering the collision risk. In this study, we proposed a collision avoidance method that quantitatively assesses the collision risk and then generates an avoidance path. First, to assess the collision risk, a collision risk assessment method based on the ship domain and the closest point of approach (CPA) was proposed. The ship domain is created with an asymmetric shape considering manoeuvring performance and the COLREGs. The CPA is used to assess quantitative collision risk value. Subsequently, a path generation algorithm based on deep reinforcement learning (DRL) was proposed to determine the avoidance time and to generate an avoidance path complying the COLREGs for the most dangerous ship in terms of collision risk. The information of own ship and target ship such as location, speed, heading, collision risk is used as the input state, and the rudder angle of own ship is set as the output action of the DRL. The cost function related to the path following and the collision avoidance is defined as the reward of the DRL-based collision avoidance method. Additionally, the DRL modes are defined to navigate the flexible avoidance path by changing the ratio between the path following and the collision avoidance. To verify the proposed method, we compared the collision avoidance method with the A* algorithm, which is a traditional path planning algorithm, and analyzed the results for various scenarios. The proposed method reliably avoided collisions through flexible paths for complex and unexpected changes in situations compared to the A* algorithm. |
|---|---|
| Publication Date | 2021-08-15 |
| Role | Corresponding Author |
| Category | SCI |
Prev June-Beom Lee, Myung-Il Roh, Ki-Su Kim, “Prediction of Ship P...
June-Beom Lee, Myung-Il Roh, Ki-Su Kim, “Prediction of Ship P...
2021.08.07by SyDLab
Hye-Won Lee, Myung-Il Roh, Ki-Su Kim, “Ship Route Planning in... Next
Hye-Won Lee, Myung-Il Roh, Ki-Su Kim, “Ship Route Planning in...
2021.06.06by SyDLab
-
Beom-Soo Kim, Min-Jae Oh, Jae-Hoon Lee, Yonghwan Kim, Myung-Il Roh, "Study on Hull Optimization Process Considering Operational Efficiency in Waves", Processes, Vol. 9, No. 5, pp. 898.1-21, 2021.05.19
-
남권우, 노명일, 이혜원, 이원재, "자율 운항 선박을 위한 딥 러닝 기반 선박 이미지 분류 방법", 한국CDE학회 논문집, Vol. 26, No. 2, pp. 144-153, 2021.06.01
-
Jisang Ha, Myung-Il Roh, Seung-Ho Ham, Sung-Jun Lee, “Optimum Design of the Underwater Discharge System Based on Surrogate Modeling”, Journal of Marine Science and Technology (Taiwan), Vol. 29, No. 3, pp. 338-353, 2021.06.01
-
Jisang Ha, Myung-Il Roh, Hye-Won Lee, “Quantitative Calculation Method of the Collision Risk for Collision Avoidance in Ship Navigation Using the CPA and Ship Domain”, Journal of Computational Design and Engineering, Vol. 8, No. 3, 2021.06.01
-
June-Beom Lee, Myung-Il Roh, Ki-Su Kim, “Prediction of Ship Power Based on Variation in Deep Feed-forward Neural Network”, International Journal of Naval Architecture and Ocean Engineering, 2021.08.07
-
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Donghun Yu, “Deep Reinforcement Learning-based Collision Avoidance for an Autonomous Ship”, Ocean Engineering, Vol. 234, pp. 1-20, 2021.08.15
-
Hye-Won Lee, Myung-Il Roh, Ki-Su Kim, “Ship Route Planning in Arctic Ocean Based on POLARIS”, Ocean Engineering, Vol. 234, pp. 109297.1-14, 2021.08.15
-
Hye-Won Lee, Joo-Hyun Woo, Myung-Il Roh, Seung-Ho Ham, et al., "Integrated Simulation of Virtual Prototypes and Control Algorithms of Unmanned Surface Vehicles Based on a Robot Operating System", Journal of Marine Science and Technology (Taiwan)
-
Won-Jae Lee, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Yeong-Min Cho, Nam-Sun Son, “Detection and Tracking for the Awareness of Surroundings of a Ship Based on Deep Learning”, Journal of Computational Design and Engineering, Vol. 8, No. 5
-
Ki-Su Kim, Myung-Il Roh, Seung-Min Lee, "Quasi-static Flooding Analysis Method of a Damaged Ship Considering Oil Spill and Cargo Load", Journal of Ship Production and Design, 2022.02.10
-
Min-Chul Kong, Myung-Il Roh, Ki-Su Kim, Jeongyoul Lee, Jongoh Kim, Gapheon Lee, "Object Detection Method for Ship Safety Plans Using Deep Learning", Ocean Engineering, 2022.02.15
-
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, "Automation of Crane Control for Block Lifting Based on Deep Reinforcement Learning", Journal of Computational Design and Engineering, Vol. 9, No. 4, pp. 1430- 1448, 2022.07.23
-
Jin-Hyeok Kim, Myung-Il Roh et al., "Prediction of the Superiority of the Hydrodynamic Performance of Hull Forms Using Deep Learning", International Journal of Naval Architecture and Ocean Engineering, Vol. 49, pp. 100490.1-15, pp. 2022.11.01
-
Min-Chul Kong, Myung-Il Roh, Ki-Su Kim, Ho-Gyun Park, Jong-Oh Kim, "Variable Indexing Method in Rule Documents for Ship Design Using Extraction of PDF Elements", Journal of Computational Design and Engineering, Vol. 9, No. 6, 2022.11.16
-
In-Chang Yeo, Myung-Il Roh, Do-Hyun Chun, Seok Ho Jang, Jae Won Heo, "Optimal Arrangement Design of Pipeline Support by Considering Safety and Production Cost", International Journal of Naval Architecture and Ocean Engineering, 2023.05.10
-
Jisang Ha, Myung-Il Roh, Ki-Su Kim, Jin-Hyeok Kim, "Method for Pipe Routing Using the Expert System and the Heuristic Pathfinding Algorithm in Shipbuilding", International Journal of Naval Architecture and Ocean Engineering, 2023.05.26
-
Hye-Won Lee, Myung-Il Roh, Yeong-Min Cho, Jeong-Ho Park, "Data Association for Autonomous Ships Based on the Virtual Simulation Environment", Ocean Engineering, Vol. 281, pp. 114646.1-17, 2023.08.01
-
천휘경, 박찬혁, 지석호, 노명일, Connie Susilawati, “다중 카메라 네트워크 가상의 관심선을 활용한 건물 내 재실자 인원 계수 방법론 개발”, 대한토목학회 논문집, Vol. 43, No. 5, pp. 667-674, 2023.10.01
-
Do-Hyun Chun, Myung-Il Roh, In-Chang Yeo, Hye-Won Lee, “Proposed Method for Design Optimization of LNG Tanks Based on the Arrangement of Thermal Insulation Panels”, Ocean Engineering, Vol. 288, Part 2, pp. 116063.1-14, 2023.11.15
-
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Donghun Yu, "Method for Collision Avoidance Based on Deep Reinforcement Learning with Path-Speed Control for an Autonomous Ship", IJNAOE, Vol. 16, pp. 100579.1-19, 2023.12.22
