Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01
Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01
첨부 '1' |
---|
Abstract | Developing a high-level autonomous collision avoidance system for ships that can operate in an unstructured and unpredictable environment is challenging. Particularly in congested sea areas, each ship should make decisions continuously to avoid collisions with other ships in a busy and complex waterway. Furthermore, recent reports indicate that a large number of marine collision accidents are caused by or are related to human decision failures concerning a lack of situational awareness and failure to comply with the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose an efficient method to overcome multiship collision avoidance problems based on the Deep Reinforcement Learning (DRL) algorithm by expanding our previous study (Zhao et al., 2019). The proposed method directly maps the states of encountered ships to an ownship's steering commands in terms of rudder angle using the Deep Neural Network (DNN). This DNN is trained over multiple ships in rich encountering situations using the policy-gradient based DRL algorithm. To address multiple encountered ships, we classify them into four regions based on COLREGs, and consider only the nearest ship in each region. We validate the proposed collision avoidance method in a variety of simulated scenarios with thorough performance evaluations, and demonstrate that the final DRL controller can obtain time efficient and collision-free paths for multiple ships. Simulation results indicate that multiple ships can avoid collisions with each other while following their own predefined paths simultaneously. In addition, the proposed approach demonstrates its excellent adaptability to unknown complex environments with various encountered ships. |
---|---|
Publication Date | 2019-11-01 |
Role | Corresponding Author |
Category | SCI |
Impact Factor | 1.894 |
-
Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01
-
오민재, 노명일, 김범수, 김용환, “선박 내항성능 해석을 위한 선형 곡면으로부터의 오프셋 생성 프로그램 개발”, 한국CDE학회 논문집, Vol. 24, No. 2, pp. 1-10, 2019.06.01
-
조영인, 오민재, 석영수, 이성준, 노명일, “딥러닝을 이용한 선형 설계 초기 단계에서의 저항 추정”, 한국CDE학회 논문집, Vol. 24, No. 2, pp. 1-8, 2019.06.01
-
Luman Zhao, Myung-Il Roh, Sung-Jun Lee, "Control Method for Path Following and Collision Avoidance of Autonomous Ships Based on Deep Reinforcement Learning", Journal of Marine Science and Technology (Taiwan), Vol. 27, No. 4, pp. 293-310, 2019.08.01
-
Xing Li, Myung-Il Roh, Seung-Ho Ham, "A Collaborative Simulation in Shipbuilding and the Offshore Installation Based on the Integration of the Dynamic Analysis, Virtual Reality, and Control Devices", IJNAOE, Vol. 11, No. 2, pp. 699-722, 2019.07.01
-
Min-Jae Oh, Myung-Il Roh, Sung-Woo Park, Do-Hyun Chun, Se-Hyun Myung, "Big Data-based Piping Material Analysis Framework in Offshore Structure for Contract Design", Ocean Systems Engineering, Vol. 9, No. 1, pp. 79-95, 2019.01.01
-
Seung-Ho Ham, Myung-Il Roh, "Dynamic Analysis of Block Offloading Using Self-propelled Modular Transporters", Automation in Construction, Vol. 96, pp. 411-432, 2018.12.01
-
Min-Jae Oh, Taw-Wan Kim, Myung-Il Roh, "G1 Bezier Surface Interpolation with T-junctions at a 3-Valent Singular Vertex", Computer Aided Geometric Design, Vol. 67, pp. 79-95, 2018.12.01
-
Luman Zhao, Myung-Il Roh, Seung-Ho Ham, "Performance Analysis of an Active Heave Compensation System on an Offshore Supply Vessel Using the Hardware-In-The-Loop Simulation", Journal of Marine Science and Technology (Taiwan), Vol. 26, No. 5
-
Hye-Won Lee, Myung-Il Roh, "Review of the Multibody Dynamics in the Applications of Ships and Offshore Structures", Ocean Engineering, Vol. 167, pp. 65-76, 2018.11.01
-
Hyun-Cheol Kim, Myung-Il Roh, Soon-Hung Han, "Passenger Evacuation Simulation of MV SEWOL Considering the Heeling Angle Change During Sinking", International Journal of Naval Architecture and Ocean Engineering, Vol. 11, No. 1, pp. 329-343, 2019.01.01
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Nam-Kug Ku, "Coupled Analysis Method of a Mooring System and a Floating Crane Based on Flexible Multibody Dynamics Considering Contact with the Seabed", Ocean Engineering, Vol. 163, pp. 555-569, 2018.09.01
-
Sung-Woo Park, Myung-Il Roh, Min-Jae Oh, Seong-Hoon Kim, "Association Analysis of Piping Materials of an Offshore Structure Using Big Data Technology", Journal of Ship Production and Design, Vol. 35, No. 3, pp. 220-230, 2019.08.01
-
전도현, 노명일, 함승호, 이혜원, “블록의 탑재 안전성을 위한 초기 평형 자세 탐색 방법 연구”, 대한조선학회 논문집, Vol. 55, No. 4, pp. 297-305, 2018.08.01
-
Min-Jae Oh, Myung-Il Roh, Tae-Wan Kim, "Local T-spline Surface Skinning with Shape Preservation", Computer-Aided Design, Vol. 104, pp. 15-26, 2018.11.01
-
Sung-Min Lee, Myung-Il Roh, Ki-Su Kim, Hoe-Ryong Jung, Jong-Jin Park, "Method for a Simultaneous Determination of the Path and the Speed for Ship Route Planning Problems", Ocean Engineering, Vol. 157, pp. 301-312, 2018.06.01
-
오민재, 노명일, 박성우, 김성훈, “빅데이터 분석을 이용한 해양 구조물 배관 자재의 소요량 예측”, 대한조선학회 논문집, Vol. 55, No. 3, pp. 243-251, 2018.06.01
-
Sun-Kyung Jung, Myung-Il Roh, Ki-Su Kim, "Arrangement Method of a Naval Surface Ship Considering Stability, Operability, and Survivability", Ocean Engineering, Vol. 152, pp. 316-333, 2018.02.23
-
명세현, 노명일, 최형순, “조선 PLM을 위한 핵심 평가 지표 수립 방법론”, 한국CDE학회 논문집, Vol. 23, No. 1, pp. 60-67, 2018.03.01
-
Seung-Ho Ham, Myung-Il Roh, Luman Zhao, "Integrated Method of Analysis, Visualization, and Hardware for Ship Motion Simulation", Journal of Computational Design and Engineering, Vol. 5, No. 3, pp. 285-298, 2018.07.01