Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01
International Journal
2019.09.16 10:40
Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01
조회 수 248
첨부 '1' |
---|
Abstract | Developing a high-level autonomous collision avoidance system for ships that can operate in an unstructured and unpredictable environment is challenging. Particularly in congested sea areas, each ship should make decisions continuously to avoid collisions with other ships in a busy and complex waterway. Furthermore, recent reports indicate that a large number of marine collision accidents are caused by or are related to human decision failures concerning a lack of situational awareness and failure to comply with the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose an efficient method to overcome multiship collision avoidance problems based on the Deep Reinforcement Learning (DRL) algorithm by expanding our previous study (Zhao et al., 2019). The proposed method directly maps the states of encountered ships to an ownship's steering commands in terms of rudder angle using the Deep Neural Network (DNN). This DNN is trained over multiple ships in rich encountering situations using the policy-gradient based DRL algorithm. To address multiple encountered ships, we classify them into four regions based on COLREGs, and consider only the nearest ship in each region. We validate the proposed collision avoidance method in a variety of simulated scenarios with thorough performance evaluations, and demonstrate that the final DRL controller can obtain time efficient and collision-free paths for multiple ships. Simulation results indicate that multiple ships can avoid collisions with each other while following their own predefined paths simultaneously. In addition, the proposed approach demonstrates its excellent adaptability to unknown complex environments with various encountered ships. |
---|---|
Publication Date | 2019-11-01 |
Role | Corresponding Author |
Category | SCI |
Impact Factor | 1.894 |
Prev Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, "Collision Detection and Response of Multibody Systems Using a Position Difference Method and Non-Interpenetration Constraint in Shipbuilding Simulation", Ocean Engineering, Vol. 195, pp. 1-18, 2020.01.01
Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, "Collision Detection and Response of Multibody Systems Using a Position Difference Method and Non-Interpenetration Constraint in Shipbuilding Simulation", Ocean Engineering, Vol. 195, pp. 1-18, 2020.01.01
2019.11.03by SyDLab
오민재, 노명일, 김범수, 김용환, “선박 내항성능 해석을 위한 선... Next
오민재, 노명일, 김범수, 김용환, “선박 내항성능 해석을 위한 선...
2019.05.28by
-
Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01
CategoryInternational Journal -
오민재, 노명일, 김범수, 김용환, “선박 내항성능 해석을 위한 선형 곡면으로부터의 오프셋 생성 프로그램 개발”, 한국CDE학회 논문집, Vol. 24, No. 2, pp. 1-10, 2019.06.01
CategoryDomestic Journal -
조영인, 오민재, 석영수, 이성준, 노명일, “딥러닝을 이용한 선형 설계 초기 단계에서의 저항 추정”, 한국CDE학회 논문집, Vol. 24, No. 2, pp. 1-8, 2019.06.01
CategoryDomestic Journal -
Luman Zhao, Myung-Il Roh, Sung-Jun Lee, "Control Method for Path Following and Collision Avoidance of Autonomous Ships Based on Deep Reinforcement Learning", Journal of Marine Science and Technology (Taiwan), Vol. 27, No. 4, pp. 293-310, 2019.08.01
CategoryInternational Journal -
Xing Li, Myung-Il Roh, Seung-Ho Ham, "A Collaborative Simulation in Shipbuilding and the Offshore Installation Based on the Integration of the Dynamic Analysis, Virtual Reality, and Control Devices", IJNAOE, Vol. 11, No. 2, pp. 699-722, 2019.07.01
CategoryInternational Journal -
Min-Jae Oh, Myung-Il Roh, Sung-Woo Park, Do-Hyun Chun, Se-Hyun Myung, "Big Data-based Piping Material Analysis Framework in Offshore Structure for Contract Design", Ocean Systems Engineering, Vol. 9, No. 1, pp. 79-95, 2019.01.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, "Dynamic Analysis of Block Offloading Using Self-propelled Modular Transporters", Automation in Construction, Vol. 96, pp. 411-432, 2018.12.01
CategoryInternational Journal -
Min-Jae Oh, Taw-Wan Kim, Myung-Il Roh, "G1 Bezier Surface Interpolation with T-junctions at a 3-Valent Singular Vertex", Computer Aided Geometric Design, Vol. 67, pp. 79-95, 2018.12.01
CategoryInternational Journal -
Luman Zhao, Myung-Il Roh, Seung-Ho Ham, "Performance Analysis of an Active Heave Compensation System on an Offshore Supply Vessel Using the Hardware-In-The-Loop Simulation", Journal of Marine Science and Technology (Taiwan), Vol. 26, No. 5
CategoryInternational Journal -
Hye-Won Lee, Myung-Il Roh, "Review of the Multibody Dynamics in the Applications of Ships and Offshore Structures", Ocean Engineering, Vol. 167, pp. 65-76, 2018.11.01
CategoryInternational Journal -
Hyun-Cheol Kim, Myung-Il Roh, Soon-Hung Han, "Passenger Evacuation Simulation of MV SEWOL Considering the Heeling Angle Change During Sinking", International Journal of Naval Architecture and Ocean Engineering, Vol. 11, No. 1, pp. 329-343, 2019.01.01
CategoryInternational Journal -
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Nam-Kug Ku, "Coupled Analysis Method of a Mooring System and a Floating Crane Based on Flexible Multibody Dynamics Considering Contact with the Seabed", Ocean Engineering, Vol. 163, pp. 555-569, 2018.09.01
CategoryInternational Journal -
Sung-Woo Park, Myung-Il Roh, Min-Jae Oh, Seong-Hoon Kim, "Association Analysis of Piping Materials of an Offshore Structure Using Big Data Technology", Journal of Ship Production and Design, Vol. 35, No. 3, pp. 220-230, 2019.08.01
CategoryInternational Journal -
전도현, 노명일, 함승호, 이혜원, “블록의 탑재 안전성을 위한 초기 평형 자세 탐색 방법 연구”, 대한조선학회 논문집, Vol. 55, No. 4, pp. 297-305, 2018.08.01
CategoryDomestic Journal -
Min-Jae Oh, Myung-Il Roh, Tae-Wan Kim, "Local T-spline Surface Skinning with Shape Preservation", Computer-Aided Design, Vol. 104, pp. 15-26, 2018.11.01
CategoryInternational Journal -
Sung-Min Lee, Myung-Il Roh, Ki-Su Kim, Hoe-Ryong Jung, Jong-Jin Park, "Method for a Simultaneous Determination of the Path and the Speed for Ship Route Planning Problems", Ocean Engineering, Vol. 157, pp. 301-312, 2018.06.01
CategoryInternational Journal -
오민재, 노명일, 박성우, 김성훈, “빅데이터 분석을 이용한 해양 구조물 배관 자재의 소요량 예측”, 대한조선학회 논문집, Vol. 55, No. 3, pp. 243-251, 2018.06.01
CategoryDomestic Journal -
Sun-Kyung Jung, Myung-Il Roh, Ki-Su Kim, "Arrangement Method of a Naval Surface Ship Considering Stability, Operability, and Survivability", Ocean Engineering, Vol. 152, pp. 316-333, 2018.02.23
CategoryInternational Journal -
명세현, 노명일, 최형순, “조선 PLM을 위한 핵심 평가 지표 수립 방법론”, 한국CDE학회 논문집, Vol. 23, No. 1, pp. 60-67, 2018.03.01
CategoryDomestic Journal -
Seung-Ho Ham, Myung-Il Roh, Luman Zhao, "Integrated Method of Analysis, Visualization, and Hardware for Ship Motion Simulation", Journal of Computational Design and Engineering, Vol. 5, No. 3, pp. 285-298, 2018.07.01
CategoryInternational Journal