Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01
Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01
첨부 '1' |
---|
Abstract | Developing a high-level autonomous collision avoidance system for ships that can operate in an unstructured and unpredictable environment is challenging. Particularly in congested sea areas, each ship should make decisions continuously to avoid collisions with other ships in a busy and complex waterway. Furthermore, recent reports indicate that a large number of marine collision accidents are caused by or are related to human decision failures concerning a lack of situational awareness and failure to comply with the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose an efficient method to overcome multiship collision avoidance problems based on the Deep Reinforcement Learning (DRL) algorithm by expanding our previous study (Zhao et al., 2019). The proposed method directly maps the states of encountered ships to an ownship's steering commands in terms of rudder angle using the Deep Neural Network (DNN). This DNN is trained over multiple ships in rich encountering situations using the policy-gradient based DRL algorithm. To address multiple encountered ships, we classify them into four regions based on COLREGs, and consider only the nearest ship in each region. We validate the proposed collision avoidance method in a variety of simulated scenarios with thorough performance evaluations, and demonstrate that the final DRL controller can obtain time efficient and collision-free paths for multiple ships. Simulation results indicate that multiple ships can avoid collisions with each other while following their own predefined paths simultaneously. In addition, the proposed approach demonstrates its excellent adaptability to unknown complex environments with various encountered ships. |
---|---|
Publication Date | 2019-11-01 |
Role | Corresponding Author |
Category | SCI |
Impact Factor | 1.894 |
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Underactuated Crane Control for the Automation of Block Erection in Shipbuilding", Automation in Construction, Vol. 124, pp. 1-28, 2021.04.01
-
Hye-Won Lee, Joo-Hyun Woo, Myung-Il Roh, Seung-Ho Ham, et al., "Integrated Simulation of Virtual Prototypes and Control Algorithms of Unmanned Surface Vehicles Based on a Robot Operating System", Journal of Marine Science and Technology (Taiwan)
-
Jisang Ha, Myung-Il Roh, Seung-Ho Ham, Sung-Jun Lee, “Optimum Design of the Underwater Discharge System Based on Surrogate Modeling”, Journal of Marine Science and Technology (Taiwan), Vol. 29, No. 3, pp. 338-353, 2021.06.01
-
Ki-Su Kim, June-Beom Lee, Myung-Il Roh, Ki-Min Han, Gap-Heon Lee, "Prediction of Ocean Weather Based on Denoising AutoEncoder and Convolutional LSTM", Journal of Marine Science and Engineering, Vol. 8, No. 10, pp. 805:1-24, 2020.10.14
-
Ki-Su Kim, Myung-Il Roh, “ISO 15016:2015-based Method for Estimating the Fuel Oil Consumption of a Ship”, Journal of Marine Science and Engineering, Vol. 8, No. 10, pp. 791:1-18, 2020.10.12
-
Sung-Jun Lee, Myung-Il Roh, Min-Jae Oh, "Image-based Ship Detection Using Deep Learning", Ocean Systems Engineering, Vol. 10, No. 4, pp. 415-434, 2020.12.01
-
Ki-Su Kim, Myung-Il Roh, "Dynamic Flooding Analysis Method for Intermediate Flooding Process of a Ship", Ocean Engineering, Vol. 218, pp. 108173.1-33, 2020.12.15
-
Seung-Ho Ham, Myung-Il Roh, “Time-domain Structural Analysis During Block Turnover and Lifting Using 2D Flexible Multibody Dynamics”, Marine Structures, Vol. 75, pp. 102841.1-26, 2021.01.01
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Block Erection Simulation Considering Frictional Contact with Wire Ropes", Ocean Engineering, Vol. 217, pp. 1-24, 2020.12.01
-
Do-Hyun Chun, Myung-Il Roh, Seung-Ho Ham, “Optimum Arrangement Design of Mastic Ropes for Membrane-type LNG Tanks Considering the Flatness of Thermal Insulation Panel and Production Cost”, Journal of Marine Science and Engineering, Vol. 8, No. 5
-
Seong-Hoon Kim, Myung-Il Roh, Min-Jae Oh, Sung-Woo Park, "Estimation of Ship Operational Efficiency from AIS Data Using Big Data Technology", IJNAOE, Vol. 12, pp. 440-453, 2020.05.21
-
Sang-Hyun Lee, Myung-Il Roh, Min-Jae Oh, Ki-Su Kim, "Optimal Layout Design of an LNG FPSO: A Case Study", Journal of Offshore Mechanics and Arctic Engineering, Vol. 142, No. 041403, pp. 1-17, 2020.08.01
-
Joo-Pil Lee, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "Design of a Wreck Removal Method Considering Safety and Economy", Ships and Offshore Structures, Vol. 15, No. 10, pp. 1037-1056, 2020.12.01
-
Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, "Collision Detection and Response of Multibody Systems Using a Position Difference Method and Non-Interpenetration Constraint in Shipbuilding Simulation", Ocean Engineering, Vol. 195, pp. 1-18, 2020.01.01
-
Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01
-
Luman Zhao, Myung-Il Roh, Sung-Jun Lee, "Control Method for Path Following and Collision Avoidance of Autonomous Ships Based on Deep Reinforcement Learning", Journal of Marine Science and Technology (Taiwan), Vol. 27, No. 4, pp. 293-310, 2019.08.01
-
Xing Li, Myung-Il Roh, Seung-Ho Ham, "A Collaborative Simulation in Shipbuilding and the Offshore Installation Based on the Integration of the Dynamic Analysis, Virtual Reality, and Control Devices", IJNAOE, Vol. 11, No. 2, pp. 699-722, 2019.07.01
-
Min-Jae Oh, Myung-Il Roh, Sung-Woo Park, Do-Hyun Chun, Se-Hyun Myung, "Big Data-based Piping Material Analysis Framework in Offshore Structure for Contract Design", Ocean Systems Engineering, Vol. 9, No. 1, pp. 79-95, 2019.01.01
-
Seung-Ho Ham, Myung-Il Roh, "Dynamic Analysis of Block Offloading Using Self-propelled Modular Transporters", Automation in Construction, Vol. 96, pp. 411-432, 2018.12.01
-
Min-Jae Oh, Taw-Wan Kim, Myung-Il Roh, "G1 Bezier Surface Interpolation with T-junctions at a 3-Valent Singular Vertex", Computer Aided Geometric Design, Vol. 67, pp. 79-95, 2018.12.01