Skip to content
Extra Form
Abstract Developing a high-level autonomous collision avoidance system for ships that can operate in an unstructured and unpredictable environment is challenging. Particularly in congested sea areas, each ship should make decisions continuously to avoid collisions with other ships in a busy and complex waterway. Furthermore, recent reports indicate that a large number of marine collision accidents are caused by or are related to human decision failures concerning a lack of situational awareness and failure to comply with the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose an efficient method to overcome multiship collision avoidance problems based on the Deep Reinforcement Learning (DRL) algorithm by expanding our previous study (Zhao et al., 2019). The proposed method directly maps the states of encountered ships to an ownship's steering commands in terms of rudder angle using the Deep Neural Network (DNN). This DNN is trained over multiple ships in rich encountering situations using the policy-gradient based DRL algorithm. To address multiple encountered ships, we classify them into four regions based on COLREGs, and consider only the nearest ship in each region. We validate the proposed collision avoidance method in a variety of simulated scenarios with thorough performance evaluations, and demonstrate that the final DRL controller can obtain time efficient and collision-free paths for multiple ships. Simulation results indicate that multiple ships can avoid collisions with each other while following their own predefined paths simultaneously. In addition, the proposed approach demonstrates its excellent adaptability to unknown complex environments with various encountered ships.
Publication Date 2019-11-01
Role Corresponding Author
Category SCI
Impact Factor 1.894

  1. No Image 18Apr
    by
    in International Journal

    Ki-Su Kim, Myung-Il Roh, "A Submarine Arrangement Design Program Based on the Expert System and the Multistage Optimization", Advances In Engineering Software, Vol. 98, No. 97-111, 2016.08.01

  2. No Image 28Sep
    by
    in International Journal

    Ki-Su Kim, Myung-Il Roh, "Dynamic Flooding Analysis Method for Intermediate Flooding Process of a Ship", Ocean Engineering, Vol. 218, pp. 108173.1-33, 2020.12.15

  3. No Image 10Dec
    by
    in International Journal

    Ki-Su Kim, Myung-Il Roh, Seung-Min Lee, "Quasi-static Flooding Analysis Method of a Damaged Ship Considering Oil Spill and Cargo Load", Journal of Ship Production and Design, 2022.02.10

  4. No Image 13Jul
    by
    in International Journal

    Ki-Su Kim, Myung-Il Roh, Sol Ha, "Expert System Based on the Arrangement Evaluation Model for the Arrangement Design of a Submarine", Expert Systems with Applications, Vol. 42, No. 22, pp. 8731-8744, 2015.12.01

  5. No Image 12Aug
    by
    in International Journal

    Ki-Su Kim, Myung-Il Roh, Sung-Min Lee, Han-Sung Kim, Hyunsik Ahn, "Weight-estimation Method of FPSO Topsides Considering the Work Breakdown Structure", Journal of Offshore Mechanics and Arctic Engineering, Vol. 40, No. 1, pp. 1-10, 2018.02.01

  6. No Image 10Oct
    by
    in International Journal

    Ki-Su Kim, Myung-Il Roh, “ISO 15016:2015-based Method for Estimating the Fuel Oil Consumption of a Ship”, Journal of Marine Science and Engineering, Vol. 8, No. 10, pp. 791:1-18, 2020.10.12

  7. No Image 02Dec
    by
    in International Journal

    Kyu-Yeul Lee, Myung-Il Roh, "A Hybrid Optimization Method for Multidisciplinary Ship Design", Journal of Ship Technology Research, Vol. 47, No. 4, pp. 181-185, 2000.10.01

  8. No Image 02Dec
    by
    in International Journal

    Kyu-Yeul Lee, Myung-Il Roh, "An Efficient Genetic Algorithm Using Gradient Information for Ship Structural Design Optimization", Journal of Ship Technology Research, Vol. 48, No. 4, pp. 161-170, 2001.11.01

  9. No Image 02Dec
    by
    in International Journal

    Kyu-Yeul Lee, Myung-Il Roh, Hyuk-Su Jeong, "An Improved Genetic Algorithm for Multi-Floor Facility Layout Problems Having Inner Structure Walls and Passages", Computers & Operations Research, Vol. 32, No. 4, pp. 879-899, 2005.04.01

  10. No Image 02Dec
    by
    in International Journal

    Kyu-Yeul Lee, Myung-Il Roh, Seonho Cho, "Multidisciplinary Design Optimization of Mechanical Systems Using Collaborative Optimization Approach", International Journal of Vehicle Design, Vol. 25, No. 4, pp. 353-368, 2001.11.01

  11. No Image 02Dec
    by
    in International Journal

    Kyu-Yeul Lee, Seong-Nam Han, Myung-Il Roh, "An Improved Genetic Algorithm for Facility Layout Problems Having Inner Structure Walls and Passages", Computers & Operations Research, Vol. 30, No. 1, pp. 117-138, 2003.01.01

  12. No Image 02Dec
    by
    in International Journal

    Kyu-Yeul Lee, Seong-Nam Han, Myung-Il Roh, "Optimal Compartment Layout Design for a Naval Ship Using an Improved Genetic Algorithm", Marine Technology and SNAME News, Vol. 39, No. 3, pp. 159-169, 2002.07.01

  13. No Image 02Dec
    by
    in International Journal

    Kyu-Yeul Lee, Seonho Cho, Myung-Il Roh, "An Efficient Global-Local Hybrid Optimization Method Using Design Sensitivity Analysis", International Journal of Vehicle Design, Vol. 28, No. 4, pp. 300-317, 2002.07.01

  14. No Image 02Dec
    by
    in International Journal

    Kyu-Yeul Lee, Won-Joon Lee, Myung-Il Roh, "Development of a Semantic Product Modeling System for Initial Hull Structure in Shipbuilding", Robotics and Computer-Integrated Manufacturing Journal, Vol. 20, No. 3, pp. 211-223, 2004.06.01

  15. No Image 16Sep
    by SyDLab
    in International Journal

    Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01

  16. No Image 22Jun
    by
    in International Journal

    Luman Zhao, Myung-Il Roh, Jeong-Woo Hong, "Optimal Thrust Allocation for Dynamic Positioning of Deep-sea Working Vessel", Journal of Advanced Research in Ocean Engineering, Vol. 1, No. 2, pp. 94-105, 2015.06.01

  17. No Image 16Dec
    by
    in International Journal

    Luman Zhao, Myung-Il Roh, Seung-Ho Ham, "Anti-Sway Control of the Crane on an Offshore Support Vessel Based on the Hardware-In-The-Loop Simulation", International Journal of Offshore and Polar Engineering, Vol. 28, No. 2, pp. 182-189, 2018.06.01

  18. No Image 16Aug
    by
    in International Journal

    Luman Zhao, Myung-Il Roh, Seung-Ho Ham, "Performance Analysis of an Active Heave Compensation System on an Offshore Supply Vessel Using the Hardware-In-The-Loop Simulation", Journal of Marine Science and Technology (Taiwan), Vol. 26, No. 5

  19. No Image 20May
    by
    in International Journal

    Luman Zhao, Myung-Il Roh, Sung-Jun Lee, "Control Method for Path Following and Collision Avoidance of Autonomous Ships Based on Deep Reinforcement Learning", Journal of Marine Science and Technology (Taiwan), Vol. 27, No. 4, pp. 293-310, 2019.08.01

  20. No Image 05Aug
    by
    in International Journal

    Luman Zhao, Myung-Il Roh, “A Thrust Allocation Method for Efficient Dynamic Positioning of a Semisubmersible Drilling Rig Based on the Hybrid Optimization Algorithm”, Mathematical Problems in Engineering, Vol. 2015, pp. 1-12, 2015.10.01

Board Pagination Prev 1 2 3 4 5 6 Next
/ 6

Powered by Xpress Engine / Designed by Sketchbook

sketchbook5, 스케치북5

sketchbook5, 스케치북5

나눔글꼴 설치 안내


이 PC에는 나눔글꼴이 설치되어 있지 않습니다.

이 사이트를 나눔글꼴로 보기 위해서는
나눔글꼴을 설치해야 합니다.

설치 취소