Skip to content
Extra Form
Abstract Developing a high-level autonomous collision avoidance system for ships that can operate in an unstructured and unpredictable environment is challenging. Particularly in congested sea areas, each ship should make decisions continuously to avoid collisions with other ships in a busy and complex waterway. Furthermore, recent reports indicate that a large number of marine collision accidents are caused by or are related to human decision failures concerning a lack of situational awareness and failure to comply with the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose an efficient method to overcome multiship collision avoidance problems based on the Deep Reinforcement Learning (DRL) algorithm by expanding our previous study (Zhao et al., 2019). The proposed method directly maps the states of encountered ships to an ownship's steering commands in terms of rudder angle using the Deep Neural Network (DNN). This DNN is trained over multiple ships in rich encountering situations using the policy-gradient based DRL algorithm. To address multiple encountered ships, we classify them into four regions based on COLREGs, and consider only the nearest ship in each region. We validate the proposed collision avoidance method in a variety of simulated scenarios with thorough performance evaluations, and demonstrate that the final DRL controller can obtain time efficient and collision-free paths for multiple ships. Simulation results indicate that multiple ships can avoid collisions with each other while following their own predefined paths simultaneously. In addition, the proposed approach demonstrates its excellent adaptability to unknown complex environments with various encountered ships.
Publication Date 2019-11-01
Role Corresponding Author
Category SCI
Impact Factor 1.894

Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01


List of Articles
번호 분류 제목 Publication Date
106 International Journal Kyu-Yeul Lee, Myung-Il Roh, "A Hybrid Optimization Method for Multidisciplinary Ship Design", Journal of Ship Technology Research, Vol. 47, No. 4, pp. 181-185, 2000.10.01 file 2000-10-01
105 International Journal Kyu-Yeul Lee, Myung-Il Roh, "An Efficient Genetic Algorithm Using Gradient Information for Ship Structural Design Optimization", Journal of Ship Technology Research, Vol. 48, No. 4, pp. 161-170, 2001.11.01 file 2001-11-01
104 International Journal Kyu-Yeul Lee, Myung-Il Roh, Seonho Cho, "Multidisciplinary Design Optimization of Mechanical Systems Using Collaborative Optimization Approach", International Journal of Vehicle Design, Vol. 25, No. 4, pp. 353-368, 2001.11.01 file 2001-11-01
103 International Journal Kyu-Yeul Lee, Seonho Cho, Myung-Il Roh, "An Efficient Global-Local Hybrid Optimization Method Using Design Sensitivity Analysis", International Journal of Vehicle Design, Vol. 28, No. 4, pp. 300-317, 2002.07.01 file 2002-07-01
102 International Journal Kyu-Yeul Lee, Seong-Nam Han, Myung-Il Roh, "Optimal Compartment Layout Design for a Naval Ship Using an Improved Genetic Algorithm", Marine Technology and SNAME News, Vol. 39, No. 3, pp. 159-169, 2002.07.01 file 2002-07-01
101 International Journal Kyu-Yeul Lee, Seong-Nam Han, Myung-Il Roh, "An Improved Genetic Algorithm for Facility Layout Problems Having Inner Structure Walls and Passages", Computers & Operations Research, Vol. 30, No. 1, pp. 117-138, 2003.01.01 file 2003-01-01
100 International Journal Kyu-Yeul Lee, Won-Joon Lee, Myung-Il Roh, "Development of a Semantic Product Modeling System for Initial Hull Structure in Shipbuilding", Robotics and Computer-Integrated Manufacturing Journal, Vol. 20, No. 3, pp. 211-223, 2004.06.01 file 2004-06-01
99 International Journal Kyu-Yeul Lee, Myung-Il Roh, Hyuk-Su Jeong, "An Improved Genetic Algorithm for Multi-Floor Facility Layout Problems Having Inner Structure Walls and Passages", Computers & Operations Research, Vol. 32, No. 4, pp. 879-899, 2005.04.01 file 2005-04-01
98 International Journal Myung-Il Roh, Kyu-Yeul Lee, "Development of a 3D CAD System for Modeling Hull Structure at the Initial Ship Design Stage", Ships and Offshore Structures, Vol. 1, No. 2, pp. 135-151, 2006.04.01 file 2006-04-01
97 International Journal Myung-Il Roh, Kyu-Yeul Lee, "An Initial Hull Structural Modeling System for Computer-Aided Process Planning in Shipbuilding", Advances In Engineering Software, Vol. 37, No. 7, pp. 457-476, 2006.07.01 file 2006-07-01
96 International Journal Myung-Il Roh, Kyu-Yeul Lee, Seong-Jin Yoo, "An Algorithm for Generating the Hull Structural Analysis Model Using the Seam Information of the Hull Structure at the Initial Design Stage", Journal of Ship and Ocean Technology, Vol. 10, No. 4, pp. 24-33, 2006.12.01 file 2006-12-01
95 International Journal Myung-Il Roh, Kyu-Yeul Lee, Woo-Young Choi, "Rapid Generation of the Piping Model Having the Relationship with a Hull Structure in Shipbuilding", Advances In Engineering Software, Vol. 38, No. 4, pp. 215-228, 2007.04.01 file 2007-04-01
94 International Journal Myung-Il Roh, Kyu-Yeul Lee, "Generation of the 3D CAD Model of the Hull Structure at the Initial Ship Design Stage and Its Application", Computers in Industry, Vol. 58, No. 6, pp. 539-557, 2007.08.01 file 2007-08-01
93 International Journal Myung-Il Roh, Kyu-Yeul Lee, "Generation of the Production Material Information of a Building Block and Simulation of the Block Erection for Computer-Aided Process Planning and Scheduling in Shipbuilding", International Journal of Production Research, Vol. 45, No. 20, pp. 4653-4683, 2007.10.01 file 2007-10-01
92 International Journal Myung-Il Roh, Kyu-Yeul Lee, Woo-Young Choi, Seong-Jin Yoo, "Improvement of Ship Design Practice Using a 3D CAD Model of a Hull Structure", Robotics and Computer-Integrated Manufacturing Journal, Vol. 24, No. 1, pp. 105-124, 2008.02.01 file 2008-02-01
91 International Journal Sang-Uk Lee, Myung-Il Roh, Ju-Hwan Cha, Kyu-Yeul Lee, "Ship Compartment Modeling Based On a Non-manifold Polyhedron Modeling Kernel", Advances In Engineering Software, Vol. 40, No. 5, pp. 378-388, 2009.05.01 file 2009-05-01
90 International Journal Ju-Hwan Cha, Myung-Il Roh, Kyu-Yeul Lee, "Combined Discrete Event and Discrete Time Simulation Framework and Its Application to the Block Erection Process in Shipbuilding", Advances In Engineering Software, Vol. 41, No. 4, pp. 656-665, 2010.04.01 file 2010-04-01
89 International Journal John-Kyu Hwang, Myung-Il Roh, Kyu-Yeul Lee, "Detailed Design and Construction of the Hull of an FPSO(Floating, Production, Storage, and Off-loading unit)", Ships and Offshore Structures, Vol. 5, No. 2, pp. 93-104, 2010.06.01 file 2010-06-01
88 International Journal Myung-Il Roh, Kyu-Yeul Lee, "Optimal Scheduling of Block Lifting in Consideration of the Minimization of Traveling Distance While Unloaded and Wire and Shackle Replacement of a Gantry Crane", Journal of Marine Science and Technology, Vol. 15, No. 2, pp. 190-200, 2010.06.01 file 2010-06-01
87 International Journal Ju-Hwan Cha, Myung-Il Roh, Kyu-Yeul Lee, "Integrated Simulation Framework for the Process Planning of Ships and Offshore Structures", Robotics and Computer-Integrated Manufacturing Journal, Vol, 26, No. 5, pp. 430-453, 2010.10.01 file 2010-10-01
Board Pagination Prev 1 2 3 4 5 6 Next
/ 6

Powered by Xpress Engine / Designed by Sketchbook

sketchbook5, 스케치북5

sketchbook5, 스케치북5

나눔글꼴 설치 안내


이 PC에는 나눔글꼴이 설치되어 있지 않습니다.

이 사이트를 나눔글꼴로 보기 위해서는
나눔글꼴을 설치해야 합니다.

설치 취소