Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01

SyDLab

조회 수 255

Atachment
첨부 '1'	OE(201911).pdf,

단축키

Prev이전 문서

Next다음 문서

가 크게 작게 위로 아래로 댓글로 가기 인쇄

단축키

Prev이전 문서

Next다음 문서

가 크게 작게 위로 아래로 댓글로 가기 인쇄

Extra Form
Abstract	Developing a high-level autonomous collision avoidance system for ships that can operate in an unstructured and unpredictable environment is challenging. Particularly in congested sea areas, each ship should make decisions continuously to avoid collisions with other ships in a busy and complex waterway. Furthermore, recent reports indicate that a large number of marine collision accidents are caused by or are related to human decision failures concerning a lack of situational awareness and failure to comply with the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs). In this study, we propose an efficient method to overcome multiship collision avoidance problems based on the Deep Reinforcement Learning (DRL) algorithm by expanding our previous study (Zhao et al., 2019). The proposed method directly maps the states of encountered ships to an ownship's steering commands in terms of rudder angle using the Deep Neural Network (DNN). This DNN is trained over multiple ships in rich encountering situations using the policy-gradient based DRL algorithm. To address multiple encountered ships, we classify them into four regions based on COLREGs, and consider only the nearest ship in each region. We validate the proposed collision avoidance method in a variety of simulated scenarios with thorough performance evaluations, and demonstrate that the final DRL controller can obtain time efficient and collision-free paths for multiple ships. Simulation results indicate that multiple ships can avoid collisions with each other while following their own predefined paths simultaneously. In addition, the proposed approach demonstrates its excellent adaptability to unknown complex environments with various encountered ships.
Publication Date	2019-11-01
Role	Corresponding Author
Category	SCI
Impact Factor	1.894

Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01

https://doi.org/10.1016/j.oceaneng.2019.106436

Prev 오민재, 노명일, 김범수, 김용환, “선박 내항성능 해석을 위한 선... 오민재, 노명일, 김범수, 김용환, “선박 내항성능 해석을 위한 선... 2019.05.28by Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, "Collision Dete... Next Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, "Collision Dete... 2019.11.03by

위로 아래로 댓글로 가기 인쇄

Category

오민재, 노명일, 김범수, 김용환, “선박 내항성능 해석을 위한 선형 곡면으로부터의 오프셋 생성 프로그램 개발”, 한국CDE학회 논문집, Vol. 24, No. 2, pp. 1-10, 2019.06.01

CategoryDomestic Journal

Read More
Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01

CategoryInternational Journal

Read More
Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, "Collision Detection and Response of Multibody Systems Using a Position Difference Method and Non-Interpenetration Constraint in Shipbuilding Simulation", Ocean Engineering, Vol. 195, pp. 1-18, 2020.01.01

CategoryInternational Journal

Read More
Joo-Pil Lee, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "Design of a Wreck Removal Method Considering Safety and Economy", Ships and Offshore Structures, Vol. 15, No. 10, pp. 1037-1056, 2020.12.01

CategoryInternational Journal

Read More
Sang-Hyun Lee, Myung-Il Roh, Min-Jae Oh, Ki-Su Kim, "Optimal Layout Design of an LNG FPSO: A Case Study", Journal of Offshore Mechanics and Arctic Engineering, Vol. 142, No. 041403, pp. 1-17, 2020.08.01

CategoryInternational Journal

Read More
Seong-Hoon Kim, Myung-Il Roh, Min-Jae Oh, Sung-Woo Park, "Estimation of Ship Operational Efficiency from AIS Data Using Big Data Technology", IJNAOE, Vol. 12, pp. 440-453, 2020.05.21

CategoryInternational Journal

Read More
Do-Hyun Chun, Myung-Il Roh, Seung-Ho Ham, “Optimum Arrangement Design of Mastic Ropes for Membrane-type LNG Tanks Considering the Flatness of Thermal Insulation Panel and Production Cost”, Journal of Marine Science and Engineering, Vol. 8, No. 5

CategoryInternational Journal

Read More
함승호, 노명일, 이종혁, “다목적 조선 해양 전용 시뮬레이터 개발을 위한 통합 시뮬레이션 방법”, 한국CDE학회 논문집, Vol. 25, No. 2, pp. 161-172, 2020.06.01

CategoryDomestic Journal

Read More
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Block Erection Simulation Considering Frictional Contact with Wire Ropes", Ocean Engineering, Vol. 217, pp. 1-24, 2020.12.01

CategoryInternational Journal

Read More
Seung-Ho Ham, Myung-Il Roh, “Time-domain Structural Analysis During Block Turnover and Lifting Using 2D Flexible Multibody Dynamics”, Marine Structures, Vol. 75, pp. 102841.1-26, 2021.01.01

CategoryInternational Journal

Read More
이수민, 노명일, 하지상, 이원재, “해상 이미지로부터 선박의 위치를 추정하는 방법”, 한국CDE학회 논문집, Vol. 25, No. 3, pp. 320-328, 2020.09.01

CategoryDomestic Journal

Read More
이준범, 노명일, 오민재, “공간 가용성을 고려한 해양 구조물의 배관 라우팅”, 한국CDE학회 논문집, Vol. 24, No. 3, pp. 280-288, 2019.08.25

CategoryDomestic Journal

Read More
Ki-Su Kim, Myung-Il Roh, "Dynamic Flooding Analysis Method for Intermediate Flooding Process of a Ship", Ocean Engineering, Vol. 218, pp. 108173.1-33, 2020.12.15

CategoryInternational Journal

Read More
Sung-Jun Lee, Myung-Il Roh, Min-Jae Oh, "Image-based Ship Detection Using Deep Learning", Ocean Systems Engineering, Vol. 10, No. 4, pp. 415-434, 2020.12.01

CategoryInternational Journal

Read More
Ki-Su Kim, Myung-Il Roh, “ISO 15016:2015-based Method for Estimating the Fuel Oil Consumption of a Ship”, Journal of Marine Science and Engineering, Vol. 8, No. 10, pp. 791:1-18, 2020.10.12

CategoryInternational Journal

Read More
Ki-Su Kim, June-Beom Lee, Myung-Il Roh, Ki-Min Han, Gap-Heon Lee, "Prediction of Ocean Weather Based on Denoising AutoEncoder and Convolutional LSTM", Journal of Marine Science and Engineering, Vol. 8, No. 10, pp. 805:1-24, 2020.10.14

CategoryInternational Journal

Read More
Jisang Ha, Myung-Il Roh, Seung-Ho Ham, Sung-Jun Lee, “Optimum Design of the Underwater Discharge System Based on Surrogate Modeling”, Journal of Marine Science and Technology (Taiwan), Vol. 29, No. 3, pp. 338-353, 2021.06.01

CategoryInternational Journal

Read More
김기수, 노명일, 정양재, 나갑주, "해기상 예측 및 가시화를 위한 응용 프로그램", 한국CDE학회 논문집, Vol. 25, No. 4, pp. 434-444, 2020.12.01

CategoryDomestic Journal

Read More
Hye-Won Lee, Joo-Hyun Woo, Myung-Il Roh, Seung-Ho Ham, et al., "Integrated Simulation of Virtual Prototypes and Control Algorithms of Unmanned Surface Vehicles Based on a Robot Operating System", Journal of Marine Science and Technology (Taiwan)

CategoryInternational Journal

Read More
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Underactuated Crane Control for the Automation of Block Erection in Shipbuilding", Automation in Construction, Vol. 124, pp. 1-28, 2021.04.01

CategoryInternational Journal

Read More

이메일 로그인

Publication

Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01

단축키

단축키

오민재, 노명일, 김범수, 김용환, “선박 내항성능 해석을 위한 선형 곡면으로부터의 오프셋 생성 프로그램 개발”, 한국CDE학회 논문집, Vol. 24, No. 2, pp. 1-10, 2019.06.01

Luman Zhao, Myung-Il Roh, "COLREGs-Compliant Multiship Collision Avoidance Based on Deep Reinforcement Learning", Ocean Engineering, Vol. 191, pp. 1-15, 2019.11.01

Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, "Collision Detection and Response of Multibody Systems Using a Position Difference Method and Non-Interpenetration Constraint in Shipbuilding Simulation", Ocean Engineering, Vol. 195, pp. 1-18, 2020.01.01

Joo-Pil Lee, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "Design of a Wreck Removal Method Considering Safety and Economy", Ships and Offshore Structures, Vol. 15, No. 10, pp. 1037-1056, 2020.12.01

Sang-Hyun Lee, Myung-Il Roh, Min-Jae Oh, Ki-Su Kim, "Optimal Layout Design of an LNG FPSO: A Case Study", Journal of Offshore Mechanics and Arctic Engineering, Vol. 142, No. 041403, pp. 1-17, 2020.08.01

Seong-Hoon Kim, Myung-Il Roh, Min-Jae Oh, Sung-Woo Park, "Estimation of Ship Operational Efficiency from AIS Data Using Big Data Technology", IJNAOE, Vol. 12, pp. 440-453, 2020.05.21

Do-Hyun Chun, Myung-Il Roh, Seung-Ho Ham, “Optimum Arrangement Design of Mastic Ropes for Membrane-type LNG Tanks Considering the Flatness of Thermal Insulation Panel and Production Cost”, Journal of Marine Science and Engineering, Vol. 8, No. 5

함승호, 노명일, 이종혁, “다목적 조선 해양 전용 시뮬레이터 개발을 위한 통합 시뮬레이션 방법”, 한국CDE학회 논문집, Vol. 25, No. 2, pp. 161-172, 2020.06.01

Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Block Erection Simulation Considering Frictional Contact with Wire Ropes", Ocean Engineering, Vol. 217, pp. 1-24, 2020.12.01

Seung-Ho Ham, Myung-Il Roh, “Time-domain Structural Analysis During Block Turnover and Lifting Using 2D Flexible Multibody Dynamics”, Marine Structures, Vol. 75, pp. 102841.1-26, 2021.01.01

이수민, 노명일, 하지상, 이원재, “해상 이미지로부터 선박의 위치를 추정하는 방법”, 한국CDE학회 논문집, Vol. 25, No. 3, pp. 320-328, 2020.09.01

이준범, 노명일, 오민재, “공간 가용성을 고려한 해양 구조물의 배관 라우팅”, 한국CDE학회 논문집, Vol. 24, No. 3, pp. 280-288, 2019.08.25

Ki-Su Kim, Myung-Il Roh, "Dynamic Flooding Analysis Method for Intermediate Flooding Process of a Ship", Ocean Engineering, Vol. 218, pp. 108173.1-33, 2020.12.15

Sung-Jun Lee, Myung-Il Roh, Min-Jae Oh, "Image-based Ship Detection Using Deep Learning", Ocean Systems Engineering, Vol. 10, No. 4, pp. 415-434, 2020.12.01

Ki-Su Kim, Myung-Il Roh, “ISO 15016:2015-based Method for Estimating the Fuel Oil Consumption of a Ship”, Journal of Marine Science and Engineering, Vol. 8, No. 10, pp. 791:1-18, 2020.10.12

Ki-Su Kim, June-Beom Lee, Myung-Il Roh, Ki-Min Han, Gap-Heon Lee, "Prediction of Ocean Weather Based on Denoising AutoEncoder and Convolutional LSTM", Journal of Marine Science and Engineering, Vol. 8, No. 10, pp. 805:1-24, 2020.10.14

Jisang Ha, Myung-Il Roh, Seung-Ho Ham, Sung-Jun Lee, “Optimum Design of the Underwater Discharge System Based on Surrogate Modeling”, Journal of Marine Science and Technology (Taiwan), Vol. 29, No. 3, pp. 338-353, 2021.06.01

김기수, 노명일, 정양재, 나갑주, "해기상 예측 및 가시화를 위한 응용 프로그램", 한국CDE학회 논문집, Vol. 25, No. 4, pp. 434-444, 2020.12.01

Hye-Won Lee, Joo-Hyun Woo, Myung-Il Roh, Seung-Ho Ham, et al., "Integrated Simulation of Virtual Prototypes and Control Algorithms of Unmanned Surface Vehicles Based on a Robot Operating System", Journal of Marine Science and Technology (Taiwan)

Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Underactuated Crane Control for the Automation of Block Erection in Shipbuilding", Automation in Construction, Vol. 124, pp. 1-28, 2021.04.01

This Category

나눔글꼴 설치 안내

이 PC에는 나눔글꼴이 설치되어 있지 않습니다.