Jeong-Ho Park, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Yeong-Min Jo, Nam-Sun Son, "Detection and Tracking Methods of Maritime Obstacles Using Multiple Cameras", Proceedings of ICDM(International Conference on Decarbonization and Digitalization in Marine Engineering) 2022, Siheung, Korea, 2022.04.28-29
Abstract | Autonomous ships require an awareness system to recognize surrounding obstacles during navigation. In general, the awareness system uses data obtained by sensors such as RADAR (RAdio Detection And Ranging) and AIS (Automatic Identification System). However, autonomous ships operating in the marine environment should recognize small obstacles, including buoys that cannot be detected by RADAR and boats without the AIS system. Just as the tracking accuracy is improved by the fusion of sensors with different characteristics, a camera with a wide-angle of view or a camera capable of night detection can complement each other. In addition, tracking accuracy can be further improved if camera images from multiple viewpoints can be used in the case of detection through multiple ships. Therefore, in this study, camera-based detection and tracking methods were developed to be aware of marine obstacles that could not be recognized by RADAR or AIS. Firstly, the Convolutional Neural Network (CNN) based YOLO v5 model, combined with an attention module, was suggested for obstacle detection. Subsequently, the position and speed of the detected obstacles were tracked using the extended Kalman Filter. Finally, the tracks of the obstacles from various cameras mounted on multiple ships were integrated using the sensor fusion method to increase the accuracy. The field tests were conducted with a USV (Unmanned Surface Vessel) for various ship encountering scenarios to verify the developed methods in the actual marine environment. As a result, it was confirmed that stable and accurate detection and tracking of marine obstacles was performed using multiple cameras. |
---|---|
Publication Date | 2022-04-28 |
-
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "A Method for Automatic Control of Cranes for Block Lifting in Shipyard", Proceedings of PRADS 2022, Dubrovnik, Croatia, pp. 64, 2022.10.09-13
-
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, "Deep Reinforcement Learning-Based Ship Collision Avoidance Considering Collision Risk", Proceedings of TEAM 2022, Istanbul, Turkey, pp. 268, 2021.12.06-07
-
박정호, 노명일, 이혜원, 하지상, 조영민, 손남선, "다중 선박으로부터의 카메라 영상 기반 단일 해상 장애물의 탐지 및 추적 방법", 2022년도 한국CDE학회 동계학술발표회, 제주, 2022.02.09-12
-
Jeong-Ho Park, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Yeong-Min Jo, Nam-Sun Son, "Detection and Tracking Methods of Maritime Obstacles Using Multiple Cameras", Proceedings of ICDM 2022, Siheung, Korea, 2022.04.28-29
-
여인창, 노명일, 전도현, "선박 배관망 지지대의 최적 배치 설계", 2022년도 한국CDE학회 동계학술발표회, 제주, 2022.02.09-12
-
전도현, 노명일, 이혜원, 함승호, "블록의 특성을 고려한 크레인의 와이어 제어 방법", 2022년도 한국CDE학회 동계학술발표회, 제주, 2022.02.09-12
-
정동근, 노명일, 김기수, 이준식, 김대혁, 장왕석, "요트 전용의 연안 항해 프로그램 개발", 2022년도 한국CDE학회 동계학술발표회, 제주, 2022.02.09-12
-
이혜원, 노명일, 김예린, "조선소의 블록 리프팅을 위한 모델 예측 제어 기반 크레인 시뮬레이션", 2022년도 한국CDE학회 동계학술발표회, 제주, 2022.02.09-12
-
송하민, 노명일, 김기수, "함정의 전투 시나리오를 고려한 승조원 운영 최적화" 2022년도 한국CDE학회 동계학술발표회, 제주, 2022.02.09-12
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Bo-Woo Nam, "Coupled Analysis of the LNG Offloading Operation Based on Multibody Dynamics", Proceedings of PRADS 2022, Dubrovnik, Croatia, 2022.10.09-13