Jeong-Ho Park, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Yeong-Min Jo, Nam-Sun Son, "Detection and Tracking Methods of Maritime Obstacles Using Multiple Cameras", Proceedings of ICDM(International Conference on Decarbonization and Digitalization in Marine Engineering) 2022, Siheung, Korea, 2022.04.28-29
Abstract | Autonomous ships require an awareness system to recognize surrounding obstacles during navigation. In general, the awareness system uses data obtained by sensors such as RADAR (RAdio Detection And Ranging) and AIS (Automatic Identification System). However, autonomous ships operating in the marine environment should recognize small obstacles, including buoys that cannot be detected by RADAR and boats without the AIS system. Just as the tracking accuracy is improved by the fusion of sensors with different characteristics, a camera with a wide-angle of view or a camera capable of night detection can complement each other. In addition, tracking accuracy can be further improved if camera images from multiple viewpoints can be used in the case of detection through multiple ships. Therefore, in this study, camera-based detection and tracking methods were developed to be aware of marine obstacles that could not be recognized by RADAR or AIS. Firstly, the Convolutional Neural Network (CNN) based YOLO v5 model, combined with an attention module, was suggested for obstacle detection. Subsequently, the position and speed of the detected obstacles were tracked using the extended Kalman Filter. Finally, the tracks of the obstacles from various cameras mounted on multiple ships were integrated using the sensor fusion method to increase the accuracy. The field tests were conducted with a USV (Unmanned Surface Vessel) for various ship encountering scenarios to verify the developed methods in the actual marine environment. As a result, it was confirmed that stable and accurate detection and tracking of marine obstacles was performed using multiple cameras. |
---|---|
Publication Date | 2022-04-28 |
-
김진혁, 노명일, 여인창, "설계 요구 조건을 고려한 국부 변형 기반 상선의 선형 변환 방법", 2023년도 한국CDE학회 동계학술발표회, 평창, pp. 47, 2023.02.08-11
CategoryDomestic Conference -
이혜원, 노명일, 함승호, 남보우, "LNG 로딩 암의 최적 설계를 위한 동적 거동 해석 방법", 2023년도 한국CDE학회 동계학술발표회, 평창, pp. 108, 2023.02.08-11
CategoryDomestic Conference -
전도현, 노명일, 이혜원, 유동훈, "연안 적용을 위한 충돌 위험도 산정 및 충돌 회피 경로 생성 방법", 2023년도 한국CDE학회 동계학술발표회, 평창, pp. 49, 2023.02.08-11
CategoryDomestic Conference -
김하연, 노명일, 이혜원, 조영민, "센서 데이터를 이용한 선박의 추적 방법", 2023년도 한국CDE학회 동계학술발표회, 평창, pp. 109, 2023.02.08-11
CategoryDomestic Conference -
조영민, 노명일, 이혜원, 공민철, "자율 운항 선박을 위한 개선된 센서 융합 방법", 2023년도 한국CDE학회 동계학술발표회, 평창, pp. 107, 2023.02.08-11
CategoryDomestic Conference -
하지상, 노명일, 공민철, 김기수, "격벽, 장비 및 배관을 고려한 선박의 배치 설계 방법", 2023년도 한국CDE학회 동계학술발표회, 평창, pp. 8, 2023.02.08-11
CategoryDomestic Conference -
여인창, 노명일, 이혜원, 유동훈, "선박용 서라운드 뷰 영상의 자동 생성 방법", 2023년도 한국CDE학회 동계학술발표회, 평창, pp. 45, 2023.02.08-11
CategoryDomestic Conference -
Min-Chul Kong, Myung-Il Roh, In-Chang Yeo, Ki-Su Kim, Jeongyoul Lee, Jongoh Kim, Gapheon Lee, "A Detection Method of Objects with Text in Drawings Based on Deep Learning", Proceedings of ISOPE 2023, Ottawa, Canada, 2023.06.19-23
CategoryInternational Conference -
Myung-Il Roh, "Applications of Deep Learning in Ship Design, Production, and Operation Stages", Proceedings of ICDM(International Conference on Decarbonization and Digitalization in Marine Engineering) 2022, Siheung, Korea, 2022.04.28-29
CategoryInternational Conference -
노명일, "선박 설계, 생산 및 운용 단계에서의 딥 러닝 활용 예, 2020년도 선박해양플랜트구조연구회 워크샵, 2021.02.18
CategoryDomestic Conference