Jeong-Ho Park, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Yeong-Min Jo, Nam-Sun Son, "Detection and Tracking Methods of Maritime Obstacles Using Multiple Cameras", Proceedings of ICDM(International Conference on Decarbonization and Digitalization in Marine Engineering) 2022, Siheung, Korea, 2022.04.28-29
| Abstract | Autonomous ships require an awareness system to recognize surrounding obstacles during navigation. In general, the awareness system uses data obtained by sensors such as RADAR (RAdio Detection And Ranging) and AIS (Automatic Identification System). However, autonomous ships operating in the marine environment should recognize small obstacles, including buoys that cannot be detected by RADAR and boats without the AIS system. Just as the tracking accuracy is improved by the fusion of sensors with different characteristics, a camera with a wide-angle of view or a camera capable of night detection can complement each other. In addition, tracking accuracy can be further improved if camera images from multiple viewpoints can be used in the case of detection through multiple ships. Therefore, in this study, camera-based detection and tracking methods were developed to be aware of marine obstacles that could not be recognized by RADAR or AIS. Firstly, the Convolutional Neural Network (CNN) based YOLO v5 model, combined with an attention module, was suggested for obstacle detection. Subsequently, the position and speed of the detected obstacles were tracked using the extended Kalman Filter. Finally, the tracks of the obstacles from various cameras mounted on multiple ships were integrated using the sensor fusion method to increase the accuracy. The field tests were conducted with a USV (Unmanned Surface Vessel) for various ship encountering scenarios to verify the developed methods in the actual marine environment. As a result, it was confirmed that stable and accurate detection and tracking of marine obstacles was performed using multiple cameras. |
|---|---|
| Publication Date | 2022-04-28 |
-
In-Chang Yeo, Myung-Il Roh, Hye-Won Lee, "An Optimization Method of the Surround-View Camera System for Automatic Berthing of Ships", Proceedings of G-NAOE 2022, Changwon, Korea, 2022.11.06-10
-
Min-Chul Kong, Myung-Il Roh, Jisang Ha, Jeong-Ho Park, EunSeok Jin, Donghun Yu, "Integrated Navigation Assistance System Using Augmented Reality", Proceedings of G-NAOE 2022, Changwon, Korea, 2022.11.06-10
-
Jeong-Ho Park, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Yeong-Min Jo, Nam-Sun Son, "Obstacle Detection and Tracking of Unmanned Surface Vehicles Using Multi-view Images in Marine Environment", Proceedings of ICCAS 2022, Yokohama, Japan, 2022.09.13-15
-
Dong-Guen Jeong, Myung-Il Roh, Ki-Su Kim, Jun-Sik Lee, Dae-Hyuk Kim, Wang-Seok Jang, "A Route Planning Method for Coastal Navigation of Small Ships", Proceedings of ICCAS 2022, Yokohama, Japan, pp. 153-156, 2022.09.13-15
-
Min-Chul Kong, Myung-Il Roh, Ki-Su Kim, Jongoh Kim, Hogyun Park, Jeongyoul Lee, "A Method of Variable Recognition and Connection for Reviewing Ship Regulations", Proceedings of ICCAS 2022, Yokohama, Japan, pp. 171-175, 2022.09.13-15
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Bo-Woo Nam, "Coupled Analysis of the LNG Offloading Operation Based on Multibody Dynamics", Proceedings of PRADS 2022, Dubrovnik, Croatia, 2022.10.09-13
-
Jeong-Ho Park, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Yeong-Min Jo, Nam-Sun Son, "Detection and Tracking Methods of Maritime Obstacles Using Multiple Cameras", Proceedings of ICDM 2022, Siheung, Korea, 2022.04.28-29
-
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, "Deep Reinforcement Learning-Based Ship Collision Avoidance Considering Collision Risk", Proceedings of TEAM 2022, Istanbul, Turkey, pp. 268, 2021.12.06-07
-
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "A Method for Automatic Control of Cranes for Block Lifting in Shipyard", Proceedings of PRADS 2022, Dubrovnik, Croatia, pp. 64, 2022.10.09-13
-
Min-Chul Kong, Myung-Il Roh, Jisang Ha, Eun Seok Jin, Donghun Yu, "Design of the Integrated System for the Safe Operation Based on Augmented Reality", Proceedings of PRADS 2022, Dubrovnik, Croatia, 2022.10.09-13
