Jeong-Ho Park, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Yeong-Min Jo, Nam-Sun Son, "Detection and Tracking Methods of Maritime Obstacles Using Multiple Cameras", Proceedings of ICDM(International Conference on Decarbonization and Digitalization in Marine Engineering) 2022, Siheung, Korea, 2022.04.28-29
| Abstract | Autonomous ships require an awareness system to recognize surrounding obstacles during navigation. In general, the awareness system uses data obtained by sensors such as RADAR (RAdio Detection And Ranging) and AIS (Automatic Identification System). However, autonomous ships operating in the marine environment should recognize small obstacles, including buoys that cannot be detected by RADAR and boats without the AIS system. Just as the tracking accuracy is improved by the fusion of sensors with different characteristics, a camera with a wide-angle of view or a camera capable of night detection can complement each other. In addition, tracking accuracy can be further improved if camera images from multiple viewpoints can be used in the case of detection through multiple ships. Therefore, in this study, camera-based detection and tracking methods were developed to be aware of marine obstacles that could not be recognized by RADAR or AIS. Firstly, the Convolutional Neural Network (CNN) based YOLO v5 model, combined with an attention module, was suggested for obstacle detection. Subsequently, the position and speed of the detected obstacles were tracked using the extended Kalman Filter. Finally, the tracks of the obstacles from various cameras mounted on multiple ships were integrated using the sensor fusion method to increase the accuracy. The field tests were conducted with a USV (Unmanned Surface Vessel) for various ship encountering scenarios to verify the developed methods in the actual marine environment. As a result, it was confirmed that stable and accurate detection and tracking of marine obstacles was performed using multiple cameras. |
|---|---|
| Publication Date | 2022-04-28 |
-
Min-Chul Kong, Myung-Il Roh, Jisang Ha, Mijin Kim, Jeoungyoun Kim, "A Method for the Generation of Optimal Patterns for Equipment Unit Modules in the Engine Room", Proceedings of PAAMES/AMEC 2023, Kyoto, Japan, 2023.10.18-20
-
Min-Chul Kong, Myung-Il Roh, In-Chang Yeo, Ki-Su Kim, Jeongyoul Lee, Jongoh Kim, Gapheon Lee, "A Detection Method of Objects with Text in Drawings Based on Deep Learning", Proceedings of ISOPE 2023, Ottawa, Canada, 2023.06.19-23
-
Myung-Il Roh, "Applications of Deep Learning in Ship Design, Production, and Operation Stages", Proceedings of ICDM(International Conference on Decarbonization and Digitalization in Marine Engineering) 2022, Siheung, Korea, 2022.04.28-29
-
Myung-Il Roh, "Physics-based Simulation for Design, Production, and Installation of Ships and Offshore Structures", International Symposium on Computational Design and Engineering, Ho Chi Minh, Vietnam, 2017.12.13-16
-
Myung-Il Roh, "Simulation Based Engineering for Ship and Offshore Plant", International Ocean Technology Conference & Expo (IOTCE 2015), Qingdao, China, 2015.09.01-03
-
Ki-Su Kim, Myung-Il Roh, Seung-Ho Ham, Sol Ha, "Evacuation Analysis of Passenger Ships Considering Intermediate Flooding", Proceedings of International Symposium on PRADS 2022, Dubrovnik, Croatia, pp. 628-632, 2022.10.09-13
-
Jin-Hyeok Kim, Myung-Il Roh, In-Chang Yeo, Ki-Su Kim, "Estimation of the Hydrodynamic Performance of the Parameterized Hull Forms Using Deep Learning", Proceedings of G-NAOE 2022, Changwon, Korea, 2022.11.06-10
-
Yeongmin Jo, Myung-Il Roh, Hye-Won Lee, Donghun Yu, "A Ship Tracking Method under Dynamic Characteristic Changes with LSTM", Proceedings of G-NAOE 2022, Changwon, Korea, 2022.11.06-10
-
Do-Hyun Chun, Myung-Il Roh, In-Chang Yeo, "Optimum Design of Membrane-type LNG Tanks for Installing Insulation", Proceedings of G-NAOE 2022, Changwon, Korea, 2022.11.06-10
-
Dong-Guen Jeong, Myung-Il Roh, Ki-Su Kim, Jun-Sik Lee, Dae-Hyuk Kim, Wang-Seok Jang, "A Method for Route Planning of Small Ships in Coastal Areas", Proceedings of ICDM 2022, Si-Heung, Korea, 2022.04.28-29
