Min-Chul Kong, Myung-Il Roh, Jisang Ha, Jeong-Ho Park, EunSeok Jin, Donghun Yu, "Integrated Navigation Assistance System Using Augmented Reality", Proceedings of G-NAOE 2022, Changwon, Korea, 2022.11.06-10
|For safe operation, a navigator needs to accurately recognize the circumstance around the ship and constantly focus on objects that require attention. Therefore, the navigator should properly utilize the information of the field of vision seen from the ship and the sensor data such as AIS (Automatic Identification System), RADAR (RAdio Detection And Ranging), etc. However, since such data have different dimensions and meanings, it is not easy to interpret except for professionals, and it is not intuitive. In addition, it is difficult to obtain consistent and high-accuracy data depending on the characteristics of each sensor (detection distance, detection period, error, blind spot, etc.) and whether other ships are equipped with the AIS system. Therefore, we developed an integrated navigation assistance system that can effectively report sensor data to the navigator by sensor data fusion. We tracked the positions of ships by sensor data fusion through the tracking filter. To supplement the limitations of sensors, we used the object detection model. Collision risk was quantitatively calculated using the detected ships and tracking data, and the collision-free path of the own ship was generated. The above processes were modularized and integrated, and communication packets were defined to enable data exchange between each module. Finally, we implement a navigation assistance system that efficiently provides necessary information for navigating using AR (Augmented Reality) technology. In addition to ship detection and tracking data, the ship needs to visualize its own sensor data, such as rudder angle and engine RPM. Various data was provided as an intuitive UI by appropriately overlapping the information within the image. The integrated navigation assistance system was mounted on a test ship in actual operation, and its effectiveness was confirmed by transmitting necessary information to the land command center.