Min-Chul Kong, Myung-Il Roh, In-Chang Yeo, Ki-Su Kim, Jeongyoul Lee, Jongoh Kim, Gapheon Lee, "A Detection Method of Objects with Text in Drawings Based on Deep Learning", Proceedings of ISOPE(International Society of Offshore and Polar Engineers) 2023, Ottawa, Canada, 2023.06.19-23
International Conference
2023.02.13 12:23
Min-Chul Kong, Myung-Il Roh, In-Chang Yeo, Ki-Su Kim, Jeongyoul Lee, Jongoh Kim, Gapheon Lee, "A Detection Method of Objects with Text in Drawings Based on Deep Learning", Proceedings of ISOPE 2023, Ottawa, Canada, 2023.06.19-23
조회 수 134
| 첨부 '1' |
|---|
| Abstract | Drawings such as piping and instrument diagrams (P&ID) or ship safety plans have various equipment and components (lines, signs, and text). Every drawing has rules to express these objects with specific symbols. Generally, these drawings are very complex because they are large in size and consist of relationships between several objects. Therefore, the drawing investigators spend countless time and labor. For the above reasons, this study uses a deep learning model that has been actively researched recently. An object detection model based on deep learning can quickly find various objects within the drawing. However, the drawing differs from the common images in size and characteristics, generally used as an input in deep learning. Therefore, we proposed a series of procedures for applying the deep learning model to the drawing. This study proposed an object detection algorithm specialized for drawings by combining the non-maximum suppression (NMS) algorithm with the sliding window algorithm. YOLOv7 was selected as an object detection model, which showed the best accuracy by comparing various deep learning models. First, we made a detection window that slides on the drawing. Then, the NMS algorithm was applied to remove duplicate objects from the overall detection results. Training a deep learning model requires a large amount of training data, but it takes a lot of time to label drawings manually. Therefore, we proposed a data generation model for training data. Objects and background images were extracted from several drawings, and training data were generated by randomly mixing them as material and base. The optimal parameters for training data were selected by comparing the accuracy of the drawings. All models used in this study were trained only with the generated virtual training data. Knowing how many objects are placed in each division of the ship is important in the inspecting process. Therefore, we developed an algorithm that automatically recognizes the division of the ship and organizes the types and numbers of equipment placed in each division. Furthermore, we developed an algorithm that can obtain the connection relationship between objects and detailed specification of objects by recognizing lines and texts connected to each object. The method proposed in this study was applied to several actual plans. We confirmed the effectiveness of the proposed method by obtaining high average accuracy. By applying the proposed method, the review procedure, which took several days, can be reduced dramatically to a few minutes per drawing. |
|---|---|
| Publication Date | 2023-06-22 |
-
Yoon-Nam An, Joo-Sung Lee, Myung-Il Roh, Bum-Sang Yoon, Kyoung-Sik Chang, "Shape Optimization of Structural Member Based on Isogeometry Concept", Proceedings of the 24th Asian-Pacific TEAM(Technical Exchange and Advisory Meeting on Marine Structures) 2010, Vladivostok, Russia, pp. 343-348, 2010.08.23-26
-
Yoon-Nam An, Joo-Sung Lee, Myung-Il Roh, Bum-Sang Yoon, Kyoung-Sik Chang, "Parametric Study of Mesh Refinement in Isogeometric Analysis", Proceedings of ISOPE(International Society of Offshore and Polar Engineers) 2010, Beijing, China, pp. 809-812, 2010.06.20-26
-
Yoon-Nam An, Joo-Sung Lee, Myung-Il Roh, Bum-Sang Yoon, Kyoung-Sik Chang, "Parametric Study of Isogeometric Analysis Using NURBS", Proceedings of the 23rd Asian-Pacific TEAM(Technical Exchange and Advisory Meeting on Marine Structures) 2009, Kaohsiung, Taiwan, pp. 169-173, 2009.11.30-12.03
-
Yeongmin Jo, Myung-Il Roh, Hye-Won Lee, Donghun Yu, "A Ship Tracking Method under Dynamic Characteristic Changes with LSTM", Proceedings of G-NAOE 2022, Changwon, Korea, 2022.11.06-10
-
Yeong-min Jo, Myung-Il Roh, Hye-Won Lee, Jisang Ha, Do-Hyun Chun, Min-chul Kong, "An Improved Method for the Sensor Fusion for Autonomous Ships", Proceedings of 10th PAAMES and AMEC 2023, Kyoto, Japan, 2023.10.18-20
-
Won-Joon Lee, Kyu-Yeul Lee, Myung-Il Roh, O-Hwan Kwon, Sung-Geun Lee, "Development of an Initial Hull Structural CAD System for Computer-Aided Process Planning (CAPP)", Proceedings of ICCAS(International Conference on Computer Applications in Shipbuilding) 2002, Malmoe, Sweden, pp. 113-123, 2002.09.09-12
-
Tae-Sub Um, Jeong-Hoon Park, Myung-Il Roh, "Determination of Optimal Principal Dimensions of the Hatch Cover for Lightening of a Bulk Carrier", Proceedings of ISGMA(International Symposium on Green Manufacturing and Applications) 2012, Jeju, Korea, pp. 1-7, 2012.08.27-29
-
Sung-Woo Park, Myung-Il Roh, Seong-Hoon Kim, Min-Jae Oh, "Material Requirements Planning of Offshore Structures Using Big Data Frameworks", Proceedings of ISCDE 2017, Ho Chi Minh, Vietnam, pp. 1-2, 2017.12.13-16
-
Sung-Woo Park, Myung-Il Roh, Min-Jae Oh, Seong-Hoon Kim, Won-Joon Lee, In-Il Kim, Chang-Yong Kim, "Estimation Model of Energy Efficiency Operational Indicator Using Public Data Based on Big Data Technology", Proceedings of ISOPE 2018, Sapporo, Japan
-
Sung-Min Lee, Myung-Il Roh, Ki-Su Kim, Seung-Ho Ham, Shin-Hyung Kim, Jin-Ho Hwang, "Lug Arrangement Design Based on the Optimization Technique and the Dynamic Analysis for Safe Block Lifting in Shipbuilding", Proceedings of ISOPE 2016, Rhodes, Greece
