Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
International Journal
2017.03.31 11:07
Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
조회 수 324
| 첨부 '1' |
|---|
| Abstract | Recently, the amount of data to be processed and the complexity thereof have been increasing due to the development of information and communication technology, and industry’s interest in such big data is increasing day by day. In the shipbuilding and offshore industry also, there is growing interest in the effective utilization of data, since various and vast amounts of data are being generated in the process of design, production, and operation. In order to effectively utilize big data in the shipbuilding and offshore industry, it is necessary to store and process large amounts of data. In this study, it was considered efficient to apply Hadoop and R, which are mostly used in big data related research. Hadoop is a framework for storing and processing big data. It provides the Hadoop Distributed File System (HDFS) for storing big data, and the MapReduce function for processing. Meanwhile, R provides various data analysis techniques through the language and environment for statistical calculation and graphics. While Hadoop makes it is easy to handle big data, it is difficult to finely process data; and although R has advanced analysis capability, it is difficult to use to process large data. This study proposes a big data platform based on Hadoop for applications in the shipbuilding and offshore industry. The proposed platform includes the existing data of the shipyard, and makes it possible to manage and process the data. To check the applicability of the platform, it is applied to estimate the weights of offshore structure topsides. In this study, we store data of existing FPSOs in Hadoop-based Hortonworks Data Platform (HDP), and perform regression analysis using RHadoop. We evaluate the effectiveness of large data processing by RHadoop by comparing the results of regression analysis and the processing time, with the results of using the conventional weight estimation program. |
|---|---|
| Publication Date | 2017-03-01 |
| Role | Corresponding Author |
| Category | Others |
-
Luman Zhao, Myung-Il Roh, “A Thrust Allocation Method for Efficient Dynamic Positioning of a Semisubmersible Drilling Rig Based on the Hybrid Optimization Algorithm”, Mathematical Problems in Engineering, Vol. 2015, pp. 1-12, 2015.10.01
-
Min-Chul Kong, Myung-Il Roh, Ki-Su Kim, Ho-Gyun Park, Jong-Oh Kim, "Variable Indexing Method in Rule Documents for Ship Design Using Extraction of PDF Elements", Journal of Computational Design and Engineering, Vol. 9, No. 6, 2022.11.16
-
Min-Chul Kong, Myung-Il Roh, Ki-Su Kim, Jeongyoul Lee, Jongoh Kim, Gapheon Lee, "Object Detection Method for Ship Safety Plans Using Deep Learning", Ocean Engineering, 2022.02.15
-
Min-Jae Oh, Myung-Il Roh, Sung-Woo Park, Do-Hyun Chun, Myeong-Jo Son, Jeong-Youl Lee, “Operational Analysis of Container Ships by Using Maritime Big Data”, Journal of Marine Science and Engineering, Vol. 9, No. 4, pp. 438: 1-21, 2021.04.18
-
Min-Jae Oh, Myung-Il Roh, Sung-Woo Park, Do-Hyun Chun, Se-Hyun Myung, "Big Data-based Piping Material Analysis Framework in Offshore Structure for Contract Design", Ocean Systems Engineering, Vol. 9, No. 1, pp. 79-95, 2019.01.01
-
Min-Jae Oh, Myung-Il Roh, Tae-Wan Kim, "Local T-spline Surface Skinning with Shape Preservation", Computer-Aided Design, Vol. 104, pp. 15-26, 2018.11.01
-
Min-Jae Oh, Taw-Wan Kim, Myung-Il Roh, "G1 Bezier Surface Interpolation with T-junctions at a 3-Valent Singular Vertex", Computer Aided Geometric Design, Vol. 67, pp. 79-95, 2018.12.01
-
Myung-Il Roh, "Block Layout Method in the Block Stockyard Based on the Genetic Algorithm", Ocean Systems Engineering, Vol. 2, No. 4, pp. 271-287, 2012.12.01
-
Myung-Il Roh, "Determination of an Economical Shipping Route Considering the Effects of Sea State for Lower Fuel Consumption", International Journal of Naval Architecture and Ocean Engineering, Vol. 5, No. 2, pp. 246-262, 2013.06.01
-
Myung-Il Roh, Ju-Hwan Cha, "A Block Transportation Scheduling System Considering a Minimization of Travel Distance without Loading of and Interference between Multiple Transporters", International Journal of Production Research, Vol. 49, No. 11, pp. 3231-3250, 2011.06.01
-
Myung-Il Roh, Kyu-Yeul Lee, "An Initial Hull Structural Modeling System for Computer-Aided Process Planning in Shipbuilding", Advances In Engineering Software, Vol. 37, No. 7, pp. 457-476, 2006.07.01
-
Myung-Il Roh, Kyu-Yeul Lee, "Development of a 3D CAD System for Modeling Hull Structure at the Initial Ship Design Stage", Ships and Offshore Structures, Vol. 1, No. 2, pp. 135-151, 2006.04.01
-
Myung-Il Roh, Kyu-Yeul Lee, "Generation of the 3D CAD Model of the Hull Structure at the Initial Ship Design Stage and Its Application", Computers in Industry, Vol. 58, No. 6, pp. 539-557, 2007.08.01
-
Myung-Il Roh, Kyu-Yeul Lee, "Generation of the Production Material Information of a Building Block and Simulation of the Block Erection for Computer-Aided Process Planning and Scheduling in Shipbuilding", International Journal of Production Research, Vol. 45, No. 20, pp. 4653-4683, 2007.10.01
-
Myung-Il Roh, Kyu-Yeul Lee, "Optimal Scheduling of Block Lifting in Consideration of the Minimization of Traveling Distance While Unloaded and Wire and Shackle Replacement of a Gantry Crane", Journal of Marine Science and Technology, Vol. 15, No. 2, pp. 190-200, 2010.06.01
-
Myung-Il Roh, Kyu-Yeul Lee, Seong-Jin Yoo, "An Algorithm for Generating the Hull Structural Analysis Model Using the Seam Information of the Hull Structure at the Initial Design Stage", Journal of Ship and Ocean Technology, Vol. 10, No. 4, pp. 24-33, 2006.12.01
-
Myung-Il Roh, Kyu-Yeul Lee, Woo-Young Choi, "Rapid Generation of the Piping Model Having the Relationship with a Hull Structure in Shipbuilding", Advances In Engineering Software, Vol. 38, No. 4, pp. 215-228, 2007.04.01
-
Myung-Il Roh, Kyu-Yeul Lee, Woo-Young Choi, Seong-Jin Yoo, "Improvement of Ship Design Practice Using a 3D CAD Model of a Hull Structure", Robotics and Computer-Integrated Manufacturing Journal, Vol. 24, No. 1, pp. 105-124, 2008.02.01
-
Myung-Il Roh, Sol Ha, "Advanced Ship Evacuation Analysis Using a Cell-Based Simulation Model", Computers In Industry, Vol. 64, No. 1, pp. 80-89, 2013.01.01
-
Nam-Kug Ku, Ara Jo, Sol Ha, Myung-Il Roh, Kyu-Yeul Lee, "Automatic Generation of Equations of Motion for Multibody System in Discrete Event Simulation Framework", Procedia Technology, Vol. 1, No. 1, pp. 55-64, 2012.02.01
