Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
International Journal
2017.03.31 11:07
Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
조회 수 817
| 첨부 '1' |
|---|
| Abstract | Recently, the amount of data to be processed and the complexity thereof have been increasing due to the development of information and communication technology, and industry’s interest in such big data is increasing day by day. In the shipbuilding and offshore industry also, there is growing interest in the effective utilization of data, since various and vast amounts of data are being generated in the process of design, production, and operation. In order to effectively utilize big data in the shipbuilding and offshore industry, it is necessary to store and process large amounts of data. In this study, it was considered efficient to apply Hadoop and R, which are mostly used in big data related research. Hadoop is a framework for storing and processing big data. It provides the Hadoop Distributed File System (HDFS) for storing big data, and the MapReduce function for processing. Meanwhile, R provides various data analysis techniques through the language and environment for statistical calculation and graphics. While Hadoop makes it is easy to handle big data, it is difficult to finely process data; and although R has advanced analysis capability, it is difficult to use to process large data. This study proposes a big data platform based on Hadoop for applications in the shipbuilding and offshore industry. The proposed platform includes the existing data of the shipyard, and makes it possible to manage and process the data. To check the applicability of the platform, it is applied to estimate the weights of offshore structure topsides. In this study, we store data of existing FPSOs in Hadoop-based Hortonworks Data Platform (HDP), and perform regression analysis using RHadoop. We evaluate the effectiveness of large data processing by RHadoop by comparing the results of regression analysis and the processing time, with the results of using the conventional weight estimation program. |
|---|---|
| Publication Date | 2017-03-01 |
| Role | Corresponding Author |
| Category | Others |
Prev Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Evaluation of Feasi...
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Evaluation of Feasi...
2016.11.29by SyDLab
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Arrangement Method ... Next
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Arrangement Method ...
2016.10.20by SyDLab
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, Sol Ha, "Dynamic Simulation of the Wireline Riser Tensioner System for a Mobile Offshore Drilling Unit Based on Multibody System Dynamics", Ocean Engineering, Vol. 106, pp. 485-495, 2015.09.15
-
Luman Zhao, Myung-Il Roh, “A Thrust Allocation Method for Efficient Dynamic Positioning of a Semisubmersible Drilling Rig Based on the Hybrid Optimization Algorithm”, Mathematical Problems in Engineering, Vol. 2015, pp. 1-12, 2015.10.01
-
Nam-Kug Ku, Myung-Il Roh, "Dynamic Response Simulation of an Offshore Wind Turbine Suspended by a Floating Crane", Ships and Offshore Structures, Vol. 10, No. 6, pp. 621-634, 2015.11.01
-
Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, Sol Ha, "Multibody Dynamic Analysis of a Heavy Load Suspended by a Floating Crane with Constraint-based Wire Rope", Ocean Engineering, Vol. 109, pp. 145-160, 2015.11.15
-
Ki-Su Kim, Myung-Il Roh, Sol Ha, "Expert System Based on the Arrangement Evaluation Model for the Arrangement Design of a Submarine", Expert Systems with Applications, Vol. 42, No. 22, pp. 8731-8744, 2015.12.01
-
Sol Ha, Nam-Kug Ku, Myung-Il Roh, "Event-based Scenario Manager for Multibody Dynamics Simulation of Heavy Load Lifting Operations in Shipyards", International Journal of Naval Architecture and Ocean Engineering, Vol. 8, No. 1, pp. 83-101, 2016.01.01
-
Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, "Simulation of Load Lifting with Equalizers Used in Shipyards", Automation in Construction, Vol. 61, pp. 98-111, 2016.02.01
-
Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, "Lifting Simulation of an Offshore Supply Vessel Considering Various Operating Conditions", Advances in Mechanical Engineering, Vol. 8, No. 6, pp. 1-13, 2016.06.16
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Block Turnover Simulation Considering the Interferences between the Block and Wire Ropes in Shipbuilding", Automation in Construction, Vol. 67, pp. 60-75, 2016.07.01
-
Jeong-Woo Hong, Myung-Il Roh, Seung-Ho Ham, Sol Ha, "Dynamic Simulation of Subsea Equipment Installation Using an Offshore Support Vessel Based on Flexible Multibody System Dynamics", Journal of Marine Science and Technology (Taiwan), Vol. 24, No. 4
-
Ki-Su Kim, Myung-Il Roh, "A Submarine Arrangement Design Program Based on the Expert System and the Multistage Optimization", Advances In Engineering Software, Vol. 98, No. 97-111, 2016.08.01
-
Sol Ha, Seong-Ho Seo, Myung-Il Roh, Hyun-Kyoung Shin, "Simplified Nonlinear Model for the Weight Estimation of FPSO Plant Topside Using the Statistical Method", Ships and Offshore Structures, Vol. 11, No. 6, pp. 603-619, 2016.09.01
-
John-Kyu Hwang, Myung-Il Roh, Ju-Hwan Cha, “Design Modification of a Damaged Free-Fall Lifeboat for FPSO Through Free-Fall Tests”, International Journal of Offshore and Polar Engineering, Vol. 26, No. 4, pp. 417-422, 2016.12.01
-
Ju-Sung Kim, Myung-Il Roh, Seung-Ho Ham, “A Method for Intermediate Flooding and Sinking Simulation of a Damaged Floater in Time Domain”, Journal of Computational Design and Engineering, Vol. 4, No. 1, pp. 1-13, 2017.01.01
-
Sol Ha, Tae-Sub Um, Myung-Il Roh, Hyun-Kyoung Shin, “A Structural Weight Estimation Model of FPSO Topsides Using an Improved Genetic Programming Method”, Ships and Offshore Structures, Vol. 12, No. 1, pp. 43-55, 2017.01.01
-
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Evaluation of Feasibility Index in the Arrangement Design of an Offshore Topside based on the Automatic Transformation of Experts’ Knowledge and the Fuzzy Logic”, Ocean Engineering, Vol. 130, 2017.01.15
-
Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
-
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Arrangement Method of Offshore Topside Based on an Expert System and Optimization Technique”, Journal of Offshore Mechanics and Arctic Engineering, Vol. 139, No. 2, pp. 1-19, 2017.04.01
-
Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, Chan-Young Lee, “Performance Analyses of Naval Ships Based on Engineering Level of Simulation at the Initial Design Stage”, IJNAOE, Vol. 9, No. 4, pp. 446-459, 2017.07.01
-
Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, “Case Study of Detection and Maneuvering Performance of Naval Ships Using Engagement Simulation of Engineering Level”, Ocean Systems Engineering, Vol. 7, No. 3, pp. 247-273, 2017.09.01
