Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
International Journal
2017.03.31 11:07
Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
조회 수 232
첨부 '1' |
---|
Abstract | Recently, the amount of data to be processed and the complexity thereof have been increasing due to the development of information and communication technology, and industry’s interest in such big data is increasing day by day. In the shipbuilding and offshore industry also, there is growing interest in the effective utilization of data, since various and vast amounts of data are being generated in the process of design, production, and operation. In order to effectively utilize big data in the shipbuilding and offshore industry, it is necessary to store and process large amounts of data. In this study, it was considered efficient to apply Hadoop and R, which are mostly used in big data related research. Hadoop is a framework for storing and processing big data. It provides the Hadoop Distributed File System (HDFS) for storing big data, and the MapReduce function for processing. Meanwhile, R provides various data analysis techniques through the language and environment for statistical calculation and graphics. While Hadoop makes it is easy to handle big data, it is difficult to finely process data; and although R has advanced analysis capability, it is difficult to use to process large data. This study proposes a big data platform based on Hadoop for applications in the shipbuilding and offshore industry. The proposed platform includes the existing data of the shipyard, and makes it possible to manage and process the data. To check the applicability of the platform, it is applied to estimate the weights of offshore structure topsides. In this study, we store data of existing FPSOs in Hadoop-based Hortonworks Data Platform (HDP), and perform regression analysis using RHadoop. We evaluate the effectiveness of large data processing by RHadoop by comparing the results of regression analysis and the processing time, with the results of using the conventional weight estimation program. |
---|---|
Publication Date | 2017-03-01 |
Role | Corresponding Author |
Category | Others |
-
Sung-Woo Park, Myung-Il Roh, Min-Jae Oh, Seong-Hoon Kim, "Association Analysis of Piping Materials of an Offshore Structure Using Big Data Technology", Journal of Ship Production and Design, Vol. 35, No. 3, pp. 220-230, 2019.08.01
CategoryInternational Journal -
Min-Jae Oh, Myung-Il Roh, Tae-Wan Kim, "Local T-spline Surface Skinning with Shape Preservation", Computer-Aided Design, Vol. 104, pp. 15-26, 2018.11.01
CategoryInternational Journal -
Sung-Min Lee, Myung-Il Roh, Ki-Su Kim, Hoe-Ryong Jung, Jong-Jin Park, "Method for a Simultaneous Determination of the Path and the Speed for Ship Route Planning Problems", Ocean Engineering, Vol. 157, pp. 301-312, 2018.06.01
CategoryInternational Journal -
Sun-Kyung Jung, Myung-Il Roh, Ki-Su Kim, "Arrangement Method of a Naval Surface Ship Considering Stability, Operability, and Survivability", Ocean Engineering, Vol. 152, pp. 316-333, 2018.02.23
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Luman Zhao, "Integrated Method of Analysis, Visualization, and Hardware for Ship Motion Simulation", Journal of Computational Design and Engineering, Vol. 5, No. 3, pp. 285-298, 2018.07.01
CategoryInternational Journal -
Luman Zhao, Myung-Il Roh, Seung-Ho Ham, "Anti-Sway Control of the Crane on an Offshore Support Vessel Based on the Hardware-In-The-Loop Simulation", International Journal of Offshore and Polar Engineering, Vol. 28, No. 2, pp. 182-189, 2018.06.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Ju-Sung Kim, "Numerical Analysis of Wreck Removal Based on Multibody System Dynamics", Journal of Marine Science and Technology, Vol. 23, No. 3, pp. 521-535, 2018.09.01
CategoryInternational Journal -
Ki-Su Kim, Myung-Il Roh, Sung-Min Lee, Han-Sung Kim, Hyunsik Ahn, "Weight-estimation Method of FPSO Topsides Considering the Work Breakdown Structure", Journal of Offshore Mechanics and Arctic Engineering, Vol. 40, No. 1, pp. 1-10, 2018.02.01
CategoryInternational Journal -
Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, “Case Study of Detection and Maneuvering Performance of Naval Ships Using Engagement Simulation of Engineering Level”, Ocean Systems Engineering, Vol. 7, No. 3, pp. 247-273, 2017.09.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Jung-Woo Hong, “Dynamic Effect of a Flexible Riser in a Fully Connected Semisubmersible Drilling Rig Using the Absolute Nodal Coordinate Formulation”, Journal of Offshore Mechanics and Arctic Engineering, 2017.10.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, Jin-Wuk Hong, Hong-Rae Lee, "Development and Validation of a Simulation-based Safety Evaluation Program for a Mega Floating Crane", Advances In Engineering Software, Vol. 112, pp. 101-116, 2017.10.01
CategoryInternational Journal -
Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
CategoryInternational Journal -
Sung-Min Lee, Myung-Il Roh, Ki-Su Kim, Seung-Ho Ham, "Optimum Design of Lug Arrangement Based on Static and Dynamic Analyses for Block Lifting", Journal of Ship Production and Design, Vol. 34, No. 2, pp. 119-133, 2018.05.01
CategoryInternational Journal -
Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, Chan-Young Lee, “Performance Analyses of Naval Ships Based on Engineering Level of Simulation at the Initial Design Stage”, IJNAOE, Vol. 9, No. 4, pp. 446-459, 2017.07.01
CategoryInternational Journal -
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Evaluation of Feasibility Index in the Arrangement Design of an Offshore Topside based on the Automatic Transformation of Experts’ Knowledge and the Fuzzy Logic”, Ocean Engineering, Vol. 130, 2017.01.15
CategoryInternational Journal -
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Arrangement Method of Offshore Topside Based on an Expert System and Optimization Technique”, Journal of Offshore Mechanics and Arctic Engineering, Vol. 139, No. 2, pp. 1-19, 2017.04.01
CategoryInternational Journal -
Ju-Sung Kim, Myung-Il Roh, Seung-Ho Ham, “A Method for Intermediate Flooding and Sinking Simulation of a Damaged Floater in Time Domain”, Journal of Computational Design and Engineering, Vol. 4, No. 1, pp. 1-13, 2017.01.01
CategoryInternational Journal -
John-Kyu Hwang, Myung-Il Roh, Ju-Hwan Cha, “Design Modification of a Damaged Free-Fall Lifeboat for FPSO Through Free-Fall Tests”, International Journal of Offshore and Polar Engineering, Vol. 26, No. 4, pp. 417-422, 2016.12.01
CategoryInternational Journal -
Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, "Lifting Simulation of an Offshore Supply Vessel Considering Various Operating Conditions", Advances in Mechanical Engineering, Vol. 8, No. 6, pp. 1-13, 2016.06.16
CategoryInternational Journal -
Ki-Su Kim, Myung-Il Roh, "A Submarine Arrangement Design Program Based on the Expert System and the Multistage Optimization", Advances In Engineering Software, Vol. 98, No. 97-111, 2016.08.01
CategoryInternational Journal