Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
International Journal
2017.03.31 11:07
Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
조회 수 221
첨부 '1' |
---|
Abstract | Recently, the amount of data to be processed and the complexity thereof have been increasing due to the development of information and communication technology, and industry’s interest in such big data is increasing day by day. In the shipbuilding and offshore industry also, there is growing interest in the effective utilization of data, since various and vast amounts of data are being generated in the process of design, production, and operation. In order to effectively utilize big data in the shipbuilding and offshore industry, it is necessary to store and process large amounts of data. In this study, it was considered efficient to apply Hadoop and R, which are mostly used in big data related research. Hadoop is a framework for storing and processing big data. It provides the Hadoop Distributed File System (HDFS) for storing big data, and the MapReduce function for processing. Meanwhile, R provides various data analysis techniques through the language and environment for statistical calculation and graphics. While Hadoop makes it is easy to handle big data, it is difficult to finely process data; and although R has advanced analysis capability, it is difficult to use to process large data. This study proposes a big data platform based on Hadoop for applications in the shipbuilding and offshore industry. The proposed platform includes the existing data of the shipyard, and makes it possible to manage and process the data. To check the applicability of the platform, it is applied to estimate the weights of offshore structure topsides. In this study, we store data of existing FPSOs in Hadoop-based Hortonworks Data Platform (HDP), and perform regression analysis using RHadoop. We evaluate the effectiveness of large data processing by RHadoop by comparing the results of regression analysis and the processing time, with the results of using the conventional weight estimation program. |
---|---|
Publication Date | 2017-03-01 |
Role | Corresponding Author |
Category | Others |
Prev Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Arrangement Method ...
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Arrangement Method ...
2016.10.20by SyDLab
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Evaluation of Feasi... Next
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Evaluation of Feasi...
2016.11.29by SyDLab
-
Seung-Ho Ham, Myung-Il Roh, Luman Zhao, "Integrated Method of Analysis, Visualization, and Hardware for Ship Motion Simulation", Journal of Computational Design and Engineering, Vol. 5, No. 3, pp. 285-298, 2018.07.01
CategoryInternational Journal -
Luman Zhao, Myung-Il Roh, Seung-Ho Ham, "Anti-Sway Control of the Crane on an Offshore Support Vessel Based on the Hardware-In-The-Loop Simulation", International Journal of Offshore and Polar Engineering, Vol. 28, No. 2, pp. 182-189, 2018.06.01
CategoryInternational Journal -
Sung-Min Lee, Myung-Il Roh, Ki-Su Kim, Hoe-Ryong Jung, Jong-Jin Park, "Method for a Simultaneous Determination of the Path and the Speed for Ship Route Planning Problems", Ocean Engineering, Vol. 157, pp. 301-312, 2018.06.01
CategoryInternational Journal -
Sung-Min Lee, Myung-Il Roh, Ki-Su Kim, Seung-Ho Ham, "Optimum Design of Lug Arrangement Based on Static and Dynamic Analyses for Block Lifting", Journal of Ship Production and Design, Vol. 34, No. 2, pp. 119-133, 2018.05.01
CategoryInternational Journal -
Sun-Kyung Jung, Myung-Il Roh, Ki-Su Kim, "Arrangement Method of a Naval Surface Ship Considering Stability, Operability, and Survivability", Ocean Engineering, Vol. 152, pp. 316-333, 2018.02.23
CategoryInternational Journal -
Ki-Su Kim, Myung-Il Roh, Sung-Min Lee, Han-Sung Kim, Hyunsik Ahn, "Weight-estimation Method of FPSO Topsides Considering the Work Breakdown Structure", Journal of Offshore Mechanics and Arctic Engineering, Vol. 40, No. 1, pp. 1-10, 2018.02.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, Jin-Wuk Hong, Hong-Rae Lee, "Development and Validation of a Simulation-based Safety Evaluation Program for a Mega Floating Crane", Advances In Engineering Software, Vol. 112, pp. 101-116, 2017.10.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Jung-Woo Hong, “Dynamic Effect of a Flexible Riser in a Fully Connected Semisubmersible Drilling Rig Using the Absolute Nodal Coordinate Formulation”, Journal of Offshore Mechanics and Arctic Engineering, 2017.10.01
CategoryInternational Journal -
Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, “Case Study of Detection and Maneuvering Performance of Naval Ships Using Engagement Simulation of Engineering Level”, Ocean Systems Engineering, Vol. 7, No. 3, pp. 247-273, 2017.09.01
CategoryInternational Journal -
Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, Chan-Young Lee, “Performance Analyses of Naval Ships Based on Engineering Level of Simulation at the Initial Design Stage”, IJNAOE, Vol. 9, No. 4, pp. 446-459, 2017.07.01
CategoryInternational Journal -
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Arrangement Method of Offshore Topside Based on an Expert System and Optimization Technique”, Journal of Offshore Mechanics and Arctic Engineering, Vol. 139, No. 2, pp. 1-19, 2017.04.01
CategoryInternational Journal -
Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
CategoryInternational Journal -
Sung-Kyoon Kim, Myung-Il Roh, Ki-Su Kim, “Evaluation of Feasibility Index in the Arrangement Design of an Offshore Topside based on the Automatic Transformation of Experts’ Knowledge and the Fuzzy Logic”, Ocean Engineering, Vol. 130, 2017.01.15
CategoryInternational Journal -
Ju-Sung Kim, Myung-Il Roh, Seung-Ho Ham, “A Method for Intermediate Flooding and Sinking Simulation of a Damaged Floater in Time Domain”, Journal of Computational Design and Engineering, Vol. 4, No. 1, pp. 1-13, 2017.01.01
CategoryInternational Journal -
Sol Ha, Tae-Sub Um, Myung-Il Roh, Hyun-Kyoung Shin, “A Structural Weight Estimation Model of FPSO Topsides Using an Improved Genetic Programming Method”, Ships and Offshore Structures, Vol. 12, No. 1, pp. 43-55, 2017.01.01
CategoryInternational Journal -
John-Kyu Hwang, Myung-Il Roh, Ju-Hwan Cha, “Design Modification of a Damaged Free-Fall Lifeboat for FPSO Through Free-Fall Tests”, International Journal of Offshore and Polar Engineering, Vol. 26, No. 4, pp. 417-422, 2016.12.01
CategoryInternational Journal -
Sol Ha, Seong-Ho Seo, Myung-Il Roh, Hyun-Kyoung Shin, "Simplified Nonlinear Model for the Weight Estimation of FPSO Plant Topside Using the Statistical Method", Ships and Offshore Structures, Vol. 11, No. 6, pp. 603-619, 2016.09.01
CategoryInternational Journal -
Jeong-Woo Hong, Myung-Il Roh, Seung-Ho Ham, Sol Ha, "Dynamic Simulation of Subsea Equipment Installation Using an Offshore Support Vessel Based on Flexible Multibody System Dynamics", Journal of Marine Science and Technology (Taiwan), Vol. 24, No. 4
CategoryInternational Journal -
Ki-Su Kim, Myung-Il Roh, "A Submarine Arrangement Design Program Based on the Expert System and the Multistage Optimization", Advances In Engineering Software, Vol. 98, No. 97-111, 2016.08.01
CategoryInternational Journal -
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Block Turnover Simulation Considering the Interferences between the Block and Wire Ropes in Shipbuilding", Automation in Construction, Vol. 67, pp. 60-75, 2016.07.01
CategoryInternational Journal