Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
International Journal
2017.03.31 11:07
Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
조회 수 236
첨부 '1' |
---|
Abstract | Recently, the amount of data to be processed and the complexity thereof have been increasing due to the development of information and communication technology, and industry’s interest in such big data is increasing day by day. In the shipbuilding and offshore industry also, there is growing interest in the effective utilization of data, since various and vast amounts of data are being generated in the process of design, production, and operation. In order to effectively utilize big data in the shipbuilding and offshore industry, it is necessary to store and process large amounts of data. In this study, it was considered efficient to apply Hadoop and R, which are mostly used in big data related research. Hadoop is a framework for storing and processing big data. It provides the Hadoop Distributed File System (HDFS) for storing big data, and the MapReduce function for processing. Meanwhile, R provides various data analysis techniques through the language and environment for statistical calculation and graphics. While Hadoop makes it is easy to handle big data, it is difficult to finely process data; and although R has advanced analysis capability, it is difficult to use to process large data. This study proposes a big data platform based on Hadoop for applications in the shipbuilding and offshore industry. The proposed platform includes the existing data of the shipyard, and makes it possible to manage and process the data. To check the applicability of the platform, it is applied to estimate the weights of offshore structure topsides. In this study, we store data of existing FPSOs in Hadoop-based Hortonworks Data Platform (HDP), and perform regression analysis using RHadoop. We evaluate the effectiveness of large data processing by RHadoop by comparing the results of regression analysis and the processing time, with the results of using the conventional weight estimation program. |
---|---|
Publication Date | 2017-03-01 |
Role | Corresponding Author |
Category | Others |
-
Sol Ha, Nam-Kug Ku, Myung-Il Roh, "Event-based Scenario Manager for Multibody Dynamics Simulation of Heavy Load Lifting Operations in Shipyards", International Journal of Naval Architecture and Ocean Engineering, Vol. 8, No. 1, pp. 83-101, 2016.01.01
CategoryInternational Journal -
Sol Ha, Ju-Hwan Cha, Myung-Il Roh, Kyu-Yeul Lee, "Implementation of the Submarine Diving Simulation in a Distributed Environment", International Journal of Naval Architecture and Ocean Engineering, Vol. 4, No. 3, pp. 211-227, 2012.09.01
CategoryInternational Journal -
Seung-Min Lee, Jong-Hyeok Lee, Myung-Il Roh, Ki-Su Kim, Seung-Ho Ham, Hye-Won Lee, "An Optimization Model of Tugboat Operation for Conveying a Large Surface Vessel", Journal of Computational Design and Engineering, Vol. 8, No. 2, 2021.04.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, “Time-domain Structural Analysis During Block Turnover and Lifting Using 2D Flexible Multibody Dynamics”, Marine Structures, Vol. 75, pp. 102841.1-26, 2021.01.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Luman Zhao, "Integrated Method of Analysis, Visualization, and Hardware for Ship Motion Simulation", Journal of Computational Design and Engineering, Vol. 5, No. 3, pp. 285-298, 2018.07.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Jung-Woo Hong, “Dynamic Effect of a Flexible Riser in a Fully Connected Semisubmersible Drilling Rig Using the Absolute Nodal Coordinate Formulation”, Journal of Offshore Mechanics and Arctic Engineering, 2017.10.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Ju-Sung Kim, "Numerical Analysis of Wreck Removal Based on Multibody System Dynamics", Journal of Marine Science and Technology, Vol. 23, No. 3, pp. 521-535, 2018.09.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, Sol Ha, "Multibody Dynamic Analysis of a Heavy Load Suspended by a Floating Crane with Constraint-based Wire Rope", Ocean Engineering, Vol. 109, pp. 145-160, 2015.11.15
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, Jin-Wuk Hong, Hong-Rae Lee, "Development and Validation of a Simulation-based Safety Evaluation Program for a Mega Floating Crane", Advances In Engineering Software, Vol. 112, pp. 101-116, 2017.10.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, "Collision Detection and Response of Multibody Systems Using a Position Difference Method and Non-Interpenetration Constraint in Shipbuilding Simulation", Ocean Engineering, Vol. 195, pp. 1-18, 2020.01.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, "Dynamic Analysis of Block Offloading Using Self-propelled Modular Transporters", Automation in Construction, Vol. 96, pp. 411-432, 2018.12.01
CategoryInternational Journal -
Seung-Ho Ham, Myung-Il Roh, Hye-Won Lee, "Simulation of Load Lifting with Equalizers Used in Shipyards", Automation in Construction, Vol. 61, pp. 98-111, 2016.02.01
CategoryInternational Journal -
Seong-Hoon Kim, Myung-Il Roh, Min-Jae Oh, Sung-Woo Park, "Estimation of Ship Operational Efficiency from AIS Data Using Big Data Technology", IJNAOE, Vol. 12, pp. 440-453, 2020.05.21
CategoryInternational Journal -
Seong-Hoon Kim, Myung-Il Roh, Ki-Su Kim, Min-Jae Oh, “Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside”, Journal of Advanced Research in Ocean Engineering, Vol. 3, No. 1, pp. 32-40, 2017.03.01
CategoryInternational Journal -
Sang-Uk Lee, Myung-Il Roh, Ju-Hwan Cha, Kyu-Yeul Lee, "Ship Compartment Modeling Based On a Non-manifold Polyhedron Modeling Kernel", Advances In Engineering Software, Vol. 40, No. 5, pp. 378-388, 2009.05.01
CategoryInternational Journal -
Sang-Hyun Lee, Myung-Il Roh, Min-Jae Oh, Ki-Su Kim, "Optimal Layout Design of an LNG FPSO: A Case Study", Journal of Offshore Mechanics and Arctic Engineering, Vol. 142, No. 041403, pp. 1-17, 2020.08.01
CategoryInternational Journal -
Nam-Kug Ku, Sol Ha, Myung-Il Roh, "Design of Controller for Mobile Robot in Welding Process of Shipbuilding Engineering", Journal of Computational Design and Engineering, Vol. 1, No. 4, pp. 243-255, 2014.10.01
CategoryInternational Journal -
Nam-Kug Ku, Sol Ha, Myung-Il Roh, "Crane Modeling and Simulation in Offshore Structure Building Industry", International Journal of Computer Theory and Engineering, Vol. 6, No. 3, pp. 278-284, 2014.06.01
CategoryInternational Journal -
Nam-Kug Ku, Myung-Il Roh, "Dynamic Response Simulation of an Offshore Wind Turbine Suspended by a Floating Crane", Ships and Offshore Structures, Vol. 10, No. 6, pp. 621-634, 2015.11.01
CategoryInternational Journal -
Nam-Kug Ku, Ju-Hwan Cha, Myung-Il Roh, Kyu-Yeul Lee, "A Tagline Proportional-Derivative Control Method for the Anti-Swing Motion of a Heavy Load Suspended by a Floating Crane in Waves", Journal of Engineering for the Maritime Environment, Vol. 227, No. 4, pp. 357-366, 2013.11.01
CategoryInternational Journal