Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "A Block Lifting Method with Wire Ropes Based on Deep Reinforcement Learning", Proceedings of ICDM(International Conference on Decarbonization and Digitalization in Marine Engineering) 2022, Si-Heung, Korea, 2022.04.28-29
International Conference
2022.04.29 15:53
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "A Block Lifting Method with Wire Ropes Based on Deep Reinforcement Learning", Proceedings of ICDM 2022, Si-Heung, Korea, 2022.04.28-29
조회 수 165
| Abstract | The block erection using a gantry crane is an important process for the production of the ships in a shipyard. The motion of the block should be controlled accurately under the external forces to prevent collision with the structures and the excessive loads on wire ropes. However, it is difficult to control the block during the lifting because the movement of the block is indirectly controlled with various objects such as trolleys, hooks, equalizers, and wire ropes. Therefore, we proposed the Deep Reinforcement Learning (DRL)-based block lifting method in this study. The DRL-based block lifting method can control the block under the change of the center of gravity and modelling uncertainty. Furthermore, the DRL-based block lifting method can provide robust control with an unexpected motion of the block due to the unexpected external disturbance. The position, orientation and angular velocity of the block and hoisting speed of wire ropes were set as the input state of the neural network of DRL. The hosting speed of wire ropes was controlled as the output action of DRL. The functions to minimize the change of orientation and to stabilize the speed of the block were set as the reward of DRL. In this study, the deep deterministic policy gradient (DDPG) method of DRL, which is a kind of off-policy actor-critic method, was applied to solve the problem with continuous state space and continuous multi-action space. To verify the DRL-based block lifting method proposed in this study, it was compared with traditional control algorithms for various simulation examples. As a result, the proposed method could effectively control the block with the modelling uncertainty. Also, the proposed method could respond to the unexpected motion of the block effectively due to the unexpected external disturbance. |
|---|---|
| Publication Date | 2022-04-28 |
-
Jisang Ha, Myung-Il Roh, Ki-Su Kim, Min-Chul Kong, "Integrated Method for the Arrangement Design of a Ship for Implementing Digital Twin in Design", Proceedings of PRADS 2022, Dubrovnik, Croatia, 2022.10.09-13
-
Jisang Ha, Myung-Il Roh, Jong-Hyeok Lee, Jin-Hyeok Kim, Min-Chul Kong, Seung-Ho Ham, "Integrated Ship Remote Operating System Based on Digital Twin Technology", Proceedings of TEAM 2019, Tainan, Taiwan, pp. 106, 2019.10.14-17
-
Jisang Ha, Myung-Il Roh, Hye-Won Lee, Jong-Ho Eun, Jong-Jin Park, Hyun-Joe Kim, "A Method of the Collision Avoidance of a Ship Using Real-time AIS Data", Proceedings of ACSMO 2020, Seoul, Korea, pp. 106, 2020.11.23-25
-
Jin-Hyeok Kim, Myung-Il Roh, In-Chang Yeo, Ki-Su Kim, Min-Jae Oh, Sejin Oh, "Estimation Model of Hydrodynamic Performance Using Hull Form Variation and Deep Learning", Proceedings of PRADS 2022, Dubrovnik, Croatia, pp. 82, 2022.10.09-13
-
Jin-Hyeok Kim, Myung-Il Roh, In-Chang Yeo, Ki-Su Kim, "Estimation of the Hydrodynamic Performance of the Parameterized Hull Forms Using Deep Learning", Proceedings of G-NAOE 2022, Changwon, Korea, 2022.11.06-10
-
Ji-Hyun Hwang, Young-Joo Ahn, Joon-Ho Min, Gwang-No Lee, Ho-Jin Jeong, Mung-Yu Kim, Hee-Chang Kim, Myung-Il Roh, Kyu-Yeul Lee, "Application of an Integrated Basic Process Engineering Solution to Generic LNG FPSO Topsides", Proceedings of ISOPE 2009
-
Ji-Hyun Hwang, Nam-Kug Ku, Joon-Chae Lee, Myung-Il Roh, Kyu-Yeul Lee, "Optimal Synthesis of LNG FPSO Liquefaction Cycles", Proceedings of ISOPE(International Society of Offshore and Polar Engineers) 2012, Rhodes, Greece, pp. 927-935, 2012.06.17-22
-
Ji-Hyun Hwang, Ju-Hwan Cha, Seung-Ho Ham, Bo-Ram Kim, Myung-Il Roh, Kyu-Yeul Lee, "Establishment of Offshore Process FEED Method for Oil-Based FPSO Topsides Systems", Proceedings of ISOPE 2009, Osaka, Japan, pp. 144-150, 2009.06.21-26
-
Ji-Hyun Hwang, Joon-Ho Min, Young-Joo Ahn, Hee-Chang Kim, Myung-Il Roh, Kyu-Yeul Lee, "Optimized Methodology to Build an Integrated Solution to Offshore Topside Process Engineering", Proceedings of ISOPE 2008, Vancouver, Canada, 2008.07.06-11
-
Jeong-Woo Hong, Seung-Ho Ham, Luman Zhao, Xing Li, Sol Ha, Myung-Il Roh, "Offshore Installation of Subsea Equipment Considering Elasticity of the Crane Boom in Harsh Environment", Proceedings of ISOPE 2015, Hawaii, USA, 2014.06.21-26
