Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "A Block Lifting Method with Wire Ropes Based on Deep Reinforcement Learning", Proceedings of ICDM(International Conference on Decarbonization and Digitalization in Marine Engineering) 2022, Si-Heung, Korea, 2022.04.28-29
International Conference
2022.04.29 15:53
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "A Block Lifting Method with Wire Ropes Based on Deep Reinforcement Learning", Proceedings of ICDM 2022, Si-Heung, Korea, 2022.04.28-29
조회 수 165
Abstract | The block erection using a gantry crane is an important process for the production of the ships in a shipyard. The motion of the block should be controlled accurately under the external forces to prevent collision with the structures and the excessive loads on wire ropes. However, it is difficult to control the block during the lifting because the movement of the block is indirectly controlled with various objects such as trolleys, hooks, equalizers, and wire ropes. Therefore, we proposed the Deep Reinforcement Learning (DRL)-based block lifting method in this study. The DRL-based block lifting method can control the block under the change of the center of gravity and modelling uncertainty. Furthermore, the DRL-based block lifting method can provide robust control with an unexpected motion of the block due to the unexpected external disturbance. The position, orientation and angular velocity of the block and hoisting speed of wire ropes were set as the input state of the neural network of DRL. The hosting speed of wire ropes was controlled as the output action of DRL. The functions to minimize the change of orientation and to stabilize the speed of the block were set as the reward of DRL. In this study, the deep deterministic policy gradient (DDPG) method of DRL, which is a kind of off-policy actor-critic method, was applied to solve the problem with continuous state space and continuous multi-action space. To verify the DRL-based block lifting method proposed in this study, it was compared with traditional control algorithms for various simulation examples. As a result, the proposed method could effectively control the block with the modelling uncertainty. Also, the proposed method could respond to the unexpected motion of the block effectively due to the unexpected external disturbance. |
---|---|
Publication Date | 2022-04-28 |
-
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Toward Advanced Mooring Analysis of a Floating Crane Based on Flexible Multibody Dynamics", Proceedings of SUTTC(The Society for Underwater Technology Technical Conference) 2017, Haikou, China, 2017.11.23-24
CategoryInternational Conference -
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Ship Mooring Design Based on Flexible Multibody Dynamics", Proceedings of the 13th IMDC, Helsinki, Finland, pp. 563-566, 2018.06.10-14
CategoryInternational Conference -
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Modeling of a Mooring System Based on Flexible Multibody Dynamics Considering Contact with Seabed", Proceedings of the 9th ACMD 2018, Xian, China, 2018.08.19-23
CategoryInternational Conference -
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Method for the Accurate and Automatic Operation of Offshore Floating Cranes for the Block Erection in Shipyards", Proceedings of OMAE 2020, Held in Virtual Conference, 2020.08.03-07
CategoryInternational Conference -
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Control of the Underactuated Gantry Crane for the Block Erection Operation in the Shipyard", MIM 2019, Berlin, Germany, 2019.08.28-30
CategoryInternational Conference -
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Collision Analysis of Block Erection by a Floating Crane", Proceedings of ACDDE 2016, Jeju, Korea, 2016.10.25-28
CategoryInternational Conference -
Hye-Won Lee, Myung-Il Roh, Seung-Ho Ham, "Dynamics-based Collision Analysis for Block Erection in Shipyard", Proceedings of the 30th Asian-Pacific TEAM 2016, Mokpo, Korea, 2016.10.10-13
CategoryInternational Conference -
Hye-Won Lee, Myung-Il Roh, Luman Zhao, Seung-Ho Ham, Nakwan Kim, Chan-Woo Yu, "Integrated Development Environment Of Autonomic Software for USV (Unmanned Surface Vehicle) Based on Ros (Robot Operating System)", Proceedings of ICCAS 2017, Singapore
CategoryInternational Conference -
Hye-Won Lee, Myung-Il Roh, Ki-Su Kim, Kuk-Jin Kang, Seong-Yeob Jung, "Arctic Sea Route Planning Based on POLARIS Rule", Proceedings of ISOPE 2019, Honolulu, Hawaii, pp. 875-877, 2019.06.16-21
CategoryInternational Conference -
Dong-Hoon Jeong, Myung-Il Roh, Seung-Ho Ham, Woo-Young Choi, Chan-Young Lee, Kyung-Min Seo, Dong-Chul Lee, "Simulation-Based Performances Analysis for Naval Ships at the Initial Design Stage", Proceedings of ISOPE 2016, Rhodes, Greece
CategoryInternational Conference