Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "A Block Lifting Method with Wire Ropes Based on Deep Reinforcement Learning", Proceedings of ICDM(International Conference on Decarbonization and Digitalization in Marine Engineering) 2022, Si-Heung, Korea, 2022.04.28-29
International Conference
2022.04.29 15:53
Do-Hyun Chun, Myung-Il Roh, Hye-Won Lee, Seung-Ho Ham, "A Block Lifting Method with Wire Ropes Based on Deep Reinforcement Learning", Proceedings of ICDM 2022, Si-Heung, Korea, 2022.04.28-29
조회 수 165
| Abstract | The block erection using a gantry crane is an important process for the production of the ships in a shipyard. The motion of the block should be controlled accurately under the external forces to prevent collision with the structures and the excessive loads on wire ropes. However, it is difficult to control the block during the lifting because the movement of the block is indirectly controlled with various objects such as trolleys, hooks, equalizers, and wire ropes. Therefore, we proposed the Deep Reinforcement Learning (DRL)-based block lifting method in this study. The DRL-based block lifting method can control the block under the change of the center of gravity and modelling uncertainty. Furthermore, the DRL-based block lifting method can provide robust control with an unexpected motion of the block due to the unexpected external disturbance. The position, orientation and angular velocity of the block and hoisting speed of wire ropes were set as the input state of the neural network of DRL. The hosting speed of wire ropes was controlled as the output action of DRL. The functions to minimize the change of orientation and to stabilize the speed of the block were set as the reward of DRL. In this study, the deep deterministic policy gradient (DDPG) method of DRL, which is a kind of off-policy actor-critic method, was applied to solve the problem with continuous state space and continuous multi-action space. To verify the DRL-based block lifting method proposed in this study, it was compared with traditional control algorithms for various simulation examples. As a result, the proposed method could effectively control the block with the modelling uncertainty. Also, the proposed method could respond to the unexpected motion of the block effectively due to the unexpected external disturbance. |
|---|---|
| Publication Date | 2022-04-28 |
-
Luman Zhao, Myung-Il Roh, Seung-Ho Ham, "Anti-sway Control of the Crane on an Offshore Support Vessel Based on the Hardware-In-the-Loop Simulation", Proceedings of ISOPE 2017, San Francisco, USA, pp. 651-654, 2017.06.25-30
-
Luman Zhao, Myung-Il Roh, Hye-Won Lee, Do-Hyun Chun, Sung-Jun Lee, "A Collision Avoidance Method of Multi-ships Based on Deep Reinforcement Learning Considering COLREGs," Proceedings of ICCAS 2019, Rotterdam, Netherlands, pp. 85-88, 2019.09.24-26
-
Luman Zhao, Myung-Il Roh, Hye-Won Lee, "Control Design for an Unmanned Surface Vessel Based on Hardware-In-the-Loop Simulation", Proceedings of SUTTC(The Society for Underwater Technology Technical Conference) 2017, Haikou, China, 2017.11.23-24
-
Kyu-Yeul Lee, Seon-Ho Cho, Myung-Il Roh, "An Efficient Global-Local Hybrid Optimization Method Using Design Sensitivity Analysis", Proceedings of OptiCon 2000, Newport Beach, USA, pp. 1-13, 2000.10.26-27
-
Kyu-Yeul Lee, Sang-Uk Lee, Doo-Yeoun Cho, Myung-Il Roh, Seong-Chan Kang, Jung-Woo Seo, "An Innovative Compartment Modeling and Ship Calculation System", Proceedings of IMDC(International Marine Design Conference) 2003, Athens, Greece, 2003.05.05-08
-
Kyu-Yeul Lee, Myung-Il Roh, Sang-Uk Lee, Joong-Hyun Rhim, Seong-Chan Kang, Jong-Hyun Kim, Jeong-Youl Lee, "Development of a Hull Structural CAD System for an Initial Design Stage", Proceedings of PRADS 2004, Germany, pp. 98-105, 2004.09.12-17
-
Kyu-Yeul Lee, Myung-Il Roh, Ju-Hwan Cha, "Development of a Non-linear Optimization Program and Its Applications to Shipbuilding", Proceedings of the 1st Mongolia-Korea Joint Workshop on CAD/CAM, Ulaanbaatar, Mongolia, pp. 1-5, 2007.07.08-10
-
Kyu-Yeul Lee, Myung-Il Roh, Hang-Soon Choi, Woo-Jae Seong, "Development of Hybrid Optimization Method and Its Application to Ship Design Optimization", Proceedings of Pacific 2002 International Maritime Conference, Sydney, Australia, 2002.01.29-31
-
Kyu-Yeul Lee, Ju-Hwan Cha, Joon-Chae Lee, Myung-Il Roh, Ji-Hyun Hwang, "Determination of the Optimal Operating Condition of Dual Mixed Refrigerant Cycle at the Pre-FEED Stage of LNG FPSO Topside Liquefaction Process", Proceedings of ISOPE(International Society of Offshore and Polar Engineers) 2011, Maui, USA, pp. 151-158, 2011.06.19-24
-
Ki-Su Kim, Myung-Il Roh, Sung-Min Lee, Jihye Cha, Jongjin Park, DongYeon Lee, Booki Kim, "An Efficient Method for Cost and Risk Saving in Ship Route Planning", Proceedings of the 31st Asian-Pacific TEAM 2017, Osaka, Japan, 2017.09.25-28
