改进DDPG的磁浮控制研究

Research on magnetic levitation control algorithm based on improved DDPG

  • 摘要: 针对传统磁浮控制算法依赖精确模型、适应性差的问题,提出一种基于强化学习的IDDPG (Improvement Deep Deterministic Policy Gradient)控制方法。首先,搭建电磁悬浮系统数学模型并分析其动态特性。其次,针对传统DDPG算法在电磁悬浮控制中的不足,设计一种分段式反比例奖励函数,以提升稳态精度和响应速度,并对DDPG控制流程进行分析及优化,以满足实际部署需求。最后,通过仿真与实验,对比分析电流环跟踪、奖励函数、训练步长以及模型变化对控制性能的影响。结果表明:采用分段式反比例奖励函数的IDDPG控制器在降低稳态误差和超调的同时,显著提升了系统的响应速度,且优化后的控制流程适用于实际系统部署。此外,在不同模型下使用相同参数时仍能取得基本一致的控制效果,验证了IDDPG在不依赖精确模型情况下的良好适应性。

     

    Abstract: To address the limitations of traditional magnetic levitation control algorithms, which often rely on precise mathematical models and exhibit poor adaptability, this paper proposes an improved deep deterministic policy gradient (IDDPG) controller based on reinforcement learning. A mathematical model of the electromagnetic levitation system is first established, and its dynamic characteristics are analyzed. To enhance the conventional DDPG algorithm’s applicability in maglev control, a segmented inverse proportional reward function is designed to improve steady-state accuracy and response speed. The control framework is further optimized to meet real-time deployment requirements. Comprehensive simulations and experiments are conducted to evaluate the impact of current loop tracking, reward function design, training step size, and model variations on control performance. Results demonstrate that the proposed IDDPG controller significantly enhances system response speed while reducing steady-state error and overshoot,and the optimized control flow is suitable for real system deployment. Moreover, it maintains consistent control performance across varying system models, confirming its robustness and adaptability without reliance on exact model knowledge.

     

/

返回文章
返回