Sauer, Timm (University of applied sciences Aschaffenburg), Spielmann, Luca (University of applied sciences Aschaffenburg), Gorks, Manuel (University of applied sciences Aschaffenburg), Zindler, Klaus (University of Applied Sciences Aschaffenburg), Jumar, Ulrich (ifak - Institut f. Automation u. Kommunikation)

Automatic Track Guidance of Industrial Trucks with Time-Variant Vehicle Parameters Using AI-Based Controllers

Scheduled for presentation during the Regular Session "Vehicle Dynamics and Control" (TuAT4), Tuesday, August 30, 2022, 11:00−11:20, Ballroom

10th IFAC International Symposium on Advances in Automotive Control, August 28-31, 2022, Columbus, Ohio, USA

This information is tentative and subject to change. Compiled on April 23, 2024

Abstract

This paper presents an extension of a self-learning control concept for automatic track guidance of industrial trucks in intralogistic systems. The presented approach is based on Reinforcement Learning (RL), a method of Artificial Intelligence (AI) and is able to adapt itself to different industrial truck variants and the associated specific vehicle parameters. Moreover, time-variant parameters during operation, such as the vehicle's velocity are taken into account. In order to consider the existing a priori knowledge of the controlled system and to avoid starting the whole training process of the controller for each truck variant from scratch, the training process is divided into two steps. In the first step, the controller is trained on a model using parameters of a nominal vehicle variant. Based on this, the control parameters are only fine-tuned in the second step. In this way the controller is adapted to the actual truck variant and the corresponding parameter values. In order to take into account the time-variant vehicle parameters during operation, the Artificial Neural Networks (ANN) of the RL controller and the observation vector are suitably extended. In this way, the varying speed can be considered in both training steps and the control parameters can be optimized accordingly. Thus, in case of the investigated scenarios a stable control loop behavior can be guaranteed for the entire speed range of industrial trucks. In order to demonstrate this, the new approach is compared with a RL control concept, not considering time-variant parameters.