Pelosi, Martina (Politecnico di Milano, Politecnico di Torino), Grieco, Bianca (Politecnico di Milano), Zanchettin, Andrea Maria (Politecnico di Milano), Rocco, Paolo (Politecnico di Milano)

Combined Bi-RRT and Q-Learning Path-Planning in Collaborative Environments

Scheduled for presentation during the Regular Session "Robot Task Planning" (FrAT2), Friday, July 18, 2025, 11:00−11:20, Room 106

Joint 10th IFAC Symposium on Mechatronic Systems and 14th Symposium on Robotics, July 15-18, 2025, Paris, France

This information is tentative and subject to change. Compiled on August 2, 2025

Abstract

In recent years, a significant transformation towards intelligent manufacturing systems has been observed in industry. One of the leading research topics in this field is collaborative robotics, which promotes a synergic interaction between humans and robots. Advantages in ergonomics and production are foreseen with the adoption of collaborative robotics. Avoiding unintended collisions, which would ensure seamless collaboration, is one of the main challenges in improving safety and productivity. This paper focuses on a decision-making strategy that allows the robot to autonomously identify the optimal path to minimize the travel distance between the current configuration and the target while maintaining a safe distance from the human collaborator. The proposed strategy involves the offline generation of a dataset of possible paths within the robot workspace and a Reinforcement Learning-based control strategy, enabling the optimal choice of the subsequent robot configuration. After training and testing in a simulated environment, the optimal policy was validated with an ABB GoFa™ robotic arm, testing different human configurations and paths.