Szmatula, Eloïse (Sorbonne Université), Lansiaux, Axel (Sorbonne Université), Baudry, Aline (Sorbonne Université), HADJES, Samuel (Sorbonne Université), Nashed, Salomé (Sorbonne Université), HINDERER, Sébastien (INRIA), Saint-Bauzel, Ludovic (Sorbonne Université), VERITE, Fabien (Sorbonne Université)

A Modular Assistive Device for the Visually Impaired: Co-Design, Kinesthetic Feedback, and Real-World Evaluation in the Cybathlon VIS Race

Scheduled for presentation during the Invited Session "Design and control coupling in deformable mechatronic and robotic systems for physical interactions with humans" (WeAT3), Wednesday, July 16, 2025, 10:20−10:40, Room 107

Joint 10th IFAC Symposium on Mechatronic Systems and 14th Symposium on Robotics, July 15-18, 2025, Paris, France

This information is tentative and subject to change. Compiled on July 16, 2025

Abstract

This paper introduces a modular assistive device designed for visually impaired individuals, tested in the Cybathlon Vision Assistance (VIS) race. Combining RGB-D and smartphone cameras with advanced algorithms, the system provides kinesthetic feedback for intuitive navigation and audio cues for task-specific guidance. Developed through co-design with expert users, the device addresses real-world challenges such as obstacle avoidance, object identification, and touchscreen interaction. While effective in competition, some limitations highlight areas for future refinement.