VISIONBOT (VISualizIng and cONtrolling a roBOT via mixed reality interface) is funded by the 3rd Open Call for Technology Exchange Programme by the euROBIN project.
VISIONBOT is an immersive VR framework for robotic arm training in industrial settings using accurate hand-tracking, real-time simulation, and user-friendly HM for intuitive, accurate and safe robotic arm training via hand-tracking, user friendly HMI and real time simulation. It builds on strong human-factors and interaction design principles to respond to the highest UX/UI standards accessibility, while meeting emerging industrial needs. In the project, RE:LAB collaborates with TUM (Technische Universität München) and University of Bremen that are the technical leaders of this challenge.
VISIONBOT represents a significant advancement in robot training by integrating several technologies into a unified framework. It simulates and programs the movements of a robot in an intuitive, accurate fluid and safe way, considering the user perspective. VISIONBOT implements hand-tracking technologies that allow users to interact with a digital twin of the robot with a natural and immersive experience, reducing the learning curve for non-technical users. VISIONBOT applies realistic physical constraints within the simulation, ensuring that the robotic joints’ movements adhere to their true degrees of freedom and limits and pointing out potential errors. The HMI is designed with a Human Factors approach and focus on ergonomics to offer simplified and effective visualisation techniques to allow quick and effective involvement of users. The validation of the solution will be done in multiple steps, based on an iterative approach of design, development and testing, to ensure that the framework correctly translates virtual actions into real-world robot movements while maintaining accuracy, safety, and responsiveness.
As a result, within 12 months VISIONBOT will deliver an open software module usable across robotic platforms.
Disclaimer: Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or European Commission. Neither the European Union nor the granting authority can be held responsible for them.
Next project
If you are interested in collaborating with us or if you would like information about our services, please contact us and we will be happy to help. Let’s get in touch and make something great happen.