Participating member(s) LEO University of Twente, Human Media Interaction
Start date1-10-2011
Budget€ 2.494.228
Type of fundingFP7
Fields of application
Service robotics | Social robotics

FROG proposes to develop a guide robot with a winning personality and behaviours that will engage tourists in a fun exploration of outdoor attractions. The work encompasses innovation in the areas of vision-based detection, robotics design and navigation, human-robot interaction, affective computing, intelligent agent architecture and dependable autonomous outdoor robot operation.


The FROG robots fun personality and social visitor-guide behaviours aim to enhance the user experience. FROGs behaviours will be designed based on the findings of systematic social behavioural studies of human interaction with robots. FROG adapts its behaviour to the users through vision-based detection of human engagement and interest.


Interactive augmented reality overlay capabilities in the body of the robot will enhance the visitors experience and increase knowledge transfer as information is offered through multi-sensory interaction. Gesture detection capabilities further allow the visitors to manipulate the augmented reality interface to explore specific interests.



FROG plans to build a highly dependable robot that operates autonomously in populated outdoor real-world settings. New robust outdoor localization and navigation algorithms based on 6 DOF localization and SLAM will offer precise localization that is required for human-friendly navigation and optimal positioning of the robots augmented reality overlays. Moreover, robust, safety-critical, human-aware navigation algorithms will be developed, taking into account human interaction at all levels.
The intelligent agent architecture is a platform that will allow the integration of low-level guidance and communication controls with high-level interaction generation including affective computing algorithms and contextual recognition. This approach will lead to the creation of a new generation of highly sophisticated autonomous outdoor robotic guide services.

ID Mind, Imperial Collega London, Pablo de Olavide, Universiteit van Amsterdam, YDreams
Funded by
European Commission