The robot

Jido is a MP-L655 platform from Neobotix, equipped with a Mitsubishi PA-10 arm with 6 degrees of freedom). Several sensors are available on the platform: sonar, 2 Sick laser range finders, 2 stereo camera banks (one mounted on the arm, and the other on a pan-tilt unit on the base platform).


Software Architecture

The software architecture is an instance of the LAAS architecture "LAAS Architecture for Autonomous System".

It is a hierarchical architecture including a supervisor written with openPRS (a Procedural Reasoning System) that controls a distributed set of functional modules.



To localize itself within its environment the robot uses a SICK laser that exports at the required rate the laser echoes together with segments deduced from aligned echoes.

These segments are matched with segments previously recorded in a map thanks to a classical SLAM procedure.



Jido navigation




Obstacle Detection

Obstacle detection is a critical function both for security reasons and for interaction purposes.The most efficient sensor is the laser. However Rackham's laser can only look forward (over 180 degrees) in an horizontal plan.

To partially overcome these limitations, the laser data are integrated in a local map and filtered using knowledge about the global map.


Human Detection

A module is able to detect faces in real time from a color camera image.

The detector uses a cascaded classifier and a head tracker based on a particle filter.


Speech Recognition

Some wors about irit and speech recognition


Talking Head

We use a talking head, or clone, developed by the Institut de la Communication Parlée .

The clone is based on a very accurate articulatory 3D model of the postures of a speaking locutor with realistic synthetic rendering thanks to 3D texture projection.



or how to make all that things work together ??