Robots Helping People in their Homes

Home robots could make all of our lives easier, and perhaps most importantly, they could allow seniors to live more independently. But training robots to operate in homes is difficult because each home is unique and filled with so many objects in different combinations and layouts. Toyota Research Institute (TRI) may have a solution: using virtual reality to change the way we train robots.

The VR training system allows human teachers to see what the robot is seeing live, in 3D, from its sensors. The teacher can instruct the robot and annotate the 3D scene, for instance adding a note on how to grasp a handle. This allows human trainers to teach robots arbitrary tasks with a variety of objects, instead of specific tasks like they would perform in a more controlled setting.