Beer-Pouring Robot Programed to Anticipate Human Actions (Video)

Article ID: 603544

Released: 28-May-2013 12:00 PM EDT

Source Newsroom: Cornell University

Newswise — ITHACA, N.Y. – A robot in Cornell’s Personal Robotics Lab has learned to foresee human action in order to step in and offer a helping hand, or more accurately, roll in and offer a helping claw.

Video: https://www.youtube.com/watch?v=xaa_wEkCvG0

Understanding when and where to pour a beer or knowing when to offer assistance opening a refrigerator door can be difficult for a robot because of the many variables it encounters while assessing the situation. A team from Cornell has created a solution.

Gazing intently with a Microsoft Kinect 3-D camera and using a database of 3D videos, the Cornell robot identifies the activities it sees, considers what uses are possible with the objects in the scene and determines how those uses fit with the activities. It then generates a set of possible continuations into the future – such as eating, drinking, cleaning, putting away – and finally chooses the most probable. As the action continues, the robot constantly updates and refines its predictions.

“We extract the general principles of how people behave,” said Ashutosh Saxena, Cornell professor of computer science and co-author of a new study tied to the research. “Drinking coffee is a big activity, but there are several parts to it.“ The robot builds a “vocabulary” of such small parts that it can put together in various ways to recognize a variety of big activities, he explained.

Saxena will join Cornell graduate student Hema S. Koppula as they present their research at the International Conference of Machine Learning, June 18-21 in Atlanta, and the Robotics: Science and Systems conference June 24-28 in Berlin, Germany.

In tests, the robot made correct predictions 82 percent of the time when looking one second into the future, 71 percent correct for three seconds and 57 percent correct for 10 seconds.

“Even though humans are predictable, they are only predictable part of the time,” Saxena said. “The future would be to figure out how the robot plans its action. Right now we are almost hard-coding the responses, but there should be a way for the robot to learn how to respond.”

The research was supported by the U.S. Army Research Office, the Alfred E. Sloan Foundation and Microsoft.

Contact Syl Kacapyr for information about Cornell's TV and radio studios.


Comment/Share

Notice: Undefined index: channel in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 60 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 165 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 165 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 165 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 165 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 165 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 165 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 165 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 165 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 165 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 229 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 229 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 229 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 229 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 287 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 346 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 386 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 417 Notice: Use of undefined constant sub_section_id - assumed 'sub_section_id' in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 446 Notice: Undefined index: channel in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 511 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 578 Notice: Trying to get property of non-object in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 578 Notice: Undefined variable: section in /opt/newswise/trunk/src/app/controllers/ArticlesController.php on line 585



Chat now!