Human Motion Prediction Based on Object Interactions

Lilli Bruckschen, Nils Dengler, and Maren Bennewitz
University of Bonn, Germany

In this paper, we consider the problem of predicting the next navigation goal of a moving human in an indoor environment.  Knowledge about this goal can greatly increase the efficiency of robots acting in the same environment, as interferences can be avoided and assistance quickly provided if necessary.  Often the navigation goal depends on the previous action of the human and the object the human has interacted with before.  Thus, the information about previous object interactions can be used to infer possible objects the human will interact with next, which in term can be used to predict the current navigation goal.  We propose to learn a probability distribution of subsequent object interactions and present a framework that utilizes the learned transition model as well as observations of the human's location and pose for the prediction of their movement goal.  As we show in various experiments, the information about transition probabilities of object interactions significantly improves the prediction of the navigation goal compared to prediction approaches that rely only on spatial information and do not consider object interactions.  Furthermore, we demonstrate how the prediction can be used to realize foresighted robot navigation.