Learning to Navigate in a Virtual World using Optic Flow and Stereo Disparity Signals

By Max Versace | August 24, 2014

mobile_robotThe Neuromorphics Lab is has just published a new article that explains how optic flow and learning can be used to improve navigation in a mobile robot. This is the abstract of the article just appeared in Artificial Life and Robotics:

"Navigating in a complex world is challenging in that the rich, real environment provides a very large number of sensory states that can immediately precede a collision. Biological organisms such as rodents are able to solve this problem, effortlessly navigating in closed-spaces by encoding in neural representations distance toward walls or obstacles for a given direction."

"This paper presents a method that can be used by virtual (simulated) or robotic agents which uses similar neural representations to learn collision avoidance. With respect to alternative methods, our reinforcement learning approach uses a small number of states defined by discretized distances along three constant directions. These distances are estimated either from optic flow or binocular stereo information. Parameterized templates for optic flow or disparity information are compared against the input flow or input disparity to estimate these distances. Simulations in a virtual environment show learning of collision avoidance. Our results show that learning with only stereo information is superior to learning with only optic flow information. Our work motivates the usage of abstract state descriptions for the learning of visual navigation. Future work will focus on the fusion of optic flow and stereo information, and transferring these models to robotic platforms."

Learning to navigate in a virtual world using optic flow and stereo disparity signals 2014

Raudies, F., Eldridge, S., Joshi, A., and Versace, M. (2014) Learning to Navigate in a Virtual World via Optic Flow and Stereo Disparity Signals. In press, Artificial Life and Robotics, DOI 10.1007/s10015-014-0153-1.


The Neuromorphics Lab is highly collaborative with connections across both academia and industry.