Our setup

• platform
• stereocamera
• lidar
• controller
• Nvidia Jetson Xavier NX

Visual navigation problem

Unity ml-agents as virtual simulation

Virtual simulation can be replaced by neural environment

Real gifs

Recorded with camera:

Fake gifs

Generated with neural environment based on this approach):

We are inspired by these projects