Counting 2,129 Big Data & Machine Learning Frameworks, Toolsets, and Examples...
Suggestion? Feedback? Tweet @stkim1

Last Commit
Dec. 3, 2017
Oct. 26, 2017


  • New reset() integrated
  • Better Train / Test structure
  • Updated binaries for Win 10
  • Better reward function


This repository integrates AirSim with openAI gym and keras-rl for autonomous copter through reinforcement learning.

The integration to gym is adapted from DRL-AutonomousVehicles and extended by the multirotor integration.




openAI gym

My test environment binaries for Win10 can be downlaoded here.

Click here for a demo video:

Youtube Video here

How to use:

You can either train yourself or load the exciting weights by setting Train to True or False. CAREFUL: When you cancel the training with STRG + C, weights are saved and will overright the already trained weights.


Right now the framework has proofed to be able to learn, with 3 score inputs. The score inputs take the average of the left, middle and right section of the depth image respectively.

Next step:

Be able to learn with full raw depth image. (For right now I am taking a screen shot of the DepthVis window of AirSim, since the API to receive the DepthVis image returns false data.)


How to pass additional information beside the image. (While using the score values, there is no difficulty to pass more information like orientation or distance from goal in the gym.Box as well)