Counting 3,039 Big Data & Machine Learning Frameworks, Toolsets, and Examples...
Suggestion? Feedback? Tweet @stkim1

Last Commit
Aug. 19, 2018
Mar. 4, 2017


In this project we play Google's T-rex game using Reinforcement Learning. The RL algorithm is based on the Deep Q-Learning algorithm [1] and is implemented from scratch in TensorFlow.


CHECK OUT THE ACCOMPAGNYING BLOGPOST - it contains a lot more useful information.



  • Python 3.5 or higher
  • Pillow 4.3.0
  • scipy 0.19.1
  • tensorflow 1.7.0 or higher
  • optional: tensorflow tensorboard


Tested on MacOs, Debian, Ubuntu, and Ubuntu-based distros.

Start by cloning the repository

$ git clone

We recommend creating a virtualenv before installing the required packages. See virtualenv or virtualenv-wrapper on how to do so.

The dependencies can be easly installed using pip.

$ optional: open the virtualenv
$ pip install -r requirements.txt

Getting started

Webserver for running the javascript T-rex game

A simple webserver is required to run the T-rex javascript game. The easiest way to achieve this is by using python's Simple HTTP Server module. Open a new terminal and navigate to TF-Rex/game, then run the following command

$ cd /path/to/project/TF-Rex/game
$ python2 -m SimpleHTTPServer 8000

The game is now accessable on your localhost This approach was tested for Chrome and Mozilla Firefox.


First, all the commandline arguments can be retrieved with

$ python --help

Quickly check if the installation was successful by playing with a pretrained Q-learner.

$ python --notraining --logdir ./trained-model

This command will restore the pretrained model, stored in ./trained-model and play the T-rex game.

IMPORTANT: The browser needs to connect with the python side. Therefore, refresh the browser after firing python --notraining --logdir ./trained-model.


Training a new model can be done as follows

$ python --logdir logs

Again, the browser needs to be refreshed to start the process. The directory passed as logdir argument will be used to store intermediate tensorflow checkpoints and tensorboard information.

While training, a different terminal can be opened to launch the tensorboard

$ tensorboard --logdir logs

The tensorboards will be visible on


[1] Playing Atari with Deep Reinforcement Learning