Counting 3,567 Big Data & Machine Learning Frameworks, Toolsets, and Examples...
Suggestion? Feedback? Tweet @stkim1



Mushroom: Reinforcement Learning python library.

What is Mushroom

Mushroom is a python Reinforcement Learning (RL) library using Tensorflow and OpenAI Gym libraries. It allows to perform RL experiments in a simple way providing TD (e.g. Q-Learning, SARSA), batch TD (e.g. FQI) algorithms, other new algorithms such as DQN and a small set of policy-based algorithms that will be enlarged soon.

Full documentation available at


You can do a minimal installation of Mushroom with:

git clone
cd mushroom
pip3 install -e .

Installing everything

To install the whole set of features, you will need additional packages installed. You can install everything by running:

pip3 install -e '.[all]'
pip3 install gym[atari]

How to set and run and experiment

To run experiments, Mushroom requires a script file that provides the necessary information for the experiment. Follow the scripts in the "examples" folder to have an idea of how an experiment can be run.

For instance, to run a quick experiment with one of the provided example scripts, run:

python3 examples/

Latest Releases
 Feb. 14 2018
 Jan. 31 2018