Counting 3,742 Big Data & Machine Learning Frameworks, Toolsets, and Examples...
Suggestion? Feedback? Tweet @stkim1



Mushroom: Reinforcement Learning python library.

What is Mushroom

Mushroom is a python Reinforcement Learning (RL) library whose modularity allows to easily use well known python libraries for tensor computation (e.g. PyTorch, Tensorflow) and RL benchmark (e.g. OpenAI Gym, PyBullet). It allows to perform RL experiments in a simple way providing online TD (e.g. Q-Learning, SARSA), batch TD (e.g. FQI) algorithms, deep RL algorithms (e.g. DQN and DDPG), and several policy-search algorithms (e.g. REINFORCE, REPS).

Full documentation available at


You can do a minimal installation of Mushroom with:

git clone
cd mushroom
pip3 install -e .

Installing everything

To install the whole set of features, you will need additional packages installed. You can install everything by running:

pip3 install -e '.[all]'

How to set and run and experiment

To run experiments, Mushroom requires a script file that provides the necessary information for the experiment. Follow the scripts in the "examples" folder to have an idea of how an experiment can be run.

For instance, to run a quick experiment with one of the provided example scripts, run:

python3 examples/

Latest Releases
 Feb. 14 2018
 Jan. 31 2018