ZhuSuan is a python probabilistic programming library for Bayesian deep learning, which conjoins the complimentary advantages of Bayesian methods and deep learning. ZhuSuan is built upon Tensorflow. Unlike existing deep learning libraries, which are mainly designed for deterministic neural networks and supervised tasks, ZhuSuan provides deep learning style primitives and algorithms for building probabilistic models and applying Bayesian inference. The supported inference algorithms include:
- Variational inference with programmable variational posteriors, various objectives and advanced gradient estimators (SGVB, REINFORCE, VIMCO, etc.).
- Importance sampling for learning and evaluating models, with programmable proposals.
- Hamiltonian Monte Carlo (HMC) with parallel chains, and optional automatic parameter tuning.
ZhuSuan is still under development. Before the first stable release (1.0), please clone the repository and run
pip install .
in the main directory. This will install ZhuSuan and its dependencies automatically. ZhuSuan also requires Tensorflow version 1.0 or later. Because users should choose whether to install the cpu or gpu version of Tensorflow, we do not include it in the dependencies. See Installing Tensorflow.
If you are developing ZhuSuan, you may want to install in an "editable" or "develop" mode. Please refer to the Contribution section below.
Documentation is available online: zhusuan.readthedocs.io
We provide examples on traditional hierarchical Bayesian models and recent deep generative models.
To run the provided examples, you may need extra dependencies to be installed. This can be done by:
pip install ".[examples]"
- Gaussian: HMC
- Toy 2D Intractable Posterior: SGVB
- Bayesian Neural Networks: SGVB
- Variational Autoencoder (VAE): SGVB, IWAE
- Convolutional VAE: SGVB
- Semi-supervised VAE (Kingma, 2014): SGVB, RWS
- Deep Sigmoid Belief Networks RWS, VIMCO
- Logistic Normal Topic Model: HMC
To install ZhuSuan in an "editable" or "develop" mode, run
pip install -e .
in the main directory. This installation is removable by:
python setup.py develop --uninstall
Additional dependencies for developments can be installed by:
pip install ".[dev]"
This command will run automatic tests in the main directory:
python -m unittest discover -v
After running tests, to ensure test coverage over the developments, run:
coverage report --include="zhusuan/*"
PEP8 Code Style Check
We follow PEP8 python code style. To check, in the main directory, run:
Docs are written under
docs/ directory as RestructuredText (
index.rst is the main page. A Tutorial on RestructuredText can be
API References are automatically generated by
Sphinx. They are under
directory and should be regenerated each time when any code changes:
To compile docs into webpages, Run
docs/ directory. The generated webpages are in
can be viewed with browsers.