Counting 1,868 Big Data & Machine Learning Frameworks, Toolsets, and Examples...
Suggestion? Feedback? Tweet @stkim1

Author
Last Commit
Oct. 17, 2017
Created
Aug. 16, 2017

graphAttack

Computational graph library for machine learning. The main point is to combine mathematical operation together to form a workflow of choice. The graph takes care of evaluating the gradient of all the inputs to ease up setting up the minimizer.

I have aimed for the library to be simple and transparent so that it would be easy to understand and modify to fit individual needs. The performance was not the primary objective as there are plenty of fast alternatives; the aim was smaller, educational models.

All feedback and ideas for improvement welcome.

Tutorial

  • To be found in tutorial.ipynb, covers basic usage and a simple linear regression model

Examples

Setting up and running / training a dense neural network model

Setting up and running / training a Convolution neural network model

Setting up and running / training a Recurrent neural network

Features

Matrix operations

  • Dot product
  • Hadamard product
  • element-wise division
  • addition

Regularization

  • Dropout
  • Batch Normalisation

Activations

  • ReLU
  • Sigmoid
  • Tanh
  • Softmax

Convolution

  • 2d convolution
  • Max Pooling

Cost operations

  • Quadratic cost
  • Cross-entropy for softmax activation

Optimisation

  • Adam SGD minimizer, support for batches and continuous series

Misc

  • Reshape / flatten
  • Slice
  • Sum all elements/axis
  • Sum all elements squared
  • element-wise exponent

GPU Support

Limited GPU support can be made avaliable by modifying the file: graphAttack/gaUtilities/graphAttackFunctions.py

Commenting out lines 1-2 and uncommenting lines 4-22 will send the dot product computations to your GPU

Requirements

Additional Resources

http://www.deeplearningbook.org/ section 6.5.1 for more information on computational graphs and the rest of the book for more details about ML/deep learning.

Dependencies

  • Python 3.5 or above
  • numpy - linear algebra for Python
  • scipy - Scientific Python library, here used for utilities

License

MIT