Counting 2,412 Big Data & Machine Learning Frameworks, Toolsets, and Examples...
Suggestion? Feedback? Tweet @stkim1

Author
Contributors
Last Commit
Feb. 22, 2018
Created
Sep. 8, 2017

OpenSeq2Seq: sequence to sequence learning

This is a research project, not an official NVIDIA product.

Features

  1. Sequence to sequence learning
    1. Different cell types: LSTM, GRU, GLSTM, SLSTM
    2. Encoders: RNN-based, unidirectional, bi-directional, GNMT-like
    3. Attention mechanisms: Bahdanau, Luong, GNMT-like
    4. Beam search for inference
  2. Single box data parallel multi-gpu training
  3. Distributed (data-parallel) multi-node, mult-gpu training using Horovod
  4. LARS norm scaling algorithm

Documentation

Contributions are welcome!

Related resources

References