Counting 2,129 Big Data & Machine Learning Frameworks, Toolsets, and Examples...
Suggestion? Feedback? Tweet @stkim1

Author
Contributors
Last Commit
Dec. 8, 2017
Created
Sep. 8, 2017

OpenSeq2Seq: multi-gpu sequence to sequence learning

This is a research project, not an official NVIDIA product.

Features

  1. Sequence to sequence learning
    1. Different cell types: LSTM, GRU, GLSTM, SLSTM
    2. Encoders: RNN-based, unidirectional, bi-directional, GNMT-like
    3. Attention mechanisms: Bahdanau, Luong, GNMT-like
    4. Beam search for inference
  2. Data parallel multi-gpu training
  3. Distributed (data-parallel) multi-node training using Horovod
  4. LARS norm scaling algorithm

Documentation