fairseq: A Fast, Extensible Toolkit for Sequence Modeling
2019-04-01NAACL 2019Code Available1· sign in to hype
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/shamanez/Self-Supervised-Embedding-Fusion-Transformerpytorch★ 123
- github.com/shamanez/BERT-like-is-All-You-Needpytorch★ 120
- github.com/guxm2021/MM_ALTpytorch★ 21
Abstract
fairseq is an open-source sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling, and other text generation tasks. The toolkit is based on PyTorch and supports distributed training across multiple GPUs and machines. We also support fast mixed-precision training and inference on modern GPUs. A demo video can be found at https://www.youtube.com/watch?v=OtgDdWtHvto