This repository includes pytorch implementations of "Attention is All You Need" (Vaswani et al., NIPS 2017) and "Weighted Transformer Network for Machine Translation" (Ahmed et al., arXiv 2017)

Paper

• Vaswani et al., "Attention is All You Need", NIPS 2017
• Ahmed et al., "Weighted Transformer Network for Machine Translation", Arxiv 2017

Code

• jadore801120/attention-is-all-you-need
• OpenNMT/OpenNMT-py
• The Annotated Transformers

fix some bugs to support pytorch 1.7

python train.py -data_path ./preprocess-train.t7 -model_path ./model/ckpt.pth