Pytorch lightning implementation of the original Transformer architecture as described in the Attention Is All You Need paper. Along with the architecture, the repo contains the code to run training and inference on a machine translation task to translate from english to italian. A Tokenizer and a Dataloader are provided as well. The dataloader uses the OPUS Books dataset.
-
Notifications
You must be signed in to change notification settings - Fork 0
ggldnl/Transformer
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Pytorch lightning implementation of the original Transformer architecture
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published