TRANSFORMER-attention-is-all-you-need
Project status: UnknownFrom-scratch PyTorch reimplementation of the "Attention Is All You Need" Transformer (23M params) with pretraining + fine-tuning experiments.
- Target software or hardware
- Work type
- Primary public repository
- github.com/rajesh-bb/transformer-attention-is-all-you-need
Projects are sorted by the latest recorded repository star count. Stars indicate interest, not completion. Missing counts remain unknown.
Repository metadata needs refreshing. The cached listing remains available.
About and scope
From-scratch PyTorch reimplementation of the "Attention Is All You Need" Transformer (23M params) with pretraining + fine-tuning experiments.
Contribution availability
Contribution policy unknown
- AI-assisted contribution policy
- Unspecified
Documented contributor systems
Contributor setup not documented
Reported progress
Progress not reported
Sources, builds and releases
- Open repository · github.comgithub.com/rajesh-bb/transformer-attention-is-all-you-need