Skip to content
On this page

PyTorch

PyTorch Lightning & Lightning Hydra Template are neat. PyTorch in 100 Seconds & Tensor Puzzles is nice intros.

TorchScale is nice library for making Transformers efficiently. BackPACK is interesting too.

WebDataset is interesting.

Notes