Small CNN (~225k params) trained from scratch on MNIST for exactly 30 seconds of training time on an Nvidia T4. Adam, lr=1e-3, batch 256, seed 0.
- Test accuracy: 0.9893 (9893/10000) after 1030 steps in 30.1s
- Checkpoint:
model.pt(torch.save dict withstate_dict)