PalimpsestBERT

Fresh ModernBERT pretrained Ancient Greek model on a new Ancient Greek corpus derived from the Harvard institutional-books collection.

Pretraining

• Best val loss: 1.8140, PPL: 6.135 (epoch 39/40)

Downstream (full results in the paper/repo)