This model is a fine-tuned version of distilgpt2 on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 0.3947 | 1.0 | 2000 | 0.3817 |
| 0.3433 | 2.0 | 4000 | 0.3453 |
| 0.3308 | 3.0 | 6000 | 0.3277 |
| 0.3246 | 4.0 | 8000 | 0.3259 |
| 0.3122 | 5.0 | 10000 | 0.3221 |
| 0.3154 | 6.0 | 12000 | 0.3182 |
| 0.3101 | 7.0 | 14000 | 0.3181 |
| 0.2938 | 8.0 | 16000 | 0.3152 |
| 0.2863 | 9.0 | 18000 | 0.3142 |
| 0.2843 | 10.0 | 20000 | 0.3142 |
| 0.2877 | 11.0 | 22000 | 0.3155 |
| 0.291 | 12.0 | 24000 | 0.3147 |
| 0.2707 | 13.0 | 26000 | 0.3197 |
| 0.2625 | 14.0 | 28000 | 0.3222 |
| 0.2598 | 15.0 | 30000 | 0.3279 |
| 0.2572 | 16.0 | 32000 | 0.3291 |
| 0.2447 | 17.0 | 34000 | 0.3384 |
| 0.2379 | 18.0 | 36000 | 0.3452 |
| 0.2337 | 19.0 | 38000 | 0.3527 |
| 0.2258 | 20.0 | 40000 | 0.3575 |
| 0.2203 | 21.0 | 42000 | 0.3623 |
| 0.2094 | 22.0 | 44000 | 0.3742 |
| 0.1992 | 23.0 | 46000 | 0.3809 |
| 0.1996 | 24.0 | 48000 | 0.3875 |
| 0.1886 | 25.0 | 50000 | 0.3953 |
| 0.1872 | 26.0 | 52000 | 0.3971 |
| 0.1825 | 27.0 | 54000 | 0.4064 |
| 0.171 | 28.0 | 56000 | 0.4152 |
| 0.1636 | 29.0 | 58000 | 0.4226 |
| 0.1624 | 30.0 | 60000 | 0.4344 |
| 0.1497 | 31.0 | 62000 | 0.4363 |
| 0.1497 | 32.0 | 64000 | 0.4437 |
| 0.1483 | 33.0 | 66000 | 0.4514 |
| 0.1358 | 34.0 | 68000 | 0.4625 |
| 0.1324 | 35.0 | 70000 | 0.4674 |
| 0.1323 | 36.0 | 72000 | 0.4752 |
| 0.1289 | 37.0 | 74000 | 0.4809 |
| 0.1183 | 38.0 | 76000 | 0.4901 |
| 0.1213 | 39.0 | 78000 | 0.4972 |
| 0.1143 | 40.0 | 80000 | 0.5013 |
| 0.1118 | 41.0 | 82000 | 0.5080 |
| 0.1074 | 42.0 | 84000 | 0.5180 |
| 0.1017 | 43.0 | 86000 | 0.5237 |
| 0.1006 | 44.0 | 88000 | 0.5291 |
| 0.101 | 45.0 | 90000 | 0.5376 |
| 0.0941 | 46.0 | 92000 | 0.5390 |
| 0.0912 | 47.0 | 94000 | 0.5467 |
| 0.0915 | 48.0 | 96000 | 0.5541 |
| 0.0876 | 49.0 | 98000 | 0.5606 |
| 0.0865 | 50.0 | 100000 | 0.5655 |
| 0.0851 | 51.0 | 102000 | 0.5721 |
| 0.083 | 52.0 | 104000 | 0.5761 |
| 0.082 | 53.0 | 106000 | 0.5865 |
| 0.0809 | 54.0 | 108000 | 0.5844 |
| 0.081 | 55.0 | 110000 | 0.5883 |
| 0.0798 | 56.0 | 112000 | 0.5910 |
| 0.0768 | 57.0 | 114000 | 0.5974 |
| 0.0765 | 58.0 | 116000 | 0.5952 |
| 0.0719 | 59.0 | 118000 | 0.6019 |
| 0.0744 | 60.0 | 120000 | 0.6034 |
| 0.0737 | 61.0 | 122000 | 0.6071 |
| 0.0704 | 62.0 | 124000 | 0.6107 |
| 0.0713 | 63.0 | 126000 | 0.6178 |
| 0.0711 | 64.0 | 128000 | 0.6170 |
| 0.0691 | 65.0 | 130000 | 0.6219 |
| 0.0675 | 66.0 | 132000 | 0.6289 |
| 0.0664 | 67.0 | 134000 | 0.6312 |
| 0.0704 | 68.0 | 136000 | 0.6313 |
| 0.0654 | 69.0 | 138000 | 0.6344 |
| 0.0665 | 70.0 | 140000 | 0.6371 |
| 0.0652 | 71.0 | 142000 | 0.6369 |
| 0.0633 | 72.0 | 144000 | 0.6410 |
| 0.0643 | 73.0 | 146000 | 0.6433 |
| 0.0646 | 74.0 | 148000 | 0.6463 |
| 0.0641 | 75.0 | 150000 | 0.6500 |
| 0.0643 | 76.0 | 152000 | 0.6506 |
| 0.0632 | 77.0 | 154000 | 0.6508 |
| 0.0634 | 78.0 | 156000 | 0.6552 |
| 0.0613 | 79.0 | 158000 | 0.6543 |
| 0.063 | 80.0 | 160000 | 0.6550 |
| 0.0615 | 81.0 | 162000 | 0.6591 |
| 0.0612 | 82.0 | 164000 | 0.6628 |
| 0.0599 | 83.0 | 166000 | 0.6630 |
| 0.062 | 84.0 | 168000 | 0.6644 |
| 0.0614 | 85.0 | 170000 | 0.6667 |
| 0.0592 | 86.0 | 172000 | 0.6685 |
| 0.0585 | 87.0 | 174000 | 0.6666 |
| 0.0611 | 88.0 | 176000 | 0.6683 |
| 0.0573 | 89.0 | 178000 | 0.6690 |
| 0.0586 | 90.0 | 180000 | 0.6694 |
| 0.0576 | 91.0 | 182000 | 0.6712 |
| 0.0585 | 92.0 | 184000 | 0.6726 |
| 0.0578 | 93.0 | 186000 | 0.6723 |
| 0.059 | 94.0 | 188000 | 0.6734 |
| 0.0562 | 95.0 | 190000 | 0.6734 |
| 0.0569 | 96.0 | 192000 | 0.6745 |
| 0.0577 | 97.0 | 194000 | 0.6754 |
| 0.0564 | 98.0 | 196000 | 0.6753 |
| 0.0564 | 99.0 | 198000 | 0.6755 |
| 0.056 | 100.0 | 200000 | 0.6756 |
model.safetensors 328 MBtraining_args.bin 5.4 kBdistilbert/distilgpt2