This model is a fine-tuned version of google/bert_uncased_L-4_H-256_A-4 on the augmented_glue_sst2 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 0.602 | 1.0 | 6227 | 0.3389 | 0.9186 |
| 0.4195 | 2.0 | 12454 | 0.2989 | 0.9151 |
| 0.3644 | 3.0 | 18681 | 0.2794 | 0.9117 |
| 0.3304 | 4.0 | 24908 | 0.2793 | 0.9106 |
| 0.3066 | 5.0 | 31135 | 0.2659 | 0.9186 |
| 0.2881 | 6.0 | 37362 | 0.2668 | 0.9140 |
| 0.2754 | 7.0 | 43589 | 0.2643 | 0.9128 |
pytorch_model.bin 45 MBtraining_args.bin 3.1 kB