This model is a fine-tuned version of EleutherAI/gpt-neo-125m on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.8022 | 0.2 | 2000 | 0.7737 | -4.8718 | -5.0523 | 0.5724 | 0.1805 | -175.2956 | -153.5872 | -11.7730 | -11.6673 |
| 0.7336 | 0.4 | 4000 | 0.7503 | -4.2523 | -4.3731 | 0.5625 | 0.1208 | -168.5040 | -147.3926 | -11.6528 | -11.5062 |
model.safetensors 501 MBtraining_args.bin 4.5 kBEleutherAI/gpt-neo-125m