This model is a fine-tuned version of EleutherAI/gpt-neo-125m on an unknown dataset. It achieves the following results on the evaluation set:
You can use this model directly with a pipeline for text generation. This example generates a different sequence each time it's run:
from transformers import pipeline
generator = pipeline('text-generation', model='2nji/gpt-neo-125m-finetuned-shakespeare')
generator("And all that", do_sample=True, min_length=20)
# [{'generated_text': "And all that in heaven is free: Thou bestow'd on God, so to my house, and in the"}]
This model was finetuned using the the Shakespare_corpus Dataset
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| No log | 1.0 | 185 | 4.1844 |
| No log | 2.0 | 370 | 4.1248 |
| 4.0892 | 3.0 | 555 | 4.1126 |
model.safetensors 501 MBtraining_args.bin 5.4 kBEleutherAI/gpt-neo-125m