This is a Shrinked and Fine-tuned version of https://huggingface.co/cnicu/t5-small-booksum
See https://ziade.org/2024/01/27/compressing-t5-models-for-summarization/ for the rationale.
Accuracy after shrinking:
rouge-1 Accuracy:
- F1 Accuracy: 95.99%
- Precision Accuracy: 85.37%
- Recall Accuracy: 95.73%
rouge-2 Accuracy:
- F1 Accuracy: 99.54%
- Precision Accuracy: 97.14%
- Recall Accuracy: 99.54%
rouge-l Accuracy:
- F1 Accuracy: 96.76%
- Precision Accuracy: 84.41%
- Recall Accuracy: 96.36%