This is albert base tuned with optimal lr, lr scheduler and weight decay on dnd-style-intents dataset.
| parametrs | value |
|---|---|
| learning rate | 5e-5 |
| lr scheduler | linear |
| weight decay | 0 |
Model has next metrics on test data from dataset
| metric | value |
|---|---|
| accuracy | 0.981 |
| Macro F1 | 0.979 |
| Micro F1 | 0.985 |