Fine-tuned model from the PsyNamic project.
Superseded. This is the model of the initial PsyNamic submission (tag
submission-v1). It was replaced after retraining under a corrected protocol (Nov 2026) by STRIDE-lab/biomedbert-abstract-application-form-20261106. All current models: PsyNamic collection.
allenai/scibert_scivocab_uncased
Application Form (multi-label: several labels per abstract possible)
Describes how the substance was administered (e.g., oral, nasal, intravenous).
| ID | Label | Definition |
|---|---|---|
| 0 | Oral | – |
| 1 | Nasal | – |
| 2 | Intravenous | – |
| 3 | Smoking | Including inhalation. |
| 4 | Subcutaneous | – |
| 5 | Other | Including sublingual. |
| 6 | Unknown | – |
| 7 | Not applicable | E.g., for systematic reviews. |
{
"mode": "train",
"data": "<private_dataset>",
"task": "Application Form",
"model": "scibert",
"cross_val": false,
"batch_size": 8,
"learning_rate": 5e-05,
"weight_decay": 0.01,
"lr_scheduler": "linear",
"warmup_ratio": 0.1,
"epochs": 30,
"dropout": 0.1,
"early_stopping_patience": 5,
"gradient_clipping": 0.1,
"device": "cuda",
"load": null,
"max_length": 512,
"is_multilabel": true
}