This model is a fine-tuned version of microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext on the Mardiyyah/TAPT_CeLLaTe2.0 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Perplexity |
|---|---|---|---|---|---|
| 1.209 | 1.0 | 14 | 1.0540 | 0.7678 | 2.8692 |
| 1.1983 | 2.0 | 28 | 1.0407 | 0.7700 | 2.8313 |
| 1.1651 | 3.0 | 42 | 1.0530 | 0.7689 | 2.8662 |
| 1.1403 | 4.0 | 56 | 1.0620 | 0.7659 | 2.8920 |
| 1.1665 | 5.0 | 70 | 1.0056 | 0.7774 | 2.7337 |
| 1.1431 | 6.0 | 84 | 0.9861 | 0.7798 | 2.6806 |
| 1.1417 | 7.0 | 98 | 1.0499 | 0.7707 | 2.8572 |
| 1.1194 | 8.0 | 112 | 1.0551 | 0.7675 | 2.8722 |
| 1.1158 | 9.0 | 126 | 1.0471 | 0.7644 | 2.8494 |
| 1.0882 | 10.0 | 140 | 1.0437 | 0.7717 | 2.8396 |
| 1.0809 | 11.0 | 154 | 1.0141 | 0.7710 | 2.7570 |
Adapted_Tokenizer/checkpoint-112/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-126/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-14/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-140/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-154/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-168/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-182/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-196/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-28/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-42/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-56/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-70/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-84/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-98/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-112/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-126/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-14/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-140/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-154/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-168/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-182/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-196/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-28/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-42/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-56/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-70/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-84/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-98/model.safetensors 442 MBAdapted_Tokenizer/model.safetensors 442 MBmodel.safetensors 438 MBAdapted_Tokenizer/checkpoint-182/rng_state.pth 14.3 kBAdapted_Tokenizer/checkpoint-56/rng_state.pth 14.3 kBAdapted_Tokenizer/checkpoint-70/rng_state.pth 14.3 kBAdapted_Tokenizer/checkpoint-112/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-126/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-14/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-140/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-154/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-168/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-196/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-28/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-42/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-84/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-98/rng_state.pth 14.2 kBAdapted_Tokenizer/training_args.bin 5.8 kBAdapted_Tokenizer/checkpoint-112/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-126/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-14/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-140/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-154/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-168/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-182/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-196/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-28/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-42/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-56/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-70/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-84/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-98/training_args.bin 5.7 kBtraining_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-112/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-126/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-14/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-140/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-154/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-168/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-182/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-196/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-28/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-42/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-56/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-70/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-84/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-98/scheduler.pt 1.1 kBmicrosoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext