This model is a fine-tuned version of microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext on the Mardiyyah/TAPT_CeLLaTe2.0 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Perplexity |
|---|---|---|---|---|---|
| 1.1444 | 1.0 | 14 | 1.0112 | 0.7749 | 2.7489 |
| 1.1264 | 2.0 | 28 | 0.9842 | 0.7806 | 2.6757 |
| 1.118 | 3.0 | 42 | 0.9774 | 0.7810 | 2.6574 |
| 1.0848 | 4.0 | 56 | 0.9892 | 0.7781 | 2.6891 |
| 1.0813 | 5.0 | 70 | 0.9697 | 0.7861 | 2.6372 |
| 1.0682 | 6.0 | 84 | 0.9910 | 0.7782 | 2.6938 |
| 1.0576 | 7.0 | 98 | 0.9641 | 0.7807 | 2.6225 |
| 1.0377 | 8.0 | 112 | 0.9392 | 0.7880 | 2.5580 |
| 1.0206 | 9.0 | 126 | 0.9936 | 0.7765 | 2.7009 |
| 1.0254 | 10.0 | 140 | 0.9782 | 0.7797 | 2.6595 |
| 0.9976 | 11.0 | 154 | 0.9627 | 0.7833 | 2.6188 |
| 0.9818 | 12.0 | 168 | 0.9549 | 0.7833 | 2.5985 |
| 0.9706 | 13.0 | 182 | 0.9498 | 0.7855 | 2.5851 |
Adapted_Tokenizer/checkpoint-112/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-126/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-14/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-140/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-154/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-168/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-182/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-196/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-28/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-42/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-56/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-70/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-84/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-98/optimizer.pt 884 MBAdapted_Tokenizer/checkpoint-112/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-126/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-14/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-140/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-154/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-168/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-182/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-196/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-28/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-42/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-56/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-70/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-84/model.safetensors 442 MBAdapted_Tokenizer/checkpoint-98/model.safetensors 442 MBAdapted_Tokenizer/model.safetensors 442 MBmodel.safetensors 438 MBAdapted_Tokenizer/checkpoint-182/rng_state.pth 14.3 kBAdapted_Tokenizer/checkpoint-56/rng_state.pth 14.3 kBAdapted_Tokenizer/checkpoint-70/rng_state.pth 14.3 kBAdapted_Tokenizer/checkpoint-112/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-126/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-14/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-140/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-154/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-168/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-196/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-28/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-42/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-84/rng_state.pth 14.2 kBAdapted_Tokenizer/checkpoint-98/rng_state.pth 14.2 kBAdapted_Tokenizer/training_args.bin 5.8 kBtraining_args.bin 5.8 kBAdapted_Tokenizer/checkpoint-112/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-126/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-14/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-140/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-154/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-168/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-182/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-196/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-28/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-42/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-56/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-70/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-84/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-98/training_args.bin 5.7 kBAdapted_Tokenizer/checkpoint-112/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-126/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-14/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-140/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-154/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-168/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-182/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-196/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-28/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-42/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-56/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-70/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-84/scheduler.pt 1.1 kBAdapted_Tokenizer/checkpoint-98/scheduler.pt 1.1 kB