This model is a fine-tuned version of allenai/longformer-base-4096 on the stab-gurevych-essays dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | B-claim | B-majorclaim | B-premise | I-claim | I-majorclaim | I-premise | O | Accuracy | Macro avg | Weighted avg |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| No log | 1.0 | 41 | 0.4487 | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 284.0} | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 141.0} | {'precision': 0.7102510460251046, 'recall': 0.9590395480225988, 'f1-score': 0.8161057692307693, 'support': 708.0} | {'precision': 0.5242566510172144, 'recall': 0.0722917565817868, 'f1-score': 0.1270623933244832, 'support': 4634.0} | {'precision': 0.635728952772074, 'recall': 0.6736292428198434, 'f1-score': 0.6541305725755335, 'support': 2298.0} | {'precision': 0.7685153090699018, 'recall': 0.9773712438468886, 'f1-score': 0.8604508262992788, 'support': 13611.0} | {'precision': 0.9707444699912788, 'recall': 0.9973120469169993, 'f1-score': 0.9838489353153878, 'support': 12277.0} | 0.8279 | {'precision': 0.5156423469822248, 'recall': 0.5256634054554452, 'f1-score': 0.49165692810649325, 'support': 33953.0} | {'precision': 0.7884799553707518, 'recall': 0.827879716078108, 'f1-score': 0.7793158674251499, 'support': 33953.0} |
| No log | 2.0 | 82 | 0.3651 | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 284.0} | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 141.0} | {'precision': 0.6355475763016158, 'recall': 1.0, 'f1-score': 0.7771679473106476, 'support': 708.0} | {'precision': 0.5581831831831832, 'recall': 0.3208890807078118, 'f1-score': 0.40750890654973965, 'support': 4634.0} | {'precision': 0.888728323699422, 'recall': 0.5352480417754569, 'f1-score': 0.66811515480717, 'support': 2298.0} | {'precision': 0.8056312443233424, 'recall': 0.9775181838219088, 'f1-score': 0.8832901812387971, 'support': 13611.0} | {'precision': 0.9999184139675288, 'recall': 0.9982894844017268, 'f1-score': 0.9991032852368142, 'support': 12277.0} | 0.8537 | {'precision': 0.5554298202107274, 'recall': 0.5474206843867007, 'f1-score': 0.5335979250204527, 'support': 33953.0} | {'precision': 0.8341039518604557, 'recall': 0.8537095396577622, 'f1-score': 0.832398123732452, 'support': 33953.0} |
| No log | 3.0 | 123 | 0.2896 | {'precision': 0.47393364928909953, 'recall': 0.352112676056338, 'f1-score': 0.40404040404040403, 'support': 284.0} | {'precision': 0.9333333333333333, 'recall': 0.2978723404255319, 'f1-score': 0.45161290322580644, 'support': 141.0} | {'precision': 0.7856328392246295, 'recall': 0.9731638418079096, 'f1-score': 0.8694006309148264, 'support': 708.0} | {'precision': 0.6642079381805409, 'recall': 0.4080707811825637, 'f1-score': 0.5055473867130063, 'support': 4634.0} | {'precision': 0.7170077628793226, 'recall': 0.8842471714534378, 'f1-score': 0.7918939984411536, 'support': 2298.0} | {'precision': 0.8606260075228371, 'recall': 0.9413709499669385, 'f1-score': 0.8991894452436927, 'support': 13611.0} | {'precision': 1.0, 'recall': 0.9978822187830904, 'f1-score': 0.9989399869536856, 'support': 12277.0} | 0.8782 | {'precision': 0.7763916472042519, 'recall': 0.6935314256679729, 'f1-score': 0.7029463936475108, 'support': 33953.0} | {'precision': 0.8699976208166521, 'recall': 0.8782140017082437, 'f1-score': 0.867649200314498, 'support': 33953.0} |
| No log | 4.0 | 164 | 0.2798 | {'precision': 0.5757575757575758, 'recall': 0.5352112676056338, 'f1-score': 0.5547445255474452, 'support': 284.0} | {'precision': 0.9054054054054054, 'recall': 0.475177304964539, 'f1-score': 0.6232558139534884, 'support': 141.0} | {'precision': 0.8377358490566038, 'recall': 0.940677966101695, 'f1-score': 0.8862275449101796, 'support': 708.0} | {'precision': 0.6079838528818121, 'recall': 0.5850237375917134, 'f1-score': 0.596282854943363, 'support': 4634.0} | {'precision': 0.8411037107516651, 'recall': 0.7693646649260226, 'f1-score': 0.8036363636363636, 'support': 2298.0} | {'precision': 0.8822353864820498, 'recall': 0.9081625156123724, 'f1-score': 0.8950112229382376, 'support': 13611.0} | {'precision': 1.0, 'recall': 0.9976378594119084, 'f1-score': 0.9988175331294598, 'support': 12277.0} | 0.8828 | {'precision': 0.8071745400478731, 'recall': 0.7444650451734122, 'f1-score': 0.7654251227226482, 'support': 33953.0} | {'precision': 0.881207953399647, 'recall': 0.882779135864283, 'f1-score': 0.8814327847290655, 'support': 33953.0} |
| No log | 5.0 | 205 | 0.2775 | {'precision': 0.6083333333333333, 'recall': 0.5140845070422535, 'f1-score': 0.5572519083969466, 'support': 284.0} | {'precision': 0.88, 'recall': 0.624113475177305, 'f1-score': 0.7302904564315352, 'support': 141.0} | {'precision': 0.8373266078184111, 'recall': 0.9378531073446328, 'f1-score': 0.8847435043304464, 'support': 708.0} | {'precision': 0.6361367606688295, 'recall': 0.5500647388864911, 'f1-score': 0.5899780118041893, 'support': 4634.0} | {'precision': 0.8413284132841329, 'recall': 0.793733681462141, 'f1-score': 0.8168383340797134, 'support': 2298.0} | {'precision': 0.8758342602892102, 'recall': 0.9255749026522665, 'f1-score': 0.9000178603322022, 'support': 13611.0} | {'precision': 1.0, 'recall': 0.9986967500203633, 'f1-score': 0.999347950118184, 'support': 12277.0} | 0.8874 | {'precision': 0.8112799107705595, 'recall': 0.7634458803693505, 'f1-score': 0.782638289356174, 'support': 33953.0} | {'precision': 0.8826579231427218, 'recall': 0.8874031749771744, 'f1-score': 0.8840991775809467, 'support': 33953.0} |
checkpoint-1053/optimizer.pt 1.0 GBcheckpoint-1134/optimizer.pt 1.0 GBcheckpoint-1215/optimizer.pt 1.0 GBcheckpoint-1296/optimizer.pt 1.0 GBcheckpoint-1377/optimizer.pt 1.0 GBcheckpoint-1458/optimizer.pt 1.0 GBcheckpoint-1539/optimizer.pt 1.0 GBcheckpoint-162/optimizer.pt 1.0 GBcheckpoint-1620/optimizer.pt 1.0 GBcheckpoint-1701/optimizer.pt 1.0 GBcheckpoint-1782/optimizer.pt 1.0 GBcheckpoint-1863/optimizer.pt 1.0 GBcheckpoint-1944/optimizer.pt 1.0 GBcheckpoint-2025/optimizer.pt 1.0 GBcheckpoint-2106/optimizer.pt 1.0 GBcheckpoint-2187/optimizer.pt 1.0 GBcheckpoint-2268/optimizer.pt 1.0 GBcheckpoint-2349/optimizer.pt 1.0 GBcheckpoint-243/optimizer.pt 1.0 GBcheckpoint-2430/optimizer.pt 1.0 GBcheckpoint-2511/optimizer.pt 1.0 GBcheckpoint-2592/optimizer.pt 1.0 GBcheckpoint-2673/optimizer.pt 1.0 GBcheckpoint-2754/optimizer.pt 1.0 GBcheckpoint-2835/optimizer.pt 1.0 GBcheckpoint-2916/optimizer.pt 1.0 GBcheckpoint-2997/optimizer.pt 1.0 GBcheckpoint-3078/optimizer.pt 1.0 GBcheckpoint-3159/optimizer.pt 1.0 GBcheckpoint-324/optimizer.pt 1.0 GBcheckpoint-3240/optimizer.pt 1.0 GBcheckpoint-3321/optimizer.pt 1.0 GBcheckpoint-3402/optimizer.pt 1.0 GBcheckpoint-3483/optimizer.pt 1.0 GBcheckpoint-3564/optimizer.pt 1.0 GBcheckpoint-3645/optimizer.pt 1.0 GBcheckpoint-3726/optimizer.pt 1.0 GBcheckpoint-3807/optimizer.pt 1.0 GBcheckpoint-3888/optimizer.pt 1.0 GBcheckpoint-3969/optimizer.pt 1.0 GBcheckpoint-405/optimizer.pt 1.0 GBcheckpoint-4050/optimizer.pt 1.0 GBcheckpoint-41/optimizer.pt 1.0 GBcheckpoint-486/optimizer.pt 1.0 GBcheckpoint-492/optimizer.pt 1.0 GBcheckpoint-567/optimizer.pt 1.0 GBcheckpoint-648/optimizer.pt 1.0 GBcheckpoint-729/optimizer.pt 1.0 GBcheckpoint-81/optimizer.pt 1.0 GBcheckpoint-810/optimizer.pt 1.0 GBcheckpoint-891/optimizer.pt 1.0 GBcheckpoint-972/optimizer.pt 1.0 GBcheckpoint-1053/model.safetensors 592 MBcheckpoint-1134/model.safetensors 592 MBcheckpoint-1215/model.safetensors 592 MBcheckpoint-1296/model.safetensors 592 MBcheckpoint-1377/model.safetensors 592 MBcheckpoint-1458/model.safetensors 592 MBcheckpoint-1539/model.safetensors 592 MBcheckpoint-162/model.safetensors 592 MBcheckpoint-1620/model.safetensors 592 MBcheckpoint-1701/model.safetensors 592 MBcheckpoint-1782/model.safetensors 592 MBcheckpoint-1863/model.safetensors 592 MBcheckpoint-1944/model.safetensors 592 MBcheckpoint-2025/model.safetensors 592 MBcheckpoint-2106/model.safetensors 592 MBcheckpoint-2187/model.safetensors 592 MBcheckpoint-2268/model.safetensors 592 MBcheckpoint-2349/model.safetensors 592 MBcheckpoint-243/model.safetensors 592 MBcheckpoint-2430/model.safetensors 592 MBcheckpoint-2511/model.safetensors 592 MBcheckpoint-2592/model.safetensors 592 MBcheckpoint-2673/model.safetensors 592 MBcheckpoint-2754/model.safetensors 592 MBcheckpoint-2835/model.safetensors 592 MBcheckpoint-2916/model.safetensors 592 MBcheckpoint-2997/model.safetensors 592 MBcheckpoint-3078/model.safetensors 592 MBcheckpoint-3159/model.safetensors 592 MBcheckpoint-324/model.safetensors 592 MBcheckpoint-3240/model.safetensors 592 MBcheckpoint-3321/model.safetensors 592 MBcheckpoint-3402/model.safetensors 592 MBcheckpoint-3483/model.safetensors 592 MBcheckpoint-3564/model.safetensors 592 MBcheckpoint-3645/model.safetensors 592 MBcheckpoint-3726/model.safetensors 592 MBcheckpoint-3807/model.safetensors 592 MBcheckpoint-3888/model.safetensors 592 MBcheckpoint-3969/model.safetensors 592 MBcheckpoint-405/model.safetensors 592 MBcheckpoint-4050/model.safetensors 592 MBcheckpoint-41/model.safetensors 592 MBcheckpoint-486/model.safetensors 592 MBcheckpoint-492/model.safetensors 592 MBcheckpoint-567/model.safetensors 592 MBcheckpoint-648/model.safetensors 592 MBcheckpoint-729/model.safetensors 592 MBcheckpoint-81/model.safetensors 592 MBcheckpoint-810/model.safetensors 592 MBcheckpoint-891/model.safetensors 592 MBcheckpoint-972/model.safetensors 592 MBmodel.safetensors 592 MBcheckpoint-1053/rng_state.pth 14.2 kBcheckpoint-1134/rng_state.pth 14.2 kBcheckpoint-1215/rng_state.pth 14.2 kBcheckpoint-1296/rng_state.pth 14.2 kBcheckpoint-1377/rng_state.pth 14.2 kBcheckpoint-1458/rng_state.pth 14.2 kBcheckpoint-1539/rng_state.pth 14.2 kBcheckpoint-162/rng_state.pth 14.2 kBcheckpoint-1620/rng_state.pth 14.2 kBcheckpoint-1701/rng_state.pth 14.2 kBcheckpoint-1782/rng_state.pth 14.2 kBcheckpoint-1863/rng_state.pth 14.2 kBcheckpoint-1944/rng_state.pth 14.2 kBcheckpoint-2025/rng_state.pth 14.2 kBcheckpoint-2106/rng_state.pth 14.2 kBcheckpoint-2187/rng_state.pth 14.2 kBcheckpoint-2268/rng_state.pth 14.2 kBcheckpoint-2349/rng_state.pth 14.2 kBcheckpoint-243/rng_state.pth 14.2 kBcheckpoint-2430/rng_state.pth 14.2 kBcheckpoint-2511/rng_state.pth 14.2 kBcheckpoint-2592/rng_state.pth 14.2 kBcheckpoint-2673/rng_state.pth 14.2 kBcheckpoint-2754/rng_state.pth 14.2 kBcheckpoint-2835/rng_state.pth 14.2 kBcheckpoint-2916/rng_state.pth 14.2 kBcheckpoint-2997/rng_state.pth 14.2 kBcheckpoint-3078/rng_state.pth 14.2 kBcheckpoint-3159/rng_state.pth 14.2 kBcheckpoint-324/rng_state.pth 14.2 kBcheckpoint-3240/rng_state.pth 14.2 kBcheckpoint-3321/rng_state.pth 14.2 kBcheckpoint-3402/rng_state.pth 14.2 kBcheckpoint-3483/rng_state.pth 14.2 kBcheckpoint-3564/rng_state.pth 14.2 kBcheckpoint-3645/rng_state.pth 14.2 kBcheckpoint-3726/rng_state.pth 14.2 kBcheckpoint-3807/rng_state.pth 14.2 kBcheckpoint-3888/rng_state.pth 14.2 kBcheckpoint-3969/rng_state.pth 14.2 kBcheckpoint-405/rng_state.pth 14.2 kBcheckpoint-4050/rng_state.pth 14.2 kBcheckpoint-41/rng_state.pth 14.2 kBcheckpoint-486/rng_state.pth 14.2 kBcheckpoint-492/rng_state.pth 14.2 kBcheckpoint-567/rng_state.pth 14.2 kBcheckpoint-648/rng_state.pth 14.2 kBcheckpoint-729/rng_state.pth 14.2 kBcheckpoint-81/rng_state.pth 14.2 kBcheckpoint-810/rng_state.pth 14.2 kBcheckpoint-891/rng_state.pth 14.2 kBcheckpoint-972/rng_state.pth 14.2 kBcheckpoint-41/training_args.bin 5.2 kBtraining_args.bin 5.2 kBcheckpoint-1053/training_args.bin 4.9 kBcheckpoint-1134/training_args.bin 4.9 kBcheckpoint-1215/training_args.bin 4.9 kBcheckpoint-1296/training_args.bin 4.9 kBcheckpoint-1377/training_args.bin 4.9 kBcheckpoint-1458/training_args.bin 4.9 kBcheckpoint-1539/training_args.bin 4.9 kBcheckpoint-162/training_args.bin 4.9 kBcheckpoint-1620/training_args.bin 4.9 kBcheckpoint-1701/training_args.bin 4.9 kBcheckpoint-1782/training_args.bin 4.9 kBcheckpoint-1863/training_args.bin 4.9 kBcheckpoint-1944/training_args.bin 4.9 kBcheckpoint-2025/training_args.bin 4.9 kBcheckpoint-2106/training_args.bin 4.9 kBcheckpoint-2187/training_args.bin 4.9 kBcheckpoint-2268/training_args.bin 4.9 kBcheckpoint-2349/training_args.bin 4.9 kBcheckpoint-243/training_args.bin 4.9 kBcheckpoint-2430/training_args.bin 4.9 kBcheckpoint-2511/training_args.bin 4.9 kBcheckpoint-2592/training_args.bin 4.9 kBcheckpoint-2673/training_args.bin 4.9 kBcheckpoint-2754/training_args.bin 4.9 kBcheckpoint-2835/training_args.bin 4.9 kBcheckpoint-2916/training_args.bin 4.9 kBcheckpoint-2997/training_args.bin 4.9 kBcheckpoint-3078/training_args.bin 4.9 kBcheckpoint-3159/training_args.bin 4.9 kBcheckpoint-324/training_args.bin 4.9 kBcheckpoint-3240/training_args.bin 4.9 kBcheckpoint-3321/training_args.bin 4.9 kBcheckpoint-3402/training_args.bin 4.9 kBcheckpoint-3483/training_args.bin 4.9 kBcheckpoint-3564/training_args.bin 4.9 kBcheckpoint-3645/training_args.bin 4.9 kBcheckpoint-3726/training_args.bin 4.9 kBcheckpoint-3807/training_args.bin 4.9 kBcheckpoint-3888/training_args.bin 4.9 kBcheckpoint-3969/training_args.bin 4.9 kBcheckpoint-405/training_args.bin 4.9 kBcheckpoint-4050/training_args.bin 4.9 kBcheckpoint-486/training_args.bin 4.9 kBcheckpoint-567/training_args.bin 4.9 kBcheckpoint-648/training_args.bin 4.9 kBcheckpoint-729/training_args.bin 4.9 kBcheckpoint-81/training_args.bin 4.9 kBcheckpoint-810/training_args.bin 4.9 kBcheckpoint-891/training_args.bin 4.9 kBcheckpoint-972/training_args.bin 4.9 kBcheckpoint-492/training_args.bin 4.7 kBcheckpoint-1053/scheduler.pt 1.1 kBcheckpoint-1134/scheduler.pt 1.1 kBcheckpoint-1215/scheduler.pt 1.1 kBcheckpoint-1296/scheduler.pt 1.1 kBcheckpoint-1377/scheduler.pt 1.1 kBcheckpoint-1458/scheduler.pt 1.1 kBcheckpoint-1539/scheduler.pt 1.1 kBcheckpoint-162/scheduler.pt 1.1 kBcheckpoint-1620/scheduler.pt 1.1 kBcheckpoint-1701/scheduler.pt 1.1 kBcheckpoint-1782/scheduler.pt 1.1 kBcheckpoint-1863/scheduler.pt 1.1 kBcheckpoint-1944/scheduler.pt 1.1 kBcheckpoint-2025/scheduler.pt 1.1 kBcheckpoint-2106/scheduler.pt 1.1 kBcheckpoint-2187/scheduler.pt 1.1 kBcheckpoint-2268/scheduler.pt 1.1 kBcheckpoint-2349/scheduler.pt 1.1 kBcheckpoint-243/scheduler.pt 1.1 kBcheckpoint-2430/scheduler.pt 1.1 kBcheckpoint-2511/scheduler.pt 1.1 kBcheckpoint-2592/scheduler.pt 1.1 kBcheckpoint-2673/scheduler.pt 1.1 kBcheckpoint-2754/scheduler.pt 1.1 kBcheckpoint-2835/scheduler.pt 1.1 kBcheckpoint-2916/scheduler.pt 1.1 kBcheckpoint-2997/scheduler.pt 1.1 kBcheckpoint-3078/scheduler.pt 1.1 kBcheckpoint-3159/scheduler.pt 1.1 kBcheckpoint-324/scheduler.pt 1.1 kBcheckpoint-3240/scheduler.pt 1.1 kBcheckpoint-3321/scheduler.pt 1.1 kBcheckpoint-3402/scheduler.pt 1.1 kBcheckpoint-3483/scheduler.pt 1.1 kBcheckpoint-3564/scheduler.pt 1.1 kBcheckpoint-3645/scheduler.pt 1.1 kBcheckpoint-3726/scheduler.pt 1.1 kBcheckpoint-3807/scheduler.pt 1.1 kBcheckpoint-3888/scheduler.pt 1.1 kBcheckpoint-3969/scheduler.pt 1.1 kBcheckpoint-405/scheduler.pt 1.1 kBcheckpoint-4050/scheduler.pt 1.1 kBcheckpoint-41/scheduler.pt 1.1 kBcheckpoint-486/scheduler.pt 1.1 kBcheckpoint-492/scheduler.pt 1.1 kBcheckpoint-567/scheduler.pt 1.1 kBcheckpoint-648/scheduler.pt 1.1 kBcheckpoint-729/scheduler.pt 1.1 kBcheckpoint-81/scheduler.pt 1.1 kBcheckpoint-810/scheduler.pt 1.1 kBcheckpoint-891/scheduler.pt 1.1 kBcheckpoint-972/scheduler.pt 1.1 kBallenai/longformer-base-4096