marlex7/tiny-bert-sst2-distilled

Source: 🤗At risk🏴‍☠️ Rescued by: isilicontext-classificationapache-2.04M params555 MBsafetensors✓ 7 checksumsupdated 1,089d ago

Magnet 0

tiny-bert-sst2-distilled

This model is a fine-tuned version of google/bert_uncased_L-2_H-128_A-2 on the glue dataset. It achieves the following results on the evaluation set:

Loss: 1.6692
Accuracy: 0.7947

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 4.787209189533254e-05
train_batch_size: 128
eval_batch_size: 128
seed: 33
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 2
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy
2.4226	1.0	527	1.7918	0.7844
1.5656	2.0	1054	1.6692	0.7947

Framework versions

Transformers 4.35.2
Pytorch 2.1.0+cu118
Datasets 2.14.7
Tokenizers 0.15.0

Loading…

CommentsShare your thoughts and shape the future of sovereign AI.

@marlex7 is unclaimedSign in with the matching Hugging Face account or an organization member account to verify this handle.Claim @marlex7

Files and sources

SourceAvailable on 🤗

Checksums7 awaiting witness

TorrentMagnet listed

Swarm0 seeders reported

Source revision: dbee1295428a…
Witnessed: Not yet
Swarm checked: 14 Nov 2026, 00:39 UTC
Weight files: 7
Model size: 555 MB
Downloads · last month: 12
Publisher: Unclaimed

Public checksum record coming on the next sync

Weights

Original

F32544 MB
52 files
run-0/checkpoint-1054/optimizer.pt 35 MBrun-0/checkpoint-4216/optimizer.pt 35 MBrun-0/checkpoint-527/optimizer.pt 35 MBrun-0/checkpoint-5270/optimizer.pt 35 MBrun-1/checkpoint-1054/optimizer.pt 35 MBrun-1/checkpoint-4216/optimizer.pt 35 MBrun-1/checkpoint-4743/optimizer.pt 35 MBrun-1/checkpoint-527/optimizer.pt 35 MBrun-2/checkpoint-1054/optimizer.pt 35 MBrun-2/checkpoint-527/optimizer.pt 35 MBmodel.safetensors 18 MBrun-0/checkpoint-1054/model.safetensors 18 MBrun-0/checkpoint-4216/model.safetensors 18 MBrun-0/checkpoint-527/model.safetensors 18 MBrun-0/checkpoint-5270/model.safetensors 18 MBrun-1/checkpoint-1054/model.safetensors 18 MBrun-1/checkpoint-4216/model.safetensors 18 MBrun-1/checkpoint-4743/model.safetensors 18 MBrun-1/checkpoint-527/model.safetensors 18 MBrun-2/checkpoint-1054/model.safetensors 18 MBrun-2/checkpoint-527/model.safetensors 18 MBrun-0/checkpoint-1054/rng_state.pth 14.3 kBrun-0/checkpoint-4216/rng_state.pth 14.3 kBrun-0/checkpoint-527/rng_state.pth 14.3 kBrun-0/checkpoint-5270/rng_state.pth 14.3 kBrun-1/checkpoint-1054/rng_state.pth 14.3 kBrun-1/checkpoint-4216/rng_state.pth 14.3 kBrun-1/checkpoint-4743/rng_state.pth 14.3 kBrun-1/checkpoint-527/rng_state.pth 14.3 kBrun-2/checkpoint-1054/rng_state.pth 14.3 kBrun-2/checkpoint-527/rng_state.pth 14.3 kBrun-0/checkpoint-1054/training_args.bin 4.7 kBrun-0/checkpoint-4216/training_args.bin 4.7 kBrun-0/checkpoint-527/training_args.bin 4.7 kBrun-0/checkpoint-5270/training_args.bin 4.7 kBrun-1/checkpoint-1054/training_args.bin 4.7 kBrun-1/checkpoint-4216/training_args.bin 4.7 kBrun-1/checkpoint-4743/training_args.bin 4.7 kBrun-1/checkpoint-527/training_args.bin 4.7 kBrun-2/checkpoint-1054/training_args.bin 4.7 kBrun-2/checkpoint-527/training_args.bin 4.7 kBtraining_args.bin 4.7 kBrun-0/checkpoint-1054/scheduler.pt 1.1 kBrun-0/checkpoint-4216/scheduler.pt 1.1 kBrun-0/checkpoint-527/scheduler.pt 1.1 kBrun-0/checkpoint-5270/scheduler.pt 1.1 kBrun-1/checkpoint-1054/scheduler.pt 1.1 kBrun-1/checkpoint-4216/scheduler.pt 1.1 kBrun-1/checkpoint-4743/scheduler.pt 1.1 kBrun-1/checkpoint-527/scheduler.pt 1.1 kBrun-2/checkpoint-1054/scheduler.pt 1.1 kBrun-2/checkpoint-527/scheduler.pt 1.1 kB

Weights

Original

F32544 MB
52 files
run-0/checkpoint-1054/optimizer.pt 35 MBrun-0/checkpoint-4216/optimizer.pt 35 MBrun-0/checkpoint-527/optimizer.pt 35 MBrun-0/checkpoint-5270/optimizer.pt 35 MBrun-1/checkpoint-1054/optimizer.pt 35 MBrun-1/checkpoint-4216/optimizer.pt 35 MBrun-1/checkpoint-4743/optimizer.pt 35 MBrun-1/checkpoint-527/optimizer.pt 35 MBrun-2/checkpoint-1054/optimizer.pt 35 MBrun-2/checkpoint-527/optimizer.pt 35 MBmodel.safetensors 18 MBrun-0/checkpoint-1054/model.safetensors 18 MBrun-0/checkpoint-4216/model.safetensors 18 MBrun-0/checkpoint-527/model.safetensors 18 MBrun-0/checkpoint-5270/model.safetensors 18 MBrun-1/checkpoint-1054/model.safetensors 18 MBrun-1/checkpoint-4216/model.safetensors 18 MBrun-1/checkpoint-4743/model.safetensors 18 MBrun-1/checkpoint-527/model.safetensors 18 MBrun-2/checkpoint-1054/model.safetensors 18 MBrun-2/checkpoint-527/model.safetensors 18 MBrun-0/checkpoint-1054/rng_state.pth 14.3 kBrun-0/checkpoint-4216/rng_state.pth 14.3 kBrun-0/checkpoint-527/rng_state.pth 14.3 kBrun-0/checkpoint-5270/rng_state.pth 14.3 kBrun-1/checkpoint-1054/rng_state.pth 14.3 kBrun-1/checkpoint-4216/rng_state.pth 14.3 kBrun-1/checkpoint-4743/rng_state.pth 14.3 kBrun-1/checkpoint-527/rng_state.pth 14.3 kBrun-2/checkpoint-1054/rng_state.pth 14.3 kBrun-2/checkpoint-527/rng_state.pth 14.3 kBrun-0/checkpoint-1054/training_args.bin 4.7 kBrun-0/checkpoint-4216/training_args.bin 4.7 kBrun-0/checkpoint-527/training_args.bin 4.7 kBrun-0/checkpoint-5270/training_args.bin 4.7 kBrun-1/checkpoint-1054/training_args.bin 4.7 kBrun-1/checkpoint-4216/training_args.bin 4.7 kBrun-1/checkpoint-4743/training_args.bin 4.7 kBrun-1/checkpoint-527/training_args.bin 4.7 kBrun-2/checkpoint-1054/training_args.bin 4.7 kBrun-2/checkpoint-527/training_args.bin 4.7 kBtraining_args.bin 4.7 kBrun-0/checkpoint-1054/scheduler.pt 1.1 kBrun-0/checkpoint-4216/scheduler.pt 1.1 kBrun-0/checkpoint-527/scheduler.pt 1.1 kBrun-0/checkpoint-5270/scheduler.pt 1.1 kBrun-1/checkpoint-1054/scheduler.pt 1.1 kBrun-1/checkpoint-4216/scheduler.pt 1.1 kBrun-1/checkpoint-4743/scheduler.pt 1.1 kBrun-1/checkpoint-527/scheduler.pt 1.1 kBrun-2/checkpoint-1054/scheduler.pt 1.1 kBrun-2/checkpoint-527/scheduler.pt 1.1 kB