ihanif/whisper-tiny-ps

Source: 🤗automatic-speech-recognitionapache-2.0153 MBother✓ 21 checksumsupdated 1,428d ago

Whisper Tiny Pashto

This model is a fine-tuned version of openai/whisper-tiny on the google/fleurs ps_af dataset. It achieves the following results on the evaluation set:

Loss: 2.0279
Wer: 497.2231

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 1e-05
train_batch_size: 64
eval_batch_size: 32
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 500
training_steps: 700
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Wer
2.9393	14.29	100	2.9025	369.2645
2.7124	28.57	200	2.7165	407.9222
2.4773	42.86	300	2.4649	449.5006
2.3142	57.14	400	2.3466	473.6002
2.2942	71.43	500	2.3101	485.9867
2.0644	85.71	600	2.0926	491.4800
1.9799	100.0	700	2.0279	497.2231

Framework versions

Transformers 4.26.0.dev0
Pytorch 1.13.1+cu117
Datasets 2.7.1.dev0
Tokenizers 0.13.2

Weights

Original

F32151 MB
2 files
pytorch_model.bin 151 MBtraining_args.bin 3.6 kB

Seed this model

Have the files? Submit a torrent.

Submit a torrent

Package the files with one command

Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo ihanif/whisper-tiny-ps ./model-folder