whisper-small-pashto

This model is a fine-tuned version of openai/whisper-small for Pashto speech recognition, trained on Common Voice Scripted Speech 27.0 - Pashto (train split).

Results

Normalized WER ignores punctuation, diacritics and letters Pashto writers use interchangeably (ي/ی, ك/ک, ګ/گ, Arabic-Indic digits), so two spellings of the same words do not count as an error. The untuned model often writes Pashto in Latin letters or adds words, which puts its WER above 100. The spontaneous-speech set is unscripted speech the model was not trained on.

During training, on 500 dev clips: loss 0.3107, raw WER 29.10.

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 1e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 500
• training_steps: 5000
• mixed_precision_training: Native AMP

Training results

Framework versions

• Transformers 5.21.0
• Pytorch 2.11.0+cu128
• Datasets 4.8.5
• Tokenizers 0.23.3