This model is Whisper small, fine-tuned for Arabic speech, with a focus on Gulf and Emirati Arabic. It keeps the English quality of the base model. The files are in the CTranslate2 format (float16), for faster-whisper.
ScriptVox uses this model for local speech to text when the language is Arabic (--lang ar).
| Item | Value |
|---|---|
| Base model | openai/whisper-small |
| Version | r12-a70 |
| Format | CTranslate2, float16, 484 MB |
| Languages | Arabic (Gulf, Emirati, other dialects, Modern Standard Arabic) and English |
| Licence | Apache-2.0 |
With ScriptVox:
scriptvox setup speech-local --arabic
scriptvox analyze clip.mp4 --transcript --lang ar
With faster-whisper:
from faster_whisper import WhisperModel
model = WhisperModel("scriptvox/whisper-small-ar", compute_type="int8")
segments, info = model.transcribe("clip.wav", language="ar", word_timestamps=True)
for s in segments:
print(s.start, s.end, s.text)
Word error rate (WER). Lower is better. The base is openai/whisper-small with the same decoder and the same text normalisation. The interval is a 95 percent paired bootstrap over clips.
| Test set | Clips | Base | This model | Change |
|---|---|---|---|---|
| Gulf Arabic (speakers and prompts not in training) | 402 | 41.32 % | 27.82 % | -32.7 % (-35.3 to -30.2) |
| Arabic, FLEURS test | 428 | 26.36 % | 17.69 % | -32.9 % (-36.5 to -29.3) |
| Emirati Arabic (a corpus not used in training) | 1,048 | 26.52 % | 20.63 % | -22.2 % (-24.7 to -19.5) |
| English, FLEURS test | 647 | 6.52 % | 6.44 % | -1.2 % (-6.1 to +4.2) |
Long recordings, about 8.5 minutes each, decoded in 30 second windows:
| Recording | WER | Gaps longer than 5 s with no words |
|---|---|---|
| Emirati, 533 s | 21.4 % | 0 |
| Gulf, 513 s | 27.9 % | 0 |
Word times are usable on all clips of the four test sets. The model writes punctuation on 94 to 100 percent of the clips.
openai/whisper-small for 14,000 steps at a learning rate of 1e-5.Training data:
| Data | Licence |
|---|---|
| Meta Omnilingual ASR Corpus: Gulf Arabic and 13 other Arabic dialects | CC BY 4.0 |
| Mozilla Common Voice 18, Arabic | CC0 |
| Google FLEURS, Arabic and English | CC BY 4.0 |
| LibriSpeech, English, with text from Whisper large-v3 | CC BY 4.0 |
No audio from YouTube or from other web video is in the training data.
| File | sha256 |
|---|---|
| model.bin | f09579e04bcbca6f42ab69ca2eba36ecb1a0e093a9eac2c93fc3eac93a829f8c |
| config.json | b55496ac7940a7ae47d2c01eab40edfd8701feec1229d9cce3b40014383fb828 |
| preprocessor_config.json | 994838f1fa6462c8b9b3c90edada831f11f3dd8b4664634e18f4694d005c9dbf |
| tokenizer.json | 27fc476bfe7f17299480be2273fc0608e4d5a99aba2ab5dec5374b4482d1a566 |
| vocabulary.json | 5ad28279db5e546349708b9a74736e2c018737ac5a600f1048f1f26c99b85b47 |
openai/whisper-small