whisper-small-mn-v24

Fine-tune of openai/whisper-small for Mongolian (mn) automatic speech recognition, trained on Blgn94/mongolian-stt-dataset-v24.

This is the v24 iteration and improves substantially over the previous release Blgn94/whisper-small-mn.

Results

That is a ~31% relative WER reduction and ~36% relative CER reduction over the previous model.

Note on measurement: these numbers are from a fixed 200-sample subset of the validation split, evaluated with predict_with_generate during training (the same protocol used for the previous model, so the comparison is apples-to-apples). A full 2,297-row validation evaluation has not yet been run; the full-set figures may differ slightly.

Usage

from transformers import pipeline

asr = pipeline("automatic-speech-recognition", model="Blgn94/whisper-small-mn-v24")
result = asr("audio.mp3", generate_kwargs={"language": "mongolian", "task": "transcribe"})
print(result["text"])

Or with the model/processor directly:

import torch, librosa
from transformers import WhisperProcessor, WhisperForConditionalGeneration

processor = WhisperProcessor.from_pretrained("Blgn94/whisper-small-mn-v24", language="mongolian", task="transcribe")
model = WhisperForConditionalGeneration.from_pretrained("Blgn94/whisper-small-mn-v24")

audio, _ = librosa.load("audio.mp3", sr=16000)
inputs = processor(audio, sampling_rate=16000, return_tensors="pt")
ids = model.generate(inputs.input_features, language="mongolian", task="transcribe")
print(processor.batch_decode(ids, skip_special_tokens=True)[0])

Audio is expected at 16 kHz mono. Keep clips within Whisper's 30 s window.

Training data

Blgn94/mongolian-stt-dataset-v24 — a combined Mongolian read-speech and subtitle corpus (~77 h of audio, 16 kHz).

Preprocessing: rows whose tokenized transcript exceeded 440 tokens (near Whisper's 448-token decoder limit) were dropped — 41 from train and 2 from validation — leaving 95,946 train / 2,297 validation clips.

Training procedure

Fine-tuned from openai/whisper-small (244M params).

Hardware: single NVIDIA RTX 5060 (8 GB). Full run took ~6.5 h.

The model, task, and language tokens were set for Mongolian transcription (language="mongolian", task="transcribe"); forced_decoder_ids was cleared so decoding follows the fine-tuned distribution.

Limitations

• The training data is ~92% Common Voice (read speech), so accuracy is strongest on clear, read-style Mongolian and weaker on spontaneous, conversational, noisy, or telephony audio.
• Cyrillic Mongolian only.
• Inherits Whisper's tendency to hallucinate on silence or non-speech segments.

Base model & license

Derived from openai/whisper-small; released under Apache-2.0.