seda-v0.1: streaming Turkish speech recognition

seda-v0.1 is a small, low-latency speech recognition model for Turkish. It is a streaming Zipformer2 transducer (66M parameters) trained with icefall, exported to int8 ONNX, and run with sherpa-onnx.

• Streaming. Words appear while the speaker is still talking. The final result arrives about 40 ms after the audio ends.
• Lightweight. On a single CPU thread it runs about 30× faster than real time and needs about 170 MB of RAM.
• Accurate. It reaches 11.5% WER on FLEURS-TR. That is on par with Whisper small (11.9%), which is 3.7× larger and offline-only.

Model details

Files

Usage

The model runs with sedalib, a small Python package built on sherpa-onnx. It downloads and caches the model from the Hub for you.

pip install sedalib

from sedalib import Recognizer, read_wav

samples, sample_rate = read_wav("speech.wav")  # 16-bit PCM WAV, mono float samples

recognizer = Recognizer.from_pretrained("atasoglu/seda-v0.1")
print(recognizer.transcribe(samples, sample_rate))

Audio at other sample rates is resampled automatically. Pass use_lm=False to from_pretrained to skip the language model for the fastest setup.

For live input, open a stream and feed it small pieces (for example 100 ms from a microphone). accept returns the partial transcript, and is_endpoint tells you when an utterance has ended:

stream = recognizer.stream()

for chunk in microphone_chunks():
    print(stream.accept(chunk, sample_rate=16000))
    if stream.is_endpoint:
        print("final:", stream.text)
        stream.reset()

print(stream.finish())  # flush the remaining frames

The model also works directly with sherpa-onnx if you prefer to use it without sedalib.

Training

• Data: about 415 h in total.
  • Common Voice 27.0 Turkish train: about 69 h of unique audio, about 206 h with 0.9/1.0/1.1 speed perturbation.
  • ISSAI Turkish Speech Corpus train: 209 h after cleanup.
  • Training sentences that also occur in the CV dev/test sets were removed.
• Recipe:
  1. A CV-only model was trained from scratch for 40 epochs.
  2. Training continued from its weights for 12 epochs on the CV + ISSAI mix (LR 0.01).
  3. The release model averages epochs 5–12 (avg 8).
  • The released export uses a 0.64 s chunk with 128 frames of left context.
• Language model:
  • Trained on Turkish Wikipedia (20231101 dump) plus the ASR training transcripts: 8.1M sentences, 109M words.
  • Sentences overlapping FLEURS, CV or ISSAI dev/test were filtered out.
  • The LM scales (0.6 / −0.5) were tuned on FLEURS dev only.

Evaluation

WER (%), streaming, CPU int8, chunk 32. References and hypotheses were normalized the same way: lowercase, no punctuation, numbers spelled out.

Speed and latency measured on 1 CPU thread with the int8 model:

• The RAM increase per extra concurrent stream is about 1.4 MB.
• With beam 4 + LM, the median first-word latency is 0.70 s and the final result arrives about 40 ms after the audio ends.

On FLEURS-TR, Whisper small (244M, offline, beam 5) scores 11.90% WER under the same normalization. The 0.4-point difference is within the 95% bootstrap confidence interval, so the two models are on par.

Limitations

• Output is spoken form. The output has no casing, punctuation or digits. A rule-based inverse text normalizer, which turns spoken numbers into digits, is not part of this release.
• Foreign names and abbreviations are the main error source. Examples include USOC and Super-G.
• Read speech dominates the training data. Accuracy on spontaneous, noisy, far-field or telephone speech has not been measured.
• ISSAI test is in-domain. It comes from the same corpus as part of the training data.
• The LM favours encyclopedic text. It gains −3.6 WER on FLEURS but only −0.8 on ISSAI. Some ISSAI audio comes from YouTube.

License

• Acoustic model (encoder-*, decoder-*, joiner-*, tokens.txt): Apache-2.0.
  • It was trained on Common Voice (CC0) and the ISSAI Turkish Speech Corpus.
  • The ISSAI corpus is published under MIT on Hugging Face and under CC BY 4.0 by ISSAI; attribution is given below.
• Language model files (lm/): CC BY-SA 4.0, because they were trained on Turkish Wikipedia text.
  • They are optional and can be left out if ShareAlike terms do not suit your use.

Acknowledgements and citation

The model was built with k2, icefall, lhotse and sherpa-onnx. It was trained on data from Mozilla Common Voice, the ISSAI Turkish Speech Corpus and Wikipedia.

@article{mussakhojayeva2023turkic,
  title   = {Multilingual Speech Recognition for Turkic Languages},
  author  = {Mussakhojayeva, Saida and Dauletbek, Kaisar and Yeshpanov, Rustem and Varol, Huseyin Atakan},
  journal = {Information},
  volume  = {14},
  number  = {2},
  pages   = {74},
  year    = {2023}
}
@inproceedings{ardila2020common,
  title     = {Common Voice: A Massively-Multilingual Speech Corpus},
  author    = {Ardila, Rosana and Branson, Megan and Davis, Kelly and Henretty, Michael and Kohler, Michael and Meyer, Josh and Morais, Reuben and Saunders, Lindsay and Tyers, Francis M. and Weber, Gregor},
  booktitle = {Proceedings of LREC},
  year      = {2020}
}
@inproceedings{yao2024zipformer,
  title     = {Zipformer: A Faster and Better Encoder for Automatic Speech Recognition},
  author    = {Yao, Zengwei and Guo, Liyong and Yang, Xiaoyu and Kang, Wei and Kuang, Fangjun and Yang, Yifan and Jin, Zengrui and Lin, Long and Povey, Daniel},
  booktitle = {ICLR},
  year      = {2024}
}