Moonshine student m7g, SAPC2 compression ladder
Fine-tuned for the Speech Accessibility Project Challenge 2 (SAPC2): English speech from speakers with ALS, cerebral palsy, Down syndrome, Parkinson's disease and stroke.
Evaluation
The checkpoint was selected on a fixed 1,000-recording subset of the official Dev set; the scores below are on the full Dev set (47,929 recordings). Scores use the competition normalizer against the better of the two references; they are within about 0.1 points of the official SCTK scorer on the same predictions.
Full Dev (47,929 recordings)
Whole-recording decoding (200 s windows), quick scorer (competition normalizer, better of the two references).
| decoding | WER | CER | empty transcripts | capped (ran to the token limit) |
|---|---|---|---|---|
| greedy | 51.96% | 36.41% | 0 | 55 |
| beam 4 | 45.77% | 31.86% | 0 | 82 |
Exact transcripts 35.09%; substitutions 39.10%, deletions 6.50%, insertions 9.28% of reference words (uncapped WER 54.88%).
WER by duration
| bucket | recordings | WER | share of all errors |
|---|---|---|---|
| 1-2s | 670 | 45.00% | 0.31% |
| 2-3s | 4354 | 31.30% | 2.15% |
| 3-5s | 14700 | 32.96% | 9.93% |
| 5-8s | 14739 | 42.40% | 18.07% |
| 8-12s | 7023 | 53.40% | 15.51% |
| 12-20s | 3867 | 60.62% | 15.85% |
| 20-35s | 1657 | 64.60% | 16.19% |
| >35s | 919 | 68.73% | 21.99% |
WER by etiology
| etiology | recordings | WER | share of all errors |
|---|---|---|---|
| ALS | 10232 | 48.36% | 20.31% |
| Cerebral Palsy | 11472 | 58.97% | 22.04% |
| Down Syndrome | 7719 | 52.74% | 11.95% |
| Parkinson's Disease | 14543 | 51.67% | 41.16% |
| Stroke | 3963 | 44.45% | 4.54% |
Runaway transcripts (hypothesis over 1.5x the reference length): 1205, 6.74% of all errors; truncated transcripts: 557.
Training recipe
{
"init": "runs/from_modal/m7g/best",
"teacher": "runs/from_modal/m15s2/best",
"kd_weight": 0.5,
"peak_lr": 2e-05,
"epochs": 1,
"balanced": true,
"balance_max_repeats": 2,
"policy": {
"max_items": 192,
"padded_seconds": 1152,
"attention_cost": 12000,
"decoder_tokens": 24576,
"accumulation": 8
},
"seed": 20261026
}
Optimizer: blocked SOAP (Adam in a Shampoo eigenbasis), FP32 weights with BF16 autocast.
Code: the moonshine package in the project repository (training, distillation, RL and
evaluation), with resumable checkpoints.
Files
Hugging Face format (config.json, model.safetensors, tokenizer/processor files). Load with
transformers (MoonshineForConditionalGeneration or CohereAsrForConditionalGeneration).