Moonshine Streaming Tiny

Model Overview

Moonshine is a high-efficiency automatic speech recognition (ASR) model designed specifically for real-time speech recognition. Unlike Whisper, which processes audio in fixed 30-second chunks, Moonshine uses a variable-length architecture that only computes the actual duration of the speech received.

Useful Sensors developed Moonshine and released the English model as open-source. There are 2 models of different sizes and capabilities - base and tiny. The tiny version utilizes 27M parameters.

Moonshine Streaming Tiny is based on Moonshine V2, released in 2026, introduced sliding window attention in the encoder part of the model. This means we no longer need to wait for the full-length of speech to start emitting the first token, reducing the time-to-first-token (TTFT) as the encoder can now "stream" the encoding frames to the decoder.

Model Features

• Model Type: Automatic Speech Recognition
• Input: Raw waveform (1D array of floats) 16kHz mono audio up to 30 seconds
• Output: Sequence of token IDs (integers)
• Quantization: None

Recommended Platforms

• Synaptics Astra™ SL2600-Series with Torq

Metrics

Deployment

Compiled Models

Torq compiled model files are provided in this repository. To recompile the models, see the Torq Documentation.

Source Models

The source model files are available at TBD.

Usage Tutorials / Example Apps

Example App GitHub Repositories

• Moonshine Streaming Example (moonshine_streaming) in Torq Examples: Basic model usage examples for Torq

License

Both the source model and the compiled model for on-device deployment are licensed under MIT License.

Learn More

• Synaptics AI Developer Zone: Get started with documentation, tutorials and resources for your Edge AI journey.
• Astra Support Portal: Connect with our engineering team and community.