audio-mnist-cnn

A small spectrogram CNN that classifies spoken digits 0–9 from 1 second of 16 kHz mono audio. Trained from scratch on AudioMNIST — specifically the gilkeyio/AudioMNIST mirror on the Hub — with a speaker-disjoint train/val/test split.

Live demo: https://huggingface.co/spaces/fergarciadlc/audio-mnist-demo

Files

Quickstart

import torch, yaml
from huggingface_hub import hf_hub_download

REPO = "fergarciadlc/audio-mnist-cnn"
ckpt_path = hf_hub_download(REPO, "best_model.pt")
cfg_path  = hf_hub_download(REPO, "config_snapshot.yaml")

state = torch.load(ckpt_path, map_location="cpu")
cfg   = yaml.safe_load(open(cfg_path))
# Build your model from cfg["model"] and load state["model_state"].

The reference inference loop (load audio → 16 kHz mono → center pad/crop to 1.0 s → log-mel spectrogram → CNN → softmax) lives in the demo Space: https://huggingface.co/spaces/fergarciadlc/audio-mnist-demo/tree/main.

Model

• Architecture: 4 conv blocks (32 → 64 → 128 → 256 channels, 3×3 kernels, BatchNorm + ReLU + MaxPool + Dropout(0.3)) → adaptive average pool → MLP head (128 units, dropout 0.3) → 10-way softmax.
• Input: log-mel spectrogram, shape (101 frames, 64 mels), mean-std normalized with fixed stats (mean −40 dB, std 20 dB).
• Parameters: ~430k. Checkpoint size ~1.7 MB.

Preprocessing

Training

• Dataset: gilkeyio/AudioMNIST — 30,000 utterances, 60 speakers, digits 0–9. Credit to @gilkeyio for hosting the Hub mirror; original dataset by Becker et al. (arXiv:1807.03418).
• Split: speaker-disjoint 80/10/10 (seed 42). No speaker appears in more than one split, so test metrics reflect generalization to new speakers.
• Optimizer: Adam, lr 1e-3, batch size 64.
• Schedule: up to 30 epochs with early stopping on val_accuracy (patience 8) and ReduceLROnPlateau on val_loss (factor 0.5, patience 3).
• Loss: cross-entropy.

Evaluation

On the speaker-disjoint test split (3,000 clips, 6 unseen speakers):

Intended use & limitations

• Intended for: demos, education, lightweight on-device digit classification of short, clean speech.
• Out of distribution: noisy environments, distant mics, accents under-represented in AudioMNIST, non-digit speech, and audio outside the 0.5–1.0 s typical clip length. Real-world laptop-mic audio (HVAC, keyboard noise) shows a noticeable drop vs. clean test numbers. No data augmentation (SpecAugment / additive noise) was used during training.
• Not suitable for: anything safety- or identity-critical.

Source

Training pipeline, configs, and MLflow tracking: https://github.com/fergarciadlc/audio-mnist.