USS ResUNet30 (MLX)

Universal source separation — extracts a chosen sound class from a mixture. Converted to MLX from the ByteDance USS code and the published RSNuts/Universal_Source_Separation checkpoint.

Files

Precision

Bold marks the best value in each column. Quality is fp16 against this model's own fp32 output — the cost of the precision change, not a score for the model.

fp16 halves the download. On the machine below it was also slightly slower and used slightly more memory than fp32, since the forward pass dominates the footprint rather than the weights.

Measured on an Apple M1 Pro (16 GB), 30 s of audio, three timed runs per configuration; speed is realtime factor. These are single-machine figures — expect different absolute numbers on other hardware, and treat the ordering as indicative rather than guaranteed.

Conditioning

USS is conditioned on a 527-dimensional vector over the AudioSet classes, which selects what the separator extracts. It is an input rather than a model weight and is not shipped here: each vector is a normalised multi-hot indicator over a class group — zero everywhere, 1/n at each of the n chosen indices — so a class list fully determines it.

Class indices follow AudioSet's class_labels_indices.csv, published by Google with the dataset under CC BY 4.0.

Used by

AudioToolSwift