This repository contains the speaker embedding models for our Zonos-v0.1 transformer and hybrid models.
The speaker embedding models are based on the ResNet293-SimAM-ASP models from VoxBlink2. We use the pretrain models as we found the finetunes performed worse.
The output of the speaker embedding model is then passed through an LDA layer and compressed from 256 to 128 dimensions to remove further spurious information about the speaker embedding clip before being fed into the Zonos models.