What's that?
MXFP4_MOE quantization of the emerging roleplay workhorse Vortex5/G4-Dark-Soul-26B-A4B
Use case
Running the model on consumer-grade Blackwell GPUs with 16gb+ of VRAM.
Disclosure
My only contribution is compute. This is not my merge. Have fun.
Cheers
Google - the base model.
Vortex5 - for the merge effort.
Everyone whose finetunes were included in the merge!