dicksondickson/granite-4.2-8b-oQ8e-bf16-MLX
[!NOTE] Updated Oct 18, 2026: Re-quantized with oMLX 0.7.1.dev1 with improved oQe Quantization. Please re-download if you have an earlier copy.
This model is a quantization of: https://huggingface.co/ibm-granite/granite-4.2-8b
This checkpoint was quantized using oMLX 0.7.1.dev1 with imatrix enabled.
Important tensors are left at bf16 which is for Apple M3 chips and later.
Run the model using oMLX: https://github.com/jundot/omlx