Gemma 3 27B Tools - 4-bit MLX Quantization

Follow me on X @BennyDaBall_OG !

This is a 4-bit MLX quantization of the ZySec-AI/gemma-3-27b-tools model.

Model Description

This repository contains a quantized version of Google's Gemma 3 27B model with tools, optimized for running with Apple's MLX framework. The quantization process reduces the model's size and computational requirements, making it suitable for deployment on devices with limited resources, such as Apple Silicon Macs.

For more details on the original model, please refer to the original model card.

Follow me on X @BennyDaBall_OG !