mlx-community/gemma-4-E4B-it-qat-4bit
Use with mlx
pip install -U mlx-vlm
python -m mlx_vlm.generate --model mlx-community/gemma-4-E4B-it-qat-4bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
pip install -U mlx-vlm
python -m mlx_vlm.generate --model mlx-community/gemma-4-E4B-it-qat-4bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>