This model was converted to MLX format from NousResearch/Arete-27B
using mlx-vlm version 0.7.12.
Refer to the original model card for more details on the model.
pip install -U mlx-vlm
python -m mlx_vlm.generate --model pjain001/arete-27b-8bit-mlx --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
model-00002-of-00006.safetensors 5.3 GBmodel-00004-of-00006.safetensors 5.3 GBmodel-00003-of-00006.safetensors 5.3 GBmodel-00005-of-00006.safetensors 5.3 GBmodel-00001-of-00006.safetensors 5.3 GBmodel-00006-of-00006.safetensors 2.2 GBNousResearch/Arete-27B