vanch007/Huihui-MiniCPM-V-4.6-abliterated-mlx-bf16

Source: 🤗image-text-to-textapache-2.01.3B params2.6 GBsafetensors✓ 2 checksumsupdated 165d ago
or submit a torrent

Huihui-MiniCPM-V-4.6-abliterated-mlx-bf16

Converted from huihui-ai/Huihui-MiniCPM-V-4.6-abliterated with mlx-vlm from the current main branch.

Conversion

  • Source: huihui-ai/Huihui-MiniCPM-V-4.6-abliterated
  • Format: MLX
  • Quantization: bfloat16
  • Processor files: processor_config.json + preprocessor_config.json

Smoke test

  • Prompt: Describe this image in one sentence.
  • Image: 64x64 solid red PNG
  • Result: The image is a solid red color, with no discernible features or objects.

Usage

python -m mlx_vlm.generate --model vanch007/Huihui-MiniCPM-V-4.6-abliterated-mlx-bf16 --max-tokens 32 --temperature 0.0 --trust-remote-code --prompt "Describe this image in one sentence." --image <path_to_image>