中文Sign up

vanch007/Huihui-MiniCPM-V-4.6-abliterated-mlx-nvfp4

Source: 🤗image-text-to-textapache-2.01.3B params2.6 GBsafetensors✓ 2 checksumsupdated 165d ago
or submit a torrent

Huihui-MiniCPM-V-4.6-abliterated-mlx-nvfp4

Converted from huihui-ai/Huihui-MiniCPM-V-4.6-abliterated with mlx-vlm from the current main branch.

Conversion

  • Source: huihui-ai/Huihui-MiniCPM-V-4.6-abliterated
  • Format: MLX
  • Quantization: bfloat16 + nvfp4
  • Processor files: processor_config.json + preprocessor_config.json

Smoke test

  • Prompt: Describe this image in one sentence.
  • Image: 64x64 solid red PNG
  • Result: The image is entirely filled with a solid red color.

Usage

python -m mlx_vlm.generate --model vanch007/Huihui-MiniCPM-V-4.6-abliterated-mlx-nvfp4 --max-tokens 32 --temperature 0.0 --trust-remote-code --prompt "Describe this image in one sentence." --image <path_to_image>