clef-flash-MLX-8bit

MLX conversion of Cloudflare/clef-flash for mlx-vlm. Clef is a decision model: it returns a probability for every option of every question in one forward pass and does not generate text.

Clef support is not yet in an mlx-vlm release:

pip install "git+https://github.com/Lazarus-931/mlx-vlm.git@feat/clef"

from mlx_vlm import load, predict

model, processor = load("nativ-community/clef-flash-MLX-8bit")
result = predict(model, processor, "Please refund my duplicate charge", {
    "department": {
        "type": "choice",
        "instructions": "Which team should handle this ticket?",
        "criteria": ["billing", "technical", "sales"],
    },
})
print(result["answers"]["department"]["value"])