JEV-9B-MLX-8bit

MLX conversion of autotrust/JEV-9B for mlx-vlm, with the System 1 LoRA (including its lm_head update) merged and lm_head, the decision readout, kept unquantized. JEV is a decision model: it returns a probability for every option of a question in one forward pass and does not generate text.

JEV support is not yet in an mlx-vlm release:

pip install "git+https://github.com/Lazarus-931/mlx-vlm.git@feat/jev"

from mlx_vlm import load, predict

model, processor = load("nativ-community/JEV-9B-MLX-8bit")
result = predict(model, processor, "The parcel arrived damaged and I want my money back.", {
    "refund": {"type": "bool", "instructions": "Is the customer asking for a refund?"},
})
print(result["answers"]["refund"]["value"])