Compact affine 4-bit control with adapter-required 8-bit MoE router gates, BF16 vision, and native BF16 MTP. Built from ornith-ai/Ornith-1.5-35B-A3B revision fbb995a for Apple Silicon.
mtp/weights.safetensorsThe fail-closed precision recipe and conversion assertions are included in BUILD_RECIPE.json and conversion_receipt.json.
The matched AR/D1/D2/D3 sweep selected D1 at 124.21 decode tok/s on the qualification host.
mtplx serve \
--model Shiftedx/ornith-1.5-35b-a3b-affine4-router8-vision-mtplx \
--profile turbo \
--generation-mode mtp \
--load-mtp \
--depth 1
python -m mlx_vlm.generate \
--model Shiftedx/ornith-1.5-35b-a3b-affine4-router8-vision-mtplx \
--image image.jpg \
--prompt "Describe this image." \
--max-tokens 256
This table was generated from the frozen lightweight quant gate after the model weights were published. Categories remain separate; the benchmark does not produce a composite intelligence score.
| Lane | Passed | Accuracy | Mean wall time | Mean decode | Peak active memory |
|---|---|---|---|---|---|
| Quality | 7/10 | 70.0% | 7.51 s | 112.00 tok/s | 39.30 GiB |
| Long context | 9/15 | 60.0% | 41.03 s | 107.09 tok/s | 42.00 GiB |
| Tool calling | 6/6 | 100.0% | 1.71 s | 89.90 tok/s | 40.53 GiB |
| Agentic | 1/2 | 50.0% | 5.34 s | — tok/s | — |
| Vision | 1/4 | 25.0% | 1.62 s | 110.15 tok/s | 39.28 GiB |
f1607035e1a6b2610e51f6d5322c55cc0ba052caoff; MTP depth 1Scores are specific to the linked model revision, benchmark revision, runtime contract, and host. Changing weight precision, KV-cache precision, reasoning mode, template, or speculative depth creates a different benchmark candidate.
mtp/weights.safetensors 1.7 GBmodel-00015-of-00016.safetensors 1.6 GBmodel-00009-of-00016.safetensors 1.6 GBmodel-00012-of-00016.safetensors 1.6 GBmodel-00006-of-00016.safetensors 1.6 GBmodel-00003-of-00016.safetensors 1.6 GBmodel-00013-of-00016.safetensors 1.4 GBmodel-00007-of-00016.safetensors 1.4 GBmodel-00004-of-00016.safetensors 1.4 GBmodel-00010-of-00016.safetensors 1.4 GBmodel-00008-of-00016.safetensors 1.2 GBmodel-00014-of-00016.safetensors 1.2 GBmodel-00011-of-00016.safetensors 1.2 GBmodel-00005-of-00016.safetensors 1.2 GBmodel-00002-of-00016.safetensors 1.2 GBmodel-00001-of-00016.safetensors 1.2 GBmodel-vision-00001-of-00001.safetensors 893 MBmodel-00016-of-00016.safetensors 841 MB有文件?提交种子。
提交种子