ornith-1.5-35b-a3b-affine4-router8-vision-mtplx
Compact affine 4-bit control with adapter-required 8-bit MoE router gates, BF16 vision, and native BF16 MTP. Built from ornith-ai/Ornith-1.5-35B-A3B revision fbb995a for Apple Silicon.
Format
- Logical size: 24.28 GB
- Qwen3.5 MoE multimodal: 35B total parameters, 3B active
- Language body: affine 4-bit/group-32 with 80 MoE router gates at affine 8-bit/group-64; recurrent inputs quantized with the language body
- Vision: 333 same-parent BF16 tensors
- MTP: 785 same-parent BF16 tensors in
mtp/weights.safetensors - Context metadata: 262,144 tokens
- Tokenizer, chat template, and image/video processor metadata preserved
The fail-closed precision recipe and conversion assertions are included in BUILD_RECIPE.json and conversion_receipt.json.
The matched AR/D1/D2/D3 sweep selected D1 at 124.21 decode tok/s on the qualification host.
Usage
mtplx serve \
--model Shiftedx/ornith-1.5-35b-a3b-affine4-router8-vision-mtplx \
--profile turbo \
--generation-mode mtp \
--load-mtp \
--depth 1
python -m mlx_vlm.generate \
--model Shiftedx/ornith-1.5-35b-a3b-affine4-router8-vision-mtplx \
--image image.jpg \
--prompt "Describe this image." \
--max-tokens 256
Qualification and limitations
- Structural loading, deterministic text, vision, and MTPLX tensor gates passed locally.
- This control quant is experimental; behavior may differ from the BF16 parent and the higher-precision hybrid.
- Full BF16 parent parity was not run on the 64 GiB qualification host.
- Shiftedx Bench results below are tied to the immutable evaluated weight revision.
- Review the upstream model card for intended use, training details, license, and safety considerations.
Shiftedx Bench post-publication qualification
This table was generated from the frozen lightweight quant gate after the model weights were published. Categories remain separate; the benchmark does not produce a composite intelligence score.
| Lane | Passed | Accuracy | Mean wall time | Mean decode | Peak active memory |
|---|---|---|---|---|---|
| Quality | 7/10 | 70.0% | 7.51 s | 112.00 tok/s | 39.30 GiB |
| Long context | 9/15 | 60.0% | 41.03 s | 107.09 tok/s | 42.00 GiB |
| Tool calling | 6/6 | 100.0% | 1.71 s | 89.90 tok/s | 40.53 GiB |
| Agentic | 1/2 | 50.0% | 5.34 s | — tok/s | — |
| Vision | 1/4 | 25.0% | 1.62 s | 110.15 tok/s | 39.28 GiB |
- Tested model revision:
f1607035e1a6b2610e51f6d5322c55cc0ba052ca - Benchmark: Shiftedx Bench v0.3.0
- Context lengths represented: 4,096, 16,384, 65,536, 131,072 prompt tokens; effective tested context: 4,096 tokens
- Runtime contract: MTPLX 2.7.1; MLX 0.32.0; mlx-lm 0.31.3; D1; turbo; thinking on; reasoning effort medium; KV cache
off; MTP depth1 - Host: Apple M4 Max, 64 GiB unified memory
- Total measured request wall time: 717.90 seconds
- 260,096-token status: not run; it is outside the lightweight quant gate.
Scores are specific to the linked model revision, benchmark revision, runtime contract, and host. Changing weight precision, KV-cache precision, reasoning mode, template, or speculative depth creates a different benchmark candidate.