Sign up

Shiftedx/ornith-1.5-35b-a3b-affine4-router8-vision-mtplx

🤗 Hugging Face sourceimage-text-to-textmit35.1B params70 GBsafetensors✓ Checksums witnessedupdated today
No torrent yet →

ornith-1.5-35b-a3b-affine4-router8-vision-mtplx

Compact affine 4-bit control with adapter-required 8-bit MoE router gates, BF16 vision, and native BF16 MTP. Built from ornith-ai/Ornith-1.5-35B-A3B revision fbb995a for Apple Silicon.

Format

  • Logical size: 24.28 GB
  • Qwen3.5 MoE multimodal: 35B total parameters, 3B active
  • Language body: affine 4-bit/group-32 with 80 MoE router gates at affine 8-bit/group-64; recurrent inputs quantized with the language body
  • Vision: 333 same-parent BF16 tensors
  • MTP: 785 same-parent BF16 tensors in mtp/weights.safetensors
  • Context metadata: 262,144 tokens
  • Tokenizer, chat template, and image/video processor metadata preserved

The fail-closed precision recipe and conversion assertions are included in BUILD_RECIPE.json and conversion_receipt.json.

The matched AR/D1/D2/D3 sweep selected D1 at 124.21 decode tok/s on the qualification host.

Usage

mtplx serve \
  --model Shiftedx/ornith-1.5-35b-a3b-affine4-router8-vision-mtplx \
  --profile turbo \
  --generation-mode mtp \
  --load-mtp \
  --depth 1

python -m mlx_vlm.generate \
  --model Shiftedx/ornith-1.5-35b-a3b-affine4-router8-vision-mtplx \
  --image image.jpg \
  --prompt "Describe this image." \
  --max-tokens 256

Qualification and limitations

  • Structural loading, deterministic text, vision, and MTPLX tensor gates passed locally.
  • This control quant is experimental; behavior may differ from the BF16 parent and the higher-precision hybrid.
  • Full BF16 parent parity was not run on the 64 GiB qualification host.
  • Shiftedx Bench results below are tied to the immutable evaluated weight revision.
  • Review the upstream model card for intended use, training details, license, and safety considerations.

Shiftedx Bench post-publication qualification

This table was generated from the frozen lightweight quant gate after the model weights were published. Categories remain separate; the benchmark does not produce a composite intelligence score.

Lane Passed Accuracy Mean wall time Mean decode Peak active memory
Quality 7/10 70.0% 7.51 s 112.00 tok/s 39.30 GiB
Long context 9/15 60.0% 41.03 s 107.09 tok/s 42.00 GiB
Tool calling 6/6 100.0% 1.71 s 89.90 tok/s 40.53 GiB
Agentic 1/2 50.0% 5.34 s — tok/s —
Vision 1/4 25.0% 1.62 s 110.15 tok/s 39.28 GiB
  • Tested model revision: f1607035e1a6b2610e51f6d5322c55cc0ba052ca
  • Benchmark: Shiftedx Bench v0.3.0
  • Context lengths represented: 4,096, 16,384, 65,536, 131,072 prompt tokens; effective tested context: 4,096 tokens
  • Runtime contract: MTPLX 2.7.1; MLX 0.32.0; mlx-lm 0.31.3; D1; turbo; thinking on; reasoning effort medium; KV cache off; MTP depth 1
  • Host: Apple M4 Max, 64 GiB unified memory
  • Total measured request wall time: 717.90 seconds
  • 260,096-token status: not run; it is outside the lightweight quant gate.

Scores are specific to the linked model revision, benchmark revision, runtime contract, and host. Changing weight precision, KV-cache precision, reasoning mode, template, or speculative depth creates a different benchmark candidate.