Loading…
Loading…
| Model | MiB | PPL | ΔPPL | KLD | RMS Δp | top-p | Pareto |
|---|---|---|---|---|---|---|---|
| Q8_0 (stock) | 2556 | 11.9747 | +0.0145 | 0.0015 | 1.02% | 97.8% | ★ |
| Fidelity-48pc | 2309 | 11.9989 | +0.0387 | 0.0026 | 1.32% | 97.3% | ★ |
| Precision-42pc | 2060 | 12.0119 | +0.0517 | 0.0040 | 1.59% | 96.6% | ★ |
| Q6_K-imx (stock) | 1974 | 12.0129 | +0.0526 | 0.0059 | 1.92% | 95.8% | ★ |
| Quality-36pc | 1772 | 12.0388 | +0.0785 | 0.0103 | 2.57% | 94.6% | ★ |
| Q5_K_M-imx (stock) | 1724 | 12.1174 | +0.1571 | 0.0171 | 3.41% | 93.3% | ≈ Compact-33pc |
| Compact-33pc | 1628 | 12.1418 | +0.1815 | 0.0166 | 3.35% | 93.2% | ★ |
| Mini-30pc ⭐ | 1487 | 12.3175 | +0.3573 | 0.0347 | 4.77% | 90.3% | ★ |
| IQ4_XS-imx (stock) | 1358 | 12.4567 | +0.4965 | 0.0712 | 6.72% | 87.0% | < Nano-27pc |
| Nano-27pc | 1350 | 12.3951 | +0.4349 | 0.0546 | 5.88% | 88.4% | ★ |
| Pico-24pc | 1210 | 12.9000 | +0.9398 | 0.1025 | 8.11% | 84.1% | ★ |
| IQ3_M-imx (stock) | 1169 | 13.9382 | +1.9779 | 0.2027 | 11.87% | 78.5% | ★ |
| Femto-21pc | 1072 | 14.1474 | +2.1871 | 0.2003 | 11.66% | 77.0% | ★ |
Paretrix is an empirical, activation-aware quantization suite for GGUF language models and speculative decoding modules.
Pareto + Matrix → Paretrix. Each rung is planned so that no better trade exists at its weight among the options measured. Around three stock bases (Q8_0, Q6_K-imx, IQ4_XS-imx), every tensor class is moved alone to every type and measured against the BF16 logits; an exact knapsack then plans each rung from those cells, and a duel at the verdict regime decides whether the plan replaces the champion. What one model measures, the next model of its family inherits.
Standard uniform quantization applies one bitwidth family across the whole network. Paretrix reads the model's own response to each move (which classes are expensive to cut, which are nearly free, which pay back a buy), then spends the budget where the measurements show the greatest return.
openbmb/MiniCPM5-2B