GGUF quantizations of apodex/Apodex-1.1-mini, a 35.95B-parameter Qwen3.5 MoE model for research, data, files, code, and tool-driven work.
All model files retain the checkpoint's native MTP/NextN head. For image input, use the included F16 vision projector.
Results reported by Apodex AI from evaluations of the original Apodex-1.1 model using FrontierAgent, its agent harness and evaluation suite.
Results reported by Apodex AI from evaluations of the original Apodex-1.1-mini checkpoint using FrontierAgent. With the Agent Team workflow, it scored 27.7 on APEX-Agent, 50.2 on FrontierFinance, and 51.7 on FrontierScience-Research.
| Quantization | File | Size | Notes |
|---|---|---|---|
| IQ1_M | Apodex-1.1-mini-IQ1_M.gguf | 8.82 GB | Ultra-low-memory option |
| IQ2_M | Apodex-1.1-mini-IQ2_M.gguf | 12.2 GB | Smallest recommended option |
| Q2_K | Apodex-1.1-mini-Q2_K.gguf | 13.2 GB | Maximum-compression K-quant |
| IQ3_M | Apodex-1.1-mini-IQ3_M.gguf | 16.0 GB | Importance-aware compact option |
| Q3_K_M | Apodex-1.1-mini-Q3_K_M.gguf | 17.2 GB | Standard Q3 K-quant |
| Q4 Selective | Apodex-1.1-mini-Q4_Selective-Q4_K_M.gguf | 19.8 GB | Compact custom Q4 alternative |
| Q4_K_S | Apodex-1.1-mini-Q4_K_S.gguf | 20.4 GB | Smaller Q4 option |
| Q4_K_M | Apodex-1.1-mini-Q4_K_M.gguf | 21.7 GB | Recommended default |
| Q5_K_S | Apodex-1.1-mini-Q5_K_S.gguf | 24.6 GB | Smaller Q5 option |
| Q5_K_M | Apodex-1.1-mini-Q5_K_M.gguf | 25.3 GB | Higher-quality Q5 option |
| Q6_K | Apodex-1.1-mini-Q6_K.gguf | 29.2 GB | High-quality option |
| Q8_0 | Apodex-1.1-mini-Q8_0.gguf | 37.8 GB | Near-lossless reference quantization |
| Vision projector | mmproj-Apodex-1.1-mini-F16.gguf | 899 MB | Required for image input |
The IQ builds use the included importance matrix. Q4 Selective is a compact custom Q4 alternative that selectively retains higher precision in key weights.
Use a current llama.cpp build with the included chat template.
llama-cli \
-m Apodex-1.1-mini-Q4_K_M.gguf \
-c 4096 -n 512 --temp 1.0 --top-p 0.95 \
--jinja --chat-template-file chat_template.jinja \
-p "Explain why reproducible builds matter."
For MTP speculative decoding:
llama-server \
-m Apodex-1.1-mini-Q4_K_M.gguf \
--spec-type draft-mtp --spec-draft-n-max 3 \
--jinja --chat-template-file chat_template.jinja
For image input:
llama-mtmd-cli \
-m Apodex-1.1-mini-Q4_K_M.gguf \
-mm mmproj-Apodex-1.1-mini-F16.gguf \
--image image.jpg -p "Describe this image."
62583b4apodex/Apodex-1.1-mini