中文Sign up

abenzerps/Apodex-1.1-mini-GGUF

Verified creator abenzerps verified
🤗 Hugging Face sourcetext-generationapache-2.0247 GBGGUF✓ 16 checksumsupdated today
Needs seeder →

Apodex-1.1-mini GGUF

GGUF quantizations of apodex/Apodex-1.1-mini, a 35.95B-parameter Qwen3.5 MoE model for research, data, files, code, and tool-driven work.

All model files retain the checkpoint's native MTP/NextN head. For image input, use the included F16 vision projector.

Upstream benchmarks

Results reported by Apodex AI from evaluations of the original Apodex-1.1 model using FrontierAgent, its agent harness and evaluation suite.

Results reported by Apodex AI from evaluations of the original Apodex-1.1-mini checkpoint using FrontierAgent. With the Agent Team workflow, it scored 27.7 on APEX-Agent, 50.2 on FrontierFinance, and 51.7 on FrontierScience-Research.

GGUF files

Quantization File Size Notes
IQ1_M Apodex-1.1-mini-IQ1_M.gguf 8.82 GB Ultra-low-memory option
IQ2_M Apodex-1.1-mini-IQ2_M.gguf 12.2 GB Smallest recommended option
Q2_K Apodex-1.1-mini-Q2_K.gguf 13.2 GB Maximum-compression K-quant
IQ3_M Apodex-1.1-mini-IQ3_M.gguf 16.0 GB Importance-aware compact option
Q3_K_M Apodex-1.1-mini-Q3_K_M.gguf 17.2 GB Standard Q3 K-quant
Q4 Selective Apodex-1.1-mini-Q4_Selective-Q4_K_M.gguf 19.8 GB Compact custom Q4 alternative
Q4_K_S Apodex-1.1-mini-Q4_K_S.gguf 20.4 GB Smaller Q4 option
Q4_K_M Apodex-1.1-mini-Q4_K_M.gguf 21.7 GB Recommended default
Q5_K_S Apodex-1.1-mini-Q5_K_S.gguf 24.6 GB Smaller Q5 option
Q5_K_M Apodex-1.1-mini-Q5_K_M.gguf 25.3 GB Higher-quality Q5 option
Q6_K Apodex-1.1-mini-Q6_K.gguf 29.2 GB High-quality option
Q8_0 Apodex-1.1-mini-Q8_0.gguf 37.8 GB Near-lossless reference quantization
Vision projector mmproj-Apodex-1.1-mini-F16.gguf 899 MB Required for image input

The IQ builds use the included importance matrix. Q4 Selective is a compact custom Q4 alternative that selectively retains higher precision in key weights.

Usage

Use a current llama.cpp build with the included chat template.

llama-cli \
  -m Apodex-1.1-mini-Q4_K_M.gguf \
  -c 4096 -n 512 --temp 1.0 --top-p 0.95 \
  --jinja --chat-template-file chat_template.jinja \
  -p "Explain why reproducible builds matter."

For MTP speculative decoding:

llama-server \
  -m Apodex-1.1-mini-Q4_K_M.gguf \
  --spec-type draft-mtp --spec-draft-n-max 3 \
  --jinja --chat-template-file chat_template.jinja

For image input:

llama-mtmd-cli \
  -m Apodex-1.1-mini-Q4_K_M.gguf \
  -mm mmproj-Apodex-1.1-mini-F16.gguf \
  --image image.jpg -p "Describe this image."

Source