Exllamav3 quantization of zai-org/GLM-4.5-Air.
Metrics via eval/model_diff.py
-- original perplexity: 3.18951417
-- original label in top-K:
K = 1: 0.7194
K = 2: 0.8281
K = 3: 0.8719
K = 4: 0.8930
K = 5: 0.9078
-- 5.0bpw-h6 perplexity: 3.21707290
-- 5.0bpw-h6 label in top-K:
K = 1: 0.7197
K = 2: 0.8254
K = 3: 0.8702
K = 4: 0.8921
K = 5: 0.9074
-- Top-K agreement, 5.0bpw-h6 vs original:
K = 1: 0.9487
K = 2: 0.8222
K = 3: 0.6600
K = 4: 0.4920
K = 5: 0.3487
-- KL divergence (A, original): 0.03612041
model-00003-of-00010.safetensors 7.3 GBmodel-00004-of-00010.safetensors 7.3 GBmodel-00005-of-00010.safetensors 7.3 GBmodel-00006-of-00010.safetensors 7.3 GBmodel-00007-of-00010.safetensors 7.3 GBmodel-00008-of-00010.safetensors 7.3 GBmodel-00009-of-00010.safetensors 7.3 GBmodel-00002-of-00010.safetensors 7.3 GBmodel-00001-of-00010.safetensors 7.3 GBmodel-00010-of-00010.safetensors 1.9 GBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Doctor-Shotgun/GLM-4.5-Air-exl3_5.0bpw-h6 ./model-folderzai-org/GLM-4.5-Air