oQ5e mixed-precision MLX conversion of Nex-AGI's Nex-N2.6, intended for Apple Silicon Macs with at least 256 GB of unified memory.
Effective weight storage: 5.61 BPW · 225.36 GB · group size 64.
Nex-N2.6 is a multimodal agentic model based on GLM-5.3-Flash, with approximately 321B parameters. This community conversion retains the full expert set, vision encoder and multi-token-prediction head. No additional training, abliteration or expert pruning was applied.
nex-agi/Nex-N2.6@987472298e7867721576ac49a253a6f5b526013e.0.7.4.dev1 native oQe streaming converter.Detailed conversion and preservation records are in CONVERSION.json.
5.61 effective bits per weight (BPW). The packed quantized matrices alone average 5.084 bits per weight; the effective figure includes their BF16 scales/biases, every unquantized tensor and safetensors headers.
| Component | Weight precision | Original parameters | Stored GB |
|---|---|---|---|
| Routed MoE experts | 5-bit | 311,653,564,416 | 214.261826 |
| Attention projections | 8-bit | 6,171,918,336 | 6.557663 |
| Shared experts | 8-bit | 1,082,130,432 | 1.149764 |
| Dense MLP projections | 8-bit | 452,984,832 | 0.481296 |
| Token embeddings | 8-bit | 634,388,480 | 0.674038 |
| Output head | 8-bit | 634,388,480 | 0.674038 |
| Vision encoder | BF16 | 563,627,008 | 1.127254 |
| Linear-attention convolutions | BF16 | 3,342,336 | 0.006685 |
| Indexer pooling/compression | BF16 | 6,297,600 | 0.012595 |
| Text/MTP normalization | BF16 | 425,216 | 0.000850 |
| MTP fusion projection | BF16 | 33,554,432 | 0.067109 |
| MoE routers/correction biases | FP32 | 50,737,248 | 0.202949 |
| Hyperconnections | FP32 | 35,391,870 | 0.141567 |
| Recurrent decay controls | FP32 | 280,704 | 0.001123 |
| Safetensors headers | — | — | 0.000403 |
| Total | 5.61 effective BPW | 321,323,031,390 | 225.359160 |
Stored GB uses decimal units. Quantized rows include their BF16 affine scales/biases; normalization in this table excludes the vision encoder, whose tensors are all counted in the vision row. Routed/shared expert and attention totals include MTP; the MTP fusion projection is listed separately. No tensors are counted twice.
Calculation: 8 × 225,359,159,611 stored bytes ÷ 321,323,031,390 original scalar parameters = 5.6108 BPW. Affine metadata contributes storage but is not counted as additional original model parameters. Tokenizer/config files, KV cache and runtime workspace are excluded.
| Block | Routed expert matrices | Other quantized matrices | Unquantized tensors | Stored GB |
|---|---|---|---|---|
| Text 0 | — (dense MLP) | 8-bit | BF16, FP32 | 0.310052 |
| Text 1 | — (dense MLP) | 8-bit | BF16, FP32 | 0.310052 |
| Text 2 | — (dense MLP) | 8-bit | BF16, FP32 | 0.310052 |
| Text 3 | 5-bit | 8-bit | BF16, FP32 | 5.150670 |
| Text 4 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 5 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 6 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 7 | 5-bit | 8-bit | BF16, FP32 | 5.150670 |
| Text 8 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 9 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 10 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 11 | 5-bit | 8-bit | BF16, FP32 | 5.150670 |
| Text 12 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 13 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 14 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 15 | 5-bit | 8-bit | BF16, FP32 | 5.150670 |
| Text 16 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 17 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 18 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 19 | 5-bit | 8-bit | BF16, FP32 | 5.150670 |
| Text 20 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 21 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 22 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 23 | 5-bit | 8-bit | BF16, FP32 | 5.150670 |
| Text 24 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 25 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 26 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 27 | 5-bit | 8-bit | BF16, FP32 | 5.150670 |
| Text 28 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 29 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 30 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 31 | 5-bit | 8-bit | BF16, FP32 | 5.150670 |
| Text 32 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 33 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 34 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 35 | 5-bit | 8-bit | BF16, FP32 | 5.150670 |
| Text 36 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 37 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 38 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 39 | 5-bit | 8-bit | BF16, FP32 | 5.150670 |
| Text 40 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 41 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 42 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| Text 43 | 5-bit | 8-bit | BF16, FP32 | 5.150670 |
| Text 44 | 5-bit | 8-bit | BF16, FP32 | 5.163911 |
| MTP 0 | 5-bit | 8-bit | BF16, FP32 | 5.214657 |
Complete per-module/tensor precision data (CSV) and exact accounting/methodology (JSON) are included. The CSV covers every quantized module and unquantized tensor; quantized module rows include their scales and affine biases.
Use a runtime supporting Nex-N2.6's glm5_next architecture and oQe mixed precision, with the included tokenizer, processor and chat template. The template supports reasoning_effort values low, high and max (default).
Cold loading and text generation tested on a 256 GB Apple Silicon Mac with oMLX 0.7.4.dev1; MTP decoding active. Broader quality, vision and long-context testing is ongoing.
Model: Nex-AGI. GLM base: Z.ai. Conversion tooling: oMLX / oQe. Community conversion: Hygaard.
Licensed under Apache-2.0, with the upstream GLM MIT notice retained. See NOTICE for attribution and modification notes.
model-00012-of-00038.safetensors 6.6 GBmodel-00025-of-00038.safetensors 6.6 GBmodel-00015-of-00038.safetensors 6.6 GBmodel-00021-of-00038.safetensors 6.6 GBmodel-00024-of-00038.safetensors 6.6 GBmodel-00008-of-00038.safetensors 6.6 GBmodel-00020-of-00038.safetensors 6.6 GBmodel-00034-of-00038.safetensors 6.6 GBmodel-00011-of-00038.safetensors 6.6 GBmodel-00017-of-00038.safetensors 6.6 GBmodel-00030-of-00038.safetensors 6.6 GBmodel-00014-of-00038.safetensors 6.6 GBmodel-00018-of-00038.safetensors 6.6 GBmodel-00027-of-00038.safetensors 6.6 GBmodel-00028-of-00038.safetensors 6.6 GBmodel-00009-of-00038.safetensors 6.6 GBmodel-00033-of-00038.safetensors 6.6 GBmodel-00004-of-00038.safetensors 6.6 GBmodel-00007-of-00038.safetensors 6.6 GBmodel-00022-of-00038.safetensors 6.6 GBmodel-00035-of-00038.safetensors 6.6 GBmodel-00031-of-00038.safetensors 6.6 GBmodel-00005-of-00038.safetensors 6.6 GBmodel-00002-of-00038.safetensors 6.2 GBmodel-00037-of-00038.safetensors 5.1 GBmodel-00001-of-00038.safetensors 5.0 GBmodel-00023-of-00038.safetensors 5.0 GBmodel-00010-of-00038.safetensors 5.0 GBmodel-00026-of-00038.safetensors 5.0 GBmodel-00013-of-00038.safetensors 5.0 GBmodel-00016-of-00038.safetensors 5.0 GBmodel-00029-of-00038.safetensors 5.0 GBmodel-00036-of-00038.safetensors 5.0 GBmodel-00019-of-00038.safetensors 5.0 GBmodel-00032-of-00038.safetensors 5.0 GBmodel-00003-of-00038.safetensors 5.0 GBmodel-00006-of-00038.safetensors 5.0 GBmodel-00038-of-00038.safetensors 1.2 GB有文件?提交种子。
提交种子nex-agi/Nex-N2.6