Nanbeige4.3-33B-oQ6e
This is an oQ6e MLX quantization of Nanbeige/Nanbeige4.3-33B.
Attribution
- Original model, weights, and tokenizer: the Nanbeige Team. See the original model card for model details and citation.
- oQ/oQe quantization method and implementation: jundot / oMLX, using jundot/omlx, version 0.7.0.
- This repository contains a community conversion. It is not an official Nanbeige or jundot release.
- Model license: Apache-2.0, as specified by the source model.
Conversion details
- Source revision:
c1093c501cc6460427c0ac634db7223d0450c0ee. - Converted directly from the BF16 source, not from the oQ8e weights.
- oMLX oQ level: 6, with enhanced imatrix weighting enabled. Selected modules use 8-bit weights, as specified in
config.json. - Quantization mode: affine. Group size: 64.
- Calibration: oMLX
oqe_code_multilingual, 128 samples × 512 tokens. - This run reused the unchanged imatrix cache collected for oQ8e. All 364 transformer projection entries received imatrix weighting. The
lm_headhad no imatrix entry. - Weight files: 6 shards, 27.732 GB in decimal units.
- The original tokenizer and chat template are included.
Use and validation
Use these weights with an MLX-compatible loader, such as oMLX, on Apple silicon. They are not the original BF16 Transformers weights.
The model passed a local load and short text-generation test. Output shard sizes and SHA-256 hashes were recorded. No benchmark or quality-equivalence claim is made.