This is an unofficial oQ8e MLX quantization of BAAI/AREX-2 for Apple Silicon.
This repository is not an official BAAI release. It does not imply endorsement by BAAI or jundot.
Source revision: d4e3502f92d9e889031c2d04e387ab2eb3520268.
| Setting | Value |
|---|---|
| Architecture | Dense Qwen-compatible multimodal model; qwen3_5 |
| Quantization | oQ8e; base 8-bit MLX affine quantization |
| Group size | 64 |
| Enhanced imatrix calibration | Enabled |
| Calibration data | oMLX built-in oqe_code_multilingual |
| Calibration samples | 128 samples, each with 512 tokens |
| Imatrix entries applied | 496 of 496 |
| Requested output dtype | BF16; protected tensors follow oMLX rules |
| Weight files | Six safetensors shards, 29.50 GB total (decimal) |
| Vision encoder | Retained |
| Tokenizer and chat template | Retained from BAAI/AREX-2 |
Calibration used the original source weights. No reduced-precision calibration proxy was used. The imatrix cache was saved locally for reuse.
The output head, language_model.lm_head, had no imatrix entry. It therefore uses the standard oQ quantization path, not imatrix-weighted quantization. No shape mismatches were reported.
The source checkpoint contains no MTP weight tensors. This repository therefore does not include MTP weights.
Load this repository in a compatible oMLX installation on Apple Silicon. Use the included tokenizer and chat template. Local validation used oMLX 0.7.0 on an Apple M3 Ultra.
See BAAI/AREX-2 for the original model's intended use, prompt guidance, limitations, and safety information.
READY.See quantization_info.json for conversion settings, calibration details, and weight checksums. It contains no local file paths.
Apache-2.0. The original BAAI license is included as LICENSE. Follow the source model's notices and applicable terms.
model-00002-of-00006.safetensors 5.0 GBmodel-00003-of-00006.safetensors 5.0 GBmodel-00004-of-00006.safetensors 5.0 GBmodel-00001-of-00006.safetensors 5.0 GBmodel-00005-of-00006.safetensors 5.0 GBmodel-00006-of-00006.safetensors 4.4 GBBAAI/AREX-2