GLM-5.3-Flash-UNCENSORED (oQ4e Mixed-Precision)

Official Solstice-AI Apple Silicon Release • Native Multimodal Vision + Video • 1M Context Window (1,048,576 Tokens) • Bundled DFlash 2 Speculative Drafter

Original Architecture by Zhipu AI / ZAI • Uncensored Weights by dealignai • oQ4e Mixed-Precision by Solstice-AI

---

Model Summary

Solstice-AI/GLM-5.3-Flash-UNCENSORED-mlx-oQ4e is the official oQ4e mixed-precision release of the uncensored 320B foundation model, GLM-5.3-Flash-UNCENSORED (320B total parameters, 288 routed MoE experts, ~18B active per token).

Mixed-Precision Quantization Architecture:

• Base Precision: 4-bit affine (group_size=64).
• Target bpw: ~4.6 bpw.
• Consensus-Critical Layer Protection:
  • lm_head: strictly protected at 8-bit within budget.
  • MoE Routers & Gate Projections (mlp.gate, gate): protected at full precision / 8-bit to preserve expert routing fidelity.
  • 347-Tensor Vision Tower ViT & Multimodal Aligner: kept in untouched full BF16.
  • Attention Sinks & Hyper-Connection Tables (hc_*): kept in full BF16/FP32.
• Native 1M Context Window: 1,048,576 tokens native context.
• Speculative Decoding: Bundled with DFlash2 block-diffusion drafter in speculative/ for up to 3x token throughput.

---

Official GLM-5.3-Flash Benchmark Scoreboard

---

Quickstart on Apple Silicon

pip install mlx mlx-lm huggingface_hub

from mlx_lm import load, generate

model, tokenizer = load("Solstice-AI/GLM-5.3-Flash-UNCENSORED-mlx-oQ4e")
response = generate(model, tokenizer, prompt="Explain sparse mixture-of-experts in GLM-5.3.", max_tokens=1024, verbose=True)
print(response)