English注册

rapid-mlx/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-MLX-4bit

来源：🤗text-generationopenmdw-1.1121B 参数激活 12B241 GBsafetensors✓ 15 个校验和4 天前更新
或提交种子

NVIDIA Nemotron 3.5 Super VL 120B-A12B — MLX 4bit (text)

Text conversion of nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16.

  • Quantization: 4-bit affine, group size 64; embeddings 8-bit/group-64. Output head, routers and latent projections retain checkpoint precision.
  • Artifact size: 69.541 GB. Recommend 128 GB+ unified memory (measured peak 72.7 GB at 1K context on M3 Ultra; 96 GB Macs may need a raised GPU wired-memory limit and are not yet verified). Allow headroom beyond the weights for prefill, caches, macOS and applications.
  • Text only: the vision tower, image projector and unused MTP head are omitted.
  • Declared context limit: 1,048,576 tokens; this does not promise that the full window fits the recommended memory.

Requirements

Requires Rapid-MLX 0.16.2 or newer. The config retains nemotron_h and opts into Rapid's reviewed precision adapter. Stock loaders do not apply that adapter; only Rapid-MLX is validated for this conversion.

rapid-mlx serve rapid-mlx/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-MLX-4bit

Reasoning and XML tool calling use the original tokenizer/chat template. MTP speculative decoding and image input are not enabled.

License

Original model by NVIDIA under OpenMDW 1.1. This conversion inherits the original model's license terms.