SketchSSM calibration: Nemotron 3 Super (NVFP4 weights)
calibration.pt is a portable SketchSSM
calibration file for Nemotron 3 Super. It contains the group-shared sketch basis and
the Full-Gram allocation scores from which the per-head rank table and the
ordered frames for any mean rank are derived. It contains no model weights.
Calibration weights
Collected with NVFP4 weights: nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 at revision ff433f5493e25d631c9f12b5d55c674229923d02 (NVIDIA's NVFP4 checkpoint). The basis and the allocation scores depend on the weights, so use this file with these weights; for another precision or checkpoint, calibrate with that checkpoint.
Contents
| Field | Value |
|---|---|
| Base model | Nemotron 3 Super (Mamba-2) |
| Recurrent layers | 40 |
| State heads per layer | 128 |
| Key dim K / value dim V | 128 / 64 |
| Basis groups per layer | 8 |
| Window W | 16 |
| Erase factor | no |
| Allocation rank cap | 42 |
Basis omega |
float32, shape (40, 8, 63, 128) |
| File size | 12,947,205 bytes |
Layers are stored in the order of the model's recurrent layers; layer_ids lists the model layer index of each. The file loads with torch.load(..., weights_only=True).
The calibration guide
documents its keys.
Verified mean ranks
For these mean ranks, the derived tables equal the published bundle tables and the exported frames equal those of the bundle export path:
| Mean rank | Dense heads | Sketch heads |
|---|---|---|
| 2 | 0 | 5120 |
| 3 | 3 | 5117 |
| 5 | 15 | 5105 |
| 9 | 268 | 4852 |
| 20 | 1452 | 3668 |
Other mean ranks are allocated with the same rule but have no stored table to
compare with. manifest.json lists the SHA-256 of calibration.pt and these
results.
Usage
With the SketchSSM repository, export the frames for a mean rank:
hf download SketchSSM/Nemotron-3-Super-NVFP4 calibration.pt --local-dir calibration
python -m sketchssm.calibration export --calibration calibration/calibration.pt \
--mean-rank 5 --out frames.pt
With the vLLM included in the SketchSSM repository (see its README for installation):
vllm serve nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 --sketchssm SketchSSM/Nemotron-3-Super-NVFP4 --sketchssm-mean-rank 5 \
--trust-remote-code --mamba-ssm-cache-dtype float32 --no-enable-prefix-caching
How it was produced
From the public calibration bundle sketchssm/calibration/example/nemotron_super in the
SketchSSM repository:
python -m sketchssm.calibration package --bundle sketchssm/calibration/example/nemotron_super --out calibration.pt
package re-allocates every configured mean rank from the packaged contents
and fails unless each table equals the bundle table.
License
This calibration file is released under the Apache License 2.0, like the SketchSSM repository. It is derived from the base model's weights, so use it under the base model's license as well.