Muse-Spark-Open-EXL3-K4-Core-K6-HQA
HQA = High Quality Attention. This is wrldsuksgo2mars/Muse-Spark-Open-EXL3-K4-Core-K6
(pinned at 89998fb177acd9a862ac8bd4fb79bfd50e940c97) with its main attention projections restored to the original
release's own weights: native BF16 from meta-models/Muse-Spark-Open-816B-A42B
at 0fb02478b02565b2ce7fc57e6051c91172774ac9, copied byte-for-byte
(no casting, requantization, padding or transposition). The expert quantization and every other tensor are the
parent's, unchanged. HQA describes the format and fidelity of these tensors; it is not a measured benchmark claim.
Restored tensors
| Projection | Modules | Layers | Compact-attention format | HQA format |
|---|---|---|---|---|
o_proj |
62 | 62 main + 0 MTP | K6 main EXL3 | BF16 |
62 projections in total. The compact view keeps the parent's quantization of these modules exactly, including the lower-bit MTP attention where the parent used it. Indexer projections, draft weights that were already native, and all other modules are untouched.
Two attention views
This repository holds two complete, mutually exclusive views of the same files:
| View | Tensor index | Model config | Quantization metadata | Active payload |
|---|---|---|---|---|
| HQA (default) | model.safetensors.index.json |
config.json |
quantize_config.json |
433.05 GB |
| compact-attention | model.compact-attention.safetensors.index.json |
config.compact-attention.json |
quantize_config.compact-attention.json |
427.86 GB |
The default view maps each restored projection to its native tensors in the hqa-attention-* shards and
omits that projection's EXL3 buffers. The compact-attention index is the parent's index byte-for-byte: it maps
the original EXL3 attention buffers (which remain in the inherited shards, deliberately, for this view) and
never references the hqa-attention-* shards, so a compact download can skip them. Its config and quantization
metadata are the parent's, with only sibling-file references redirected to the compact filenames.
These alternate filenames are a cuteafd convention, not a Hugging Face mode switch: generic loaders read the
default files only, and a valid safetensors index does not imply generic Transformers/EXL3 support.
Loader support. A loader must select one bundle (index, config and quantization metadata together) for the
lifetime of the loaded model, treat the selected index as authoritative, and refuse a missing or mixed bundle.
The cuteafd --compact-attention option that selects the compact bundle is future work and is not implemented
yet; per-family cuteafd loader support for the HQA view lands separately. Until then this checkpoint is
published for that work; do not assume a current cuteafd release serves either view of it.
Sizes
| Bytes | GB | |
|---|---|---|
| HQA active payload | 433,054,693,340 | 433.05 GB |
| compact-attention active payload | 427,855,788,244 | 427.86 GB |
| Full download (all files) | 436,485,745,846 | 436.49 GB |
| Full download, safetensors only | 436,202,983,956 | 436.20 GB |
| New native attention shards | 8,321,507,456 | 8.32 GB |
The views share almost all bytes; do not add them. New shards (balanced across 4, spread 134,217,728 bytes):
| Shard | Bytes | SHA256 |
|---|---|---|
hqa-attention-00001-of-00004.safetensors |
2,147,485,792 | 17de42ef858514499f850c27d6750ef0843b57292776b91380ac912538465514 |
hqa-attention-00002-of-00004.safetensors |
2,147,485,792 | 33ca574815f39d22d9fc9c92780d14a53a737bf04221956a259623304fe36cb1 |
hqa-attention-00003-of-00004.safetensors |
2,013,267,936 | 64e14313c87349104b7944fc21191b1dbeed7c78330480e20e53ca407019ebc2 |
hqa-attention-00004-of-00004.safetensors |
2,013,267,936 | 546c24b1dc39f1b6e4adbb3cae37802e8cdbbfe6a36c5aad03ce5ffc81c14120 |
Validation performed
- Every replacement tensor was compared byte-for-byte with its pinned source extent (8,321,499,136 bytes); shapes, dtypes and shard hashes checked.
- Both views were opened through an explicit selection harness implementing the contract above: every indexed
tensor resolves in its file header; each view's payload equals its
total_size; no projection exposes both native and EXL3 storage; the compact view equals the pinned parent's tensor selection and payload exactly and opens none of the native shards (and loads with them physically absent); the views have distinct identities. - Inherited files are server-side copies of the pinned parent. Publication completes only after the remote tree matches the planned inventory exactly: inherited LFS SHA256 values equal the pinned parent's, and new files equal the local write records.
- The cuteafd planner (
cuteafd planat cuteafd 3ba032b62) on a directory exposing only the compact bundle under the canonical filenames, with the native shards absent, reproduced the pinned parent plan exactly. The same planner does not yet execute the HQA bundle:muse_spark configuration is not servable: model.language_model.layers.0.self_attn: incomplete native Muse Spark operator group. That is the separate family loader work; the artifact contract does not depend on it. - Not performed: whole-model generation, quality or performance evaluation of the HQA view.
Provenance
hqa-provenance.json binds both views, the parent and source revisions, every restored tensor's source byte extent,
shard membership and hashes, and the producing tool. README.parent.md, quantization-provenance.json and
quantization-errors/ are the parent's records: they describe the compact-attention view and every unchanged
module, not the restored native modules. License and usage files are inherited unchanged from the parent.
Produced by quantization/hqa.py in cuteafd (CPU and I/O only).