Voxprint huihui-qwen36-27b

Base model

• Quantized from: huihui-ai/Huihui-Qwen3.6-27B-abliterated-MTP-GGUF
• Revision: 2da8c0432f0a42c25c14cbc99f90028a90d3dcd3
• Foundation weights: Qwen/Qwen3.6-27B
• Licence of the weights: apache-2.0
• Parameters: 27.0B
• Card date: 2026-10-10

Method

Requant of upstream abliterated huihui-ai/Huihui-Qwen3.6-27B-abliterated-MTP-GGUF at revision 2da8c0432f0a42c25c14cbc99f90028a90d3dcd3. Forge does not repeat that ablation. The 24 GB tier reuses a pinned upstream GGUF when one fits; the 16 GB tier is quantized here.

Calibration data

This requant does not repeat the upstream ablation and does not include that author's calibration set. The importance matrix and the eval prompts are original text in src/voxprint_forge/data, under the Apache-2.0 licence recorded in src/voxprint_forge/data/LICENCES.md.

Quantization

Importance matrix: Importance matrix imatrix.gguf sha256 a9235683394e6fef4a20b74622c02e94418abaca4f9daf1df647997dbb945705, built with llama.cpp from the same source.

• 24gb: Q5_K_M (min_vram_gb=24)

• 16gb: Q3_K_M (min_vram_gb=16)

KV cache preference is q8_0, then q4_0 when q8_0 does not fit. Fit is weights plus KV, with headroom left for compute buffers.

Evaluation

24gb / Q5_K_M

• min_vram_gb: 24

• budget_gb: 24.0

• perplexity: 4.6487

• refusal rate EN: 0.0

• refusal rate RU: 0.0

• peak weights+KV:

  • ctx 8192: weights 18346022010 bytes, KV 285212672 bytes, fits True, nvidia-smi used None

  • ctx 16384: weights 18346022010 bytes, KV 570425344 bytes, fits True, nvidia-smi used None

• sample prose:

16gb / Q3_K_M

• min_vram_gb: 16

• budget_gb: 16.0

• perplexity: 5.1976

• refusal rate EN: 0.0

• refusal rate RU: 0.0

• peak weights+KV:

  • ctx 8192: weights 12744151531 bytes, KV 285212672 bytes, fits True, nvidia-smi used None

  • ctx 16384: weights 12744151531 bytes, KV 570425344 bytes, fits True, nvidia-smi used None

• sample prose:

Known limits

Refusals are reduced. This is not a production safety filter and it is not for safety-critical use. Russian prose is a short sample, not a fluency benchmark; read it before shipping a tier. Quality moves with the quant and, on ablated models, with the direction removed.

Acceptable use

Use of this model is subject to the VOXPrint Acceptable Use Policy, in addition to the upstream licence.

Credits

• huihui-ai

• Qwen

• llama.cpp (GGUF conversion, imatrix, quantization, runtime)

Modification notice

Modified from the base model named above by Voxprint AI Model Forge. Changes are requantization and, where the plan says so, an in-house difference-of-means refusal-direction ablation. The Apache-2.0 licence covers this card and the Forge code. Upstream weights keep the licence recorded in this card.

License

Apache-2.0. Full text: apache.org/licenses/LICENSE-2.0.

Made for Voxprint AI Media Suite

Voxprint AI Plotweaver loads these GGUF tiers for creative writing. It selects the 16 GB or 24 GB tier using min_vram_gb from the measurements above.

• 24gb / Q5_K_M: min_vram_gb 24

• 16gb / Q3_K_M: min_vram_gb 16