Qwen3-VL-4B Heretic — Dynamic ConvRot INT8 for ComfyUI Krea 2

This repository contains a true dynamic-ConvRot INT8 conversion of

DreamFast/Qwen3-VL-4b-Heretic,

packaged as a single-file ComfyUI text encoder for Krea 2.

Krea 2 uses Qwen3-VL-4B-Instruct conditioning, not the text-only Qwen3-4B

architecture. The Heretic source is an abliterated derivative of

Qwen/Qwen3-VL-4B-Instruct.

Downloads

| Precision | File | Size | Notes |

| --- | --- | ---: | --- |

| INT8 | qwen3-vl-4b-heretic_int8_dynamic_convrot.safetensors | 4.84 GB | Hosted in this repository; recommended |

| BF16 | Upstream BF16 safetensors | 8.88 GB | Publicly hosted by DreamFast; not duplicated here |

INT8 SHA-256:

c766f6f078bbfe7474699faaceb9484251b0c7c8dd4bf2d5730b320feca54778

Quantization

Built with

silveroxides/convert_to_quant

1.3.1 at commit ee83a4d90d18f52824c3b6b23e45bc7514fb027e.

• 356 INT8 weights with per-row FP32 scales
• All 356 quantized layers contain convrot: true ComfyUI metadata
• Dynamic ConvRot group sizes:
• 216 layers at 256
• 72 layers at 1,024
• 68 layers at 4,096
• 357 embeddings, norms, biases, and other sensitive tensors remain BF16
• Deterministic seed 42
• Prodigy learned rounding

Conversion command:

ctq \
  -i qwen3-vl-4b-heretic.safetensors \
  -o qwen3-vl-4b-heretic_int8_dynamic_convrot.safetensors \
  --int8 \
  --scaling_mode row \
  --dynamic-convrot \
  --comfy_quant \
  --save-quant-metadata \
  --low-memory \
  --device cuda \
  --heur \
  --exclude-layers \
  '(embed|norm|bias|lm_head|spiece_model|multi_modal_projector|patch_embed|patch_conv)' \
  --verbose NORMAL \
  --manual-seed 42

Fidelity versus BF16

Four varied prompts were encoded through ComfyUI's Krea 2 loader with BF16 as

the reference.

| Metric | INT8 dynamic ConvRot |

| --- | ---: |

| Mean cosine similarity | 0.999853 |

| Mean relative L2 error | 2.13% |

| Mean absolute error | 0.03439 |

| Mean maximum absolute error | 2.816 |

ComfyUI verification

GPU loading, tokenization, and end-to-end Krea 2 encoding passed with:

• ComfyUI commit 093d571b83e7a79833200e199b46b9f5a62217f9
• Python from the ComfyUI 13_env Conda environment
• PyTorch 2.11.0+cu130
• comfy-kitchen 0.2.22
• NVIDIA GeForce RTX 5090

The output conditioning shape was (1, 10, 30720), corresponding to the 12

Qwen3-VL hidden states used by Krea 2.

Installation

Download the INT8 file into:

ComfyUI/models/text_encoders/

Select it in CLIPLoader with type krea2.

The file is a ComfyUI single-file text-encoder checkpoint, not a complete

Transformers repository.

Credits

• Abliterated source and BF16 ComfyUI checkpoint:

DreamFast/Qwen3-VL-4b-Heretic-ComfyUI

• Original base model:

Qwen/Qwen3-VL-4B-Instruct

• Quantization tooling:

silveroxides/convert_to_quant