Ming-Image-0.1-Design (INT4)
Weight-only INT4 derivative of inclusionAI/Ming-Image-0.1-Design.
This is not an inclusionAI release. The original weights are MIT licensed; this repository redistributes a quantized copy under that same license. Copyright in the model remains with inclusionAI.
What was quantized
Linear weights in the thinker (mllm/), the Qwen2 connector (connector/),
and the diffusion transformer (transformer/) are stored with per-group absmax into signed int4 (range -7..7), group size 128 along the input dimension, two values packed per byte.
A matrix is quantized only when it has at least 1,048,576 parameters. For int4,
the input dimension must also be divisible by 128; other matrices stay bf16.
Each quantized tensor keeps its original name. The matching scale is a float32
tensor named by replacing the .weight suffix with .weight_scale.
These pieces are copied from the original checkpoint unchanged, in bf16:
- token embeddings and the unused
lm_head - layer norms and biases
- the MLP condition projector (
mlp/) - the 4-channel RGBA VAE (
vae/) - the scheduler and tokenizer
The method is data-free absmax. No calibration prompts were run, so this is not GPTQ, AWQ, or SmoothQuant.
INT4 storage is about a quarter of the bf16 size of each quantized matrix. Activations are still computed in bf16.
How to use
The ComfyUI node Ming Image 0.1 Design loads this folder when its
weights setting is int4. Put the repository here, relative to the
ComfyUI root:
models/ming-image/Ming-Image-0.1-Design-INT4
The node does not download quantized checkpoints. From a shell:
hf download alexokita/Ming-Image-0.1-Design-INT4 --local-dir <ComfyUI>/models/ming-image/Ming-Image-0.1-Design-INT4
The folder must contain quantization_config.json. Sampling settings from the
original model card are 12 steps, CFG 1.0, and either 1024 or 2048 resolution.
The workflow is
https://huggingface.co/alexokita/Ming-Image-0.1-Design-ComfyUI.
The original model card, architecture notes, and license are here: https://huggingface.co/inclusionAI/Ming-Image-0.1-Design
Limitations
- Int4 in particular can soften small type and fine UI detail. fp8 is the closest of the three to the bf16 checkpoint.
- Transparent-background trigger phrases from the original model card were not published with the weights. The VAE is still the original 4-channel decoder, so an alpha channel is produced either way.
- This file format is for the Ming-Image ComfyUI node in this project. It is
not a Diffusers
model_index.jsonpipeline.