MOSS-Image-SFT (INT8 ConvRot) for ComfyUI

This repository provides INT8 ConvRot quantizations for OpenMOSS-Team/MOSS-Image-SFT

The native ComfyUI workflow file is included in this repository:

moss-image_comfyUI_workflow.json.

---

📂 Repository Structure

The files are organized into standard ComfyUI directory paths:

Abiray/MOSS-Image-SFT-INT8-convrot/
├── diffusion_models/
│   └── moss-image-sft-dit-int8-convrot.safetensors       # 5.41 GB (INT8 DiT Backbone)
├── text_encoders/
│   └── moss-image-sft-qwen35-int8-convrot.safetensors     # 8.45 GB (INT8 Qwen3.5 Text Encoder)
├── vae/
│   └── moss-image-sft-vae.safetensors                    # 336 MB  (FLUX.2 VAE, BF16)
└── moss-image_comfyUI_workflow.json                      # Ready-to-use ComfyUI workflow

---

🔬 Quantization Summary

Standard INT8 round-to-nearest (RTN) or naive absmax clipping often causes severe structural degradation in diffusion models due to high-magnitude activation outliers across specific channels.

ConvRot applies orthogonal Hadamard matrix rotations to the weights and activation spaces prior to quantization. This flattens outlier peaks, allowing fast 1-pass absmax INT8 mapping to maintain near-lossless fidelity.

All modulation layers, LayerNorms/RMSNorms, RoPE bands, and attention scale vectors are retained in original BF16/FP32 precision.

---

🖼️ Sample Generations

---

⚙️ Recommended Inference Settings

---

🚀 Setup & Usage in ComfyUI

1. Download Models

Run this Python script inside your ComfyUI environment to place each model directly into its respective folder:

import os
from huggingface_hub import hf_hub_download

COMFY_ROOT = "/path/to/ComfyUI/models"  # e.g., /tmp/workspace/ComfyUI/models
REPO_ID = "Abiray/MOSS-Image-SFT-INT8-convrot"

files = [
    ("diffusion_models", "moss-image-sft-dit-int8-convrot.safetensors"),
    ("text_encoders", "moss-image-sft-qwen35-int8-convrot.safetensors"),
    ("vae", "moss-image-sft-vae.safetensors"),
]

for subfolder, filename in files:
    target_path = f"{subfolder}/{filename}"
    print(f"⬇️ Downloading {filename}...")
    hf_hub_download(
        repo_id=REPO_ID,
        filename=target_path,
        local_dir=COMFY_ROOT,
    )

print("✅ All models downloaded successfully!")

2. Run Inference

1. Download moss-image_comfyUI_workflow.json from this repository.
2. Drag and drop the .json file into your ComfyUI window.
3. Verify node selections:
   • Load Diffusion Model: moss-image-sft-dit-int8-convrot.safetensors
   • CLIPLoader / Text Encoder: moss-image-sft-qwen35-int8-convrot.safetensors
   • VAELoader: moss-image-sft-vae.safetensors
4. Queue Prompt.

---

📄 License & Attribution

• Base model developed by the OpenMOSS Team: OpenMOSS-Team/MOSS-Image-SFT.
• Released under the Apache-2.0 License.