Follow me on X @BennyDaBall_OG !
Want to support my work? Buy me a coffee on Ko-fi !
PAN 2 on a single consumer RTX 5090. A 29B world model in 16.3 GB, full W4A4, sampling up to 20 seconds of video on the card.
A native ComfyUI NVFP4 build of PAN 2, the general-purpose world model from the Institute of Foundation Models at MBZUAI, made from the Comfy-Org repack. Text to video and image to video in one file. Weights and activations are both 4-bit.
Image to video, 5 seconds. One picture in, the next five seconds out.
Every clip on this page came out of this file in ComfyUI at 1248x704, 50 steps, CFG 2.5. The prompts are in assets/PROMPTS.md, the full captions in assets/captions, the start picture in input.
Text to video, 5 seconds. Run, jump, catch.
Text to video, 10 seconds. Dig, wave, regret.
Text to video, 20 seconds. One continuous shot, start to finish, on one RTX 5090.
PAN 2 makes video only. The third workflow adds the trick from my Hy-Nomas x LTX-2.5 audio workflows: the finished frames are encoded with LTX's own video VAE and frozen, and the stock LTX-2.5 distilled model denoises only an empty audio track next to them. LTX-2.5 is a joint audio and video model, so the sound follows the picture. No training, no extra nodes. Turn the volume on.
Text to video with LTX-2.5 audio, 5 seconds. Crack, drop, sizzle.
Text to video with LTX-2.5 audio, 5 seconds. She holds the camera and turns.
Text to video with LTX-2.5 audio, 5 seconds. One push, then physics.
Picture and sound of each clip came out of one run of the workflow. The raw soundtracks come out at very different levels (the egg loud, the island quiet), so the copies on this page are leveled to about the same loudness. Nothing else was done to them.
Timed on my RTX 5090 in stock ComfyUI with core nodes: 1248x704, 24 fps, euler, simple, 50 steps, CFG 2.5. Time is the sampling of one clip: the warm median of three for 5 seconds, single runs for 10 and 20.
| Transformer file | Size | 5s clip | 10s clip | 20s clip |
|---|---|---|---|---|
| Original BF16 | 67.37 GB | does not fit | does not fit | does not fit |
| Official INT8 | 26.68 GB | 262s | 672s | 2,450s |
| NVFP4, this repo | 16.33 GB | 220s | 602s | 1,819s |
Whole prompt from the ComfyUI interface on the same card, one run of each workflow (text encoder, sampling, decode and MP4 save): text to video 5s in 244s, image to video 5s in 248s, text to video with LTX-2.5 audio 5s in 258s.
The shape of it, without the recipe.
| Download | ComfyUI folder | Size |
|---|---|---|
| PAN 2 transformer (NVFP4) | models/diffusion_models/ |
16.33 GB |
Text encoder qwen3.5_9b_int8_convrot.safetensors, from Comfy-Org/PAN2 |
models/text_encoders/ |
9.75 GB |
VAE wan2.2_vae.safetensors, from Comfy-Org/PAN2 |
models/vae/ |
1.41 GB |
| For the audio workflow only: the LTX-2.5 distilled INT8 transformer, its Gemma 4 text encoder and the video and audio VAEs, from Lightricks/LTX-2.5 | their usual folders |
ComfyUI/input/ first.| Workflow | Example |
|---|---|
| Text to Video | the dog and the ball |
| Image to Video | the sea turtle |
| Text to Video with LTX-2.5 Audio | the egg, with sound |
All three use core nodes only: Load Diffusion Model, Load CLIP (type pan2), Load VAE, a text node for the caption, CLIP Text Encode, Wan22ImageToVideoLatent, KSampler, VAE Decode. I ran each of them from the ComfyUI interface before putting it here.
{a|b} as a random choice and strips the braces out of the JSON. The plain text node passes it through untouched.| File | Size | sha256 |
|---|---|---|
diffusion_models/PAN2-NVFP4-ComfyUI.safetensors |
16,330,390,364 bytes | f643ebc36697c33c8bcbaec1a30083df729ca017ca65db9a1bda08d769b1535a |
nvfp4 layout.pan2_int8_convrot.safetensors from Comfy-Org/PAN2.ComfyUI at commit e9afbccc2, the first build after PAN 2 support was merged (version string 0.45.0), comfy-kitchen 0.2.41, torch 2.14.0 + CUDA 13.0, one RTX 5090. Text encoder qwen3.5_9b_int8_convrot and the Wan 2.2 VAE for every file, clips and numbers alike. Same prompt and seed for every file in a comparison.
Quantized by BennyDaBall. Built on three RTX PRO 6000 Blackwell cards and one RTX 5090.
PAN 2 is made by the Institute of Foundation Models at MBZUAI and released under Apache-2.0. This repository is a quantized derivative of it under the same license, built from the ComfyUI repack by Comfy-Org. LICENSE, NOTICE and THIRD_PARTY_LICENSES are included. It is not an official IFM or Comfy-Org release.
Thanks to IFM for the model, to Comfy-Org and comfy-kitchen for the ComfyUI support and the NVFP4 runtime, to Lightricks for LTX-2.5, and to the authors of GPTQ, Schur Replay and Four Over Six.
Follow me on X @BennyDaBall_OG !
Want to support my work? Buy me a coffee on Ko-fi !
Comfy-Org/PAN2