Marigold V2

Revisiting Diffusion Transformers for Monocular Depth Estimation

ACM Transactions on Graphics (SIGGRAPH Asia 2026)

Igor Pavlovic^1,2,*,†, Thiemo Wandel^2,*, Anton Obukhov^2,§
Luca Bartolomei³, Andrey Davydov², Fabio Tosi³, Matteo Poggi³, Sabine Süsstrunk¹, Dengxin Dai<sup>2

1</sup>EPFL · ²HUAWEI Bayer Lab · ³University of Bologna
^*Equal contribution · ^†Internship · ^§Project lead

---

News

2026-12: To appear in ACM Transactions on Graphics 45(6) and to be presented at SIGGRAPH Asia 2026.
2026-09-13: Mirrored on ModelScope:
2026-09-08: Initial release: inference, evaluation, and training code, the released checkpoints, and the demo.

Usage

Inference, evaluation, and training code lives in the GitHub repository, which downloads this repository and the base model into its assets/ folder:

git clone https://github.com/huawei-bayerlab/marigold-v2.git && cd marigold-v2
bash setup/setup_env.sh && conda activate marigold-v2
python scripts/download_assets.py --skip-datasets
python scripts/infer.py --modality depth --image_dir /path/to/images --output_dir output/depth
python scripts/infer.py --checkpoint assets/checkpoints/Marigold-V2/depth/Log-layered --image_dir ...   # any checkpoint below

Inference needs about 17 GB of GPU memory at 1024² and 29 GB at 2048², so a 24 GB card covers 1024² and 2048² needs 32 GB. Outputs are affine-invariant, i.e. depth up to an unknown scale and shift per image.

Checkpoints

Log and linear depth increase with distance, disparity decreases. Each folder holds one trainables.safetensors with keys <component>.<parameter> (Diffuser.* LoRA weights, VAE.* decoder weights when present). qwen_text_embeddings/ contains the precomputed prompt embeddings and masks per modality (<prefix>_prompt_embeds.pt, <prefix>_prompt_mask.pt), so the text encoder of the base model is never needed. manifest.json lists sizes and SHA-256 checksums of all files.

Results

Zero-shot depth with the Pixel-Perfect Depth protocol, depth/Log-stage2, AbsRel ↓ / δ1 ↑ in percent:

Surface normals, normals, mean angular error ↓ / % within 11.25° ↑:

Albedo on the Hypersim test split, albedo: PSNR 20.78, SSIM 0.811, LPIPS 0.195.

Training data

Depth: Hypersim and Virtual KITTI 2 (about 74k images, as repackaged for Marigold V1). See-through depth: LayeredDepth-Syn. Normals and albedo: Hypersim. All released models were trained on a single 32 GB GPU.

Citation

@article{pavlovic2026marigoldv2,
    author = {Pavlovic, Igor and Wandel, Thiemo and Obukhov, Anton and Bartolomei, Luca and Davydov, Andrey and Tosi, Fabio and Poggi, Matteo and S{\"u}sstrunk, Sabine and Dai, Dengxin},
    title = {Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation},
    year = {2026},
    issue_date = {December 2026},
    publisher = {Association for Computing Machinery},
    volume = {45},
    number = {6},
    url = {https://doi.org/10.1145/3842528},
    doi = {10.1145/3842528},
    journal = {ACM Trans. Graph.},
    month = dec,
    articleno = {204},
    numpages = {14}
}

License

The weights in this repository are released under the Apache License, Version 2.0 (see LICENSE). The base model Qwen-Image-Edit-2509 keeps its own license.