HiDream Image DreamBooth LoRA - linoyts/HiDream-yarn-art-LoRA

Model description

These are linoyts/dog-hidream-lora-offload-mini-test DreamBooth LoRA weights for HiDream-ai/HiDream-I1-Full.

The weights were trained using DreamBooth with the HiDream Image diffusers trainer.

Trigger words

You should use yarn art style to trigger the image generation.

Download model

Download the *.safetensors LoRA in the Files & versions tab.

Use it with the 🧨 diffusers library

    >>> import torch
    >>> from transformers import PreTrainedTokenizerFast, LlamaForCausalLM
    >>> from diffusers import HiDreamImagePipeline

    >>> tokenizer_4 = PreTrainedTokenizerFast.from_pretrained("meta-llama/Meta-Llama-3.1-8B-Instruct")
    >>> text_encoder_4 = LlamaForCausalLM.from_pretrained(
    ...     "meta-llama/Meta-Llama-3.1-8B-Instruct",
    ...     output_hidden_states=True,
    ...     output_attentions=True,
    ...     torch_dtype=torch.bfloat16,
    ... )

    >>> pipe = HiDreamImagePipeline.from_pretrained(
    ...     "HiDream-ai/HiDream-I1-Full",
    ...     scheduler=scheduler,
    ...     tokenizer_4=tokenizer_4,
    ...     text_encoder_4=text_encoder_4,
    ...     torch_dtype=torch.bfloat16,
    ... )
    >>> pipe.enable_model_cpu_offload()
    >>> pipe.load_lora_weights(f"linoyts/HiDream-yarn-art-LoRA")
    >>> image = pipe(f"yoda, yarn art style").images[0]

For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers