Anime in Real Life LoRA for Qwen-Image

LoRA model that transforms anime-style prompts into photorealistic images for Qwen-Image

trigger word: "Real life Anime"

📝 Updates

🧪 Usage

🔧 Initialization

from diffusers import DiffusionPipeline
import torch

model_name = "Qwen/Qwen-Image"

# Load the pipeline
if torch.cuda.is_available():
    torch_dtype = torch.bfloat16
    device = "cuda"
else:
    torch_dtype = torch.float32
    device = "cpu"

pipe = DiffusionPipeline.from_pretrained(model_name, torch_dtype=torch_dtype)
pipe = pipe.to(device)

🔌 Load LoRA Weights

# Load LoRA weights
pipe.load_lora_weights("flymy-ai/qwen-image-anime-irl-lora", weight_name='flymy_anime_irl.safetensors', adapter_name="lora")

🎨 Generate Anime in Real Life Images

prompt = '''Real life Anime in a cozy kitchen, eating noodles with chopsticks, while a curious cat looks out the window.'''
negative_prompt = " "
image = pipe(
    prompt=prompt,
    negative_prompt=negative_prompt,
    width=1024,
    height=1024,
    num_inference_steps=50,
    true_cfg_scale=4,
    generator=torch.Generator(device="cuda").manual_seed(4633346 + 2) 
).images[0]

# Display the image (in Jupyter or save to file)
image.show()
# or
image.save("output.png")

🖼️ Sample Outputs

Examples of anime characters transformed into photorealistic images:

🎛️ Using with ComfyUI

We provide a ready-to-use ComfyUI workflow that works with our trained LoRA models. Follow these steps to set up and use the workflow:

Setup Instructions

1. Download the latest ComfyUI:

   • Visit the ComfyUI GitHub repository
   • Clone or download the latest version

2. Install ComfyUI:

   • Follow the installation instructions from the ComfyUI repository
   • Make sure all dependencies are properly installed

3. Download Qwen-Image model weights:

   • Go to Qwen-Image ComfyUI weights
   • Download all the model files

4. Place Qwen-Image weights in ComfyUI:

   • Copy the downloaded Qwen-Image model files to the appropriate folders in ComfyUI/models/
   • Follow the folder structure as specified in the model repository

5. Download our pre-trained LoRA weights:

   • Visit flymy-ai/qwen-image-lora
   • Download the LoRA .safetensors files

6. Place LoRA weights in ComfyUI:

   • Copy the LoRA file flymy-ai/qwen-image-lora/pytorch_lora_weights.safetensors to ComfyUI/models/loras/

7. Load the workflow:

   • Open ComfyUI in your browser
   • Load the workflow file qwen_image_lora_example.json located in this repository
   • The workflow is pre-configured to work with our LoRA models

Workflow Features

• ✅ Pre-configured for Qwen-Image + LoRA inference
• ✅ Optimized settings for best quality output
• ✅ Easy prompt and parameter adjustment
• ✅ Compatible with all our trained LoRA models

The ComfyUI workflow provides a user-friendly interface for generating images with our trained LoRA models without needing to write Python code.

🖼️ Workflow Screenshot

📊 Anime to Real Life Examples

Below are examples showing how our LoRA model transforms anime-style descriptions into photorealistic images:

Example 1

Example 2

Example 3

🤝 Support

If you have questions or suggestions, join our community:

• 🌐 FlyMy.AI
• 💬 Discord Community
• 🐦 Follow us on X
• 💼 Connect on LinkedIn
• 📧 Support

⭐ Don't forget to star the repository if you like it!

---

license: apache-2.0