thedeoxen/refcontrol-flux-kontext-reference-canny-lora

🤗 Hugging Face sourceimage-to-imageapache-2.0376 MBother✓ 25 checksumsupdated today
Needs seeder →

RefControl Flux Kontext – Reference Canny LoRA

📝 Short description

A LoRA for Flux Kontext Dev that fuses a reference image (left) with a canny edge map (right).
It preserves identity and style from the reference while following the edges and outlines from the control.

Trigger word: refcontrolcanny

Demo video


📊 Examples

Reference Result

📖 Extended description

This LoRA was primarily trained on humans and characters, but it works with objects and scenes as well.
The main purpose is to preserve identity — facial features, clothing, style — from the reference image, while using the canny edge map to define contours, composition, and layout.


⚙️ How to use

  1. Concatenate two images side by side:
    • Left: reference image (person, character, or object).
    • Right: canny edges (line structure).
  2. Add the trigger word refcontrolcanny in your prompt.
  3. Adjust LoRA weight (recommended 0.8–1.0) depending on how strictly you want to follow edges.

✅ Example prompt

refcontrolcanny, change canny edges to photo with reference from left


🎯 What it does

  • Preserves style and identity of the reference.
  • Uses canny edges to control structure, outline, and composition.
  • Produces consistent results across different poses and layouts.

⚡ Tips

  • Works best if the canny map captures clean edges with minimal noise.

📌 Use cases

  • Character consistency in illustrations and comics.
  • Stylized redraws of objects with sharp outlines.
  • Scene composition based on silhouettes.
  • Rapid prototyping of layouts and storyboards.