Coloring Book HiDream
Model description
This HiDream LoRA is Lycoris based and produces great line art styles and coloring book images. I found the results to be much stronger than my Coloring Book Flux LoRA. Hope this clearly demonstrates the quality that can be achieved with this awesome model.
I recommend using LCM sampler with the simple scheduler, for some reason using other samplers resulted in hallucinations that affected quality when LoRAs are utilized. Some of the images in the gallery will have prompt examples.
Trigger words: c0l0ringb00k, coloring book
Recommended Sampler: LCM
Recommended Scheduler: SIMPLE
Recommended Strength: 0.3-0.6
This model was trained to 2000 steps, 2 repeats with a learning rate of 4e-4 trained with Simple Tuner using the main branch. The dataset was around 90 synthetic images in total. All of the images used were 1:1 aspect ratio at 1024x1024 to fit into VRAM.
Training took around 3 hours using an RTX 4090 with 24GB VRAM, training times are on par with Flux LoRA training. Captioning was done using Joy Caption Batch with modified instructions and a token limit of 128 tokens (more than that gets truncated during training).
The resulting LoRA can produce some really great coloring book images with either simple designs or more intricate designs based on prompts. I'm not here to troubleshoot installation issues or field endless questions, each environment is completely different.
I trained the model with Full and ran inference in ComfyUI using the Dev model, it is said that this is the best strategy to get high quality outputs.
Testing and training takes a lot of time and personal resources. If you can afford it please contribute to my KoFi (https://ko-fi.com/renderartist) – Contributing will allow me more flexibility to train in the cloud and continue experimenting and sharing better.
renderartist.com
Trigger words
You should use c0l0ringb00k to trigger the image generation.
You should use coloring book to trigger the image generation.
Download model
Weights for this model are available in Safetensors format.
Download them in the Files & versions tab.