pixel_spritesheet_4walk_small_lora_v1
Model description
A pixel art spritesheet LoRA for small 32x32 characters, with animation frames for walking up/down/left/right, standing with both arms raised, jumping left/right, and lying on the floor.
How to use
You can use the default FLUX.2 Klein base 4B workflows from ComfyUI. Both the text-to-image workflow and the edit base workflow work.
Images should be 512x512 because that's the size of the spritesheets used in training.
Both the 2750-steps LoRA and the 3000-steps LoRA are available. The 3000-steps version seems to be more consistent in making humanoid characters, but the 2750-steps version seems a bit more creative in non-humanoid characters if using edit + an image reference.
Does this LoRA work with FLUX.2 Klein 4B distilled?
No. It's technically compatible, but the distilled model ruins the quality of the pixels and the consistency. Use the base model.
How to get pixel-perfect images
To get pixel-perfect images, downscale by a factor of 4. So 512x512 images should downscale to 128x128. Using k-centroid scaling works well.
See the examples below:
| Raw output | K-centroid downscaled, then upscaled back to 512x512 |
|---|---|
Using an image reference
You can use the edit workflow with an image reference of a character for your spritesheet.
Prompt: Create a pixel art spritesheet of the character in the image. The spritesheet is a 4 by 4 grid of four rows of frames - first row is 3 walking frames facing down and 1 frame both arms raised, second row is 3 walking frames facing left and 1 frame jumping left, third row is 3 walking frames facing right and 1 frame jumping right, fourth row is 3 walking frames back view facing up and 1 frame lying on floor.
Testing the spritesheets in a game
If you want to quickly test your spritesheets in a 2D game, here's a simple "sandbox" game/tool where you can upload the raw spritesheet outputs and spawn in your characters to move around:
Link to tool here
Source code here
Notes
This is a first attempt at making a pixel art spritesheet LoRA using small sprites. There are sometimes bad images generated with issues like hair or headwear being cut off, and non-human characters with bad anatomy. The bottom row of sprites with the back view also has problems with consistency sometimes (for example, the werewolf is missing the red scarf).
Credits
- The dataset used to train this LoRA consists of spritesheets edited and based on a template spritesheet by George Bailey, licensed under CC BY 4.0
Download model
Download them in the Files & versions tab.