RimWorld

RimWorld

Bottom Left Portrait
How To Use Stable Diffusion to make AI generated portraits of pawns
Thanks to Vengyr, who posted this guide in the comments on January 18, 2023

Some familiarity with Stable Diffusion is needed. If you don't have Stable Diffusion installed, this guide might help: https://rentry.org/voldy
  1. You need: Stable Diffusion, Paint.net with this https://forums.getpaint.net/topic/32048-boltbaits-plugin-pack-for-pdn-v406-updated-aug-16-2017/ plugin pack, Sozai Maker mod.

  2. Use Sozai Maker to capture the pic of your pawn.

  3. Crop the pic so that it's still a square, with bottom of character being cropped (so that it won't be "floating"), and leaving a bit of space on top of the head (so that the head won't be cut off). It will be something like 300x300. Fill the background with white instead of transparent.

  4. Run img2img with Stable Diffusion on it. I use a denoise of 0.7, AnythingV3 model, and pretty basic prompt (describing how the pawn looks, age, some features like traits and profession). Realistic artstyle will be much harder than anime and might need a higher denoise.

  5. Once you get a pic you like, shrink it to 500x500, then crop the sides to 430x500. Use the magic wand to delete the white background (making it transparent). Choose the transparent parts with magic wand, do Effects -> Selection -> Outline Selection. Make it 1-2 width. Remove the outlines at the edges. Basically the whole portrait will have an outline. Without the outline it will look much worse.
Ask questions and share portraits of your pawns in the comments below!