FOSS AI painting with Krita

Björn Tantau@swg-empire.de to Free and Open Source Software@beehaw.org – 109 points –

It's so awesome that I can let my kid paint with Krita and let her enhance the picture with AI live. She wanted to have an AI picture editor on her phone but I didn't like the privacy policy. But Krita AI Diffusion came to the rescue.

After testing it out myself I showed her Krita, the most important tools and how to use layers and before I could say anything she was off to paint a nice landscape. When she was finished I actually got to enable the AI plugin and show her the ropes around that. And after enabling live painting she went ham and added a phoenix and a giant hand.

Hardest thing about it was that she had to describe what she wanted in English. But she's already learning that in school so it shouldn't give her too much trouble in the long run.

Anyways, FOSS rules!

13

You are viewing a single comment

I tried it myself and it is very interesting but I was a little confused with what options to use. Can you give some examples? For example wich model and strength did you used? How do you used the layers for the controlnet? Thank you

I watched some tutorials on YouTube.

For this image she used live mode of Comics & Anime at about 30% strength. Increasing or decreasing the strength as needed. She painted filled out shapes, like filled out triangles for the mountains, green and blue for the field and sky and the general shape of a bird in orange for the phoenix.

Just painting the outlines generally doesn't work as well as using filled out shapes. And it's important that you describe. what's in the picture.

We didn't use the layers at all. If you can find some documentation on those that would be appreciated, I don't get them either.

I recorded her work. I'll ask her if I may upload it.