Hey guys,
so Klein dropped and of course I had to throw it on my machine right away :D I ran both bf16 versions against each other with 50 prompts, same seeds, around 2MP, on an RTX A4500 with 20GB. Base with 50 steps and CFG 3.5, distilled with 15 steps and CFG 1, both with the official ComfyUI workflows. Left is base, right is distilled. These are my 10 favorites.
I didn’t use the prompt upsampler but wrote all prompts in the same caption style it uses, so medium first, then framing, people, background, light and text in quotes. Makes a big difference, short prompts give you pretty generic stuff.
Speed wise base took around 148 seconds per image and distilled around 24. So 50 images were about 2 hours vs 22 minutes, and on most prompts you really have a hard time telling which one is which.
Text is really good. The chinese sign, the japanese one, VISIT MARS, the chalkboard with the euro price, all correct in both. Only a neon HOTEL sign in the rain got messed up by both. Base wins when prompts get tricky though. I asked for robbers with cheap rubber masks of an old bald man and base gives you masks while distilled just gives you four creepy real old dudes :D Counting is still meh, I asked for seven elephants and got 6 and 5. I didnt cherry pick, so there are a lot of errors involved.
And yes I tested the not safe part too, I know you’re gonna ask :D Artistic not safe art :P works somewhat in base, not perfect but good enough that I think you can work with it, especially for finetunes and loras. Distilled is way more restrictive, it either skips nipples completely or just gives you clothes you never asked for to cover things up :D
For me distilled is the everyday model because of the speed and base is the one to build on