The 'Compact' Version of Stable Diffusion 3 Is Generating Monstrous Human Bodies(xatakaon.com)
xatakaon.com
The 'Compact' Version of Stable Diffusion 3 Is Generating Monstrous Human Bodies
https://www.xatakaon.com/robotics-and-ai/the-compact-version-of-stable-diffusion-3-is-here-and-its-generating-monstrous-human-bodies
48 comments
And sometimes that body is nude. On one hand I hope that this will help some people understand that their standards of what is SFW or NSFW need to be adjusted. Also, why the hell are we using workplaces as a yard stick for what is acceptable in our private life? Why on earth is it a problem if kids see tits at home?
Anyway, I hope standards will change in the US faster than the rest of the world finishes shifting to those utterly stupid standards.
Anyway, I hope standards will change in the US faster than the rest of the world finishes shifting to those utterly stupid standards.
Indeed, what counts as safe and not-safe varies wildly by culture.
I live in Berlin, and outside my apartment there is a spinning cube of adverts; the face of that cube advertising for Dildo King is between the face advertising for family cargo bikes and the face advertising for Edeka (a supermarket). There are also several nudist beaches within the city limits.
From outside the USA, I sometimes hear things such as Florida wanting to treat cross-dressing as inherently sexualised and therefore criminal if done in the presence of minors. (Was that a true story? When I search for it, I get transgender issues, rather than cross-dressing, so I can't find out if Hillary Clinton's trousers are a literal fashion crime in Florida).
I live in Berlin, and outside my apartment there is a spinning cube of adverts; the face of that cube advertising for Dildo King is between the face advertising for family cargo bikes and the face advertising for Edeka (a supermarket). There are also several nudist beaches within the city limits.
From outside the USA, I sometimes hear things such as Florida wanting to treat cross-dressing as inherently sexualised and therefore criminal if done in the presence of minors. (Was that a true story? When I search for it, I get transgender issues, rather than cross-dressing, so I can't find out if Hillary Clinton's trousers are a literal fashion crime in Florida).
https://medium.com/incerto/the-most-intolerant-wins-the-dict...
it's interesting to consider the implications of Taleb's essay in light of the companies trying to make globally inoffensive LLMs.
it's interesting to consider the implications of Taleb's essay in light of the companies trying to make globally inoffensive LLMs.
Although it'll be fascinating to see how things like the finger situation change as we get models in common use that also handle video well. One thing that becomes obvious quickly with Stable Diffusion is that it doesn't have a good concept of a 3D world model to work with; or any grasp of physics. It is practically impossible for a human artist with SD levels of competence to accidentally draw multiple limbs and that speaks to how it just doesn't get that humans are a 3D existence.
Once video data is involved though it seems likely that will change. And I reckon a side effect is that a lot of the trickier details will improve. It'll be a great experiment to figure out whether the models also need lessons in anatomy or whether they figure it out through pure observation.
Once video data is involved though it seems likely that will change. And I reckon a side effect is that a lot of the trickier details will improve. It'll be a great experiment to figure out whether the models also need lessons in anatomy or whether they figure it out through pure observation.
I think the point is you need a naked human body - art classes use volunteers, midjourney presumably uses pornhub. I guess there is not a lot of naked human images out there that’s not porn.
At least since v5 and barring any prompt engineering, midjourney is a real prude. I would be very surprised if it's trained on porn. Try something like "women at the beach" and everyone is wearing wetsuits. Or the infamous "treasure chest is a banned term".
FWIW this is better for my purposes, with the older versions I recall trying to generate illustrations of female scientists for use in professional settings, and having to do a lot of tweaking to avoid ahem chest issues.
It seems obvious that midjourney is trained on copyrighted material though. I've seen the latest version generate straight-up "Tom Cruise in Top Gun 2" and similar.
FWIW this is better for my purposes, with the older versions I recall trying to generate illustrations of female scientists for use in professional settings, and having to do a lot of tweaking to avoid ahem chest issues.
It seems obvious that midjourney is trained on copyrighted material though. I've seen the latest version generate straight-up "Tom Cruise in Top Gun 2" and similar.
I imagine if they filtered out just the bits with some action going on, they'd still have approximately infinite feed of naked human bodies in all possible poses, which would be unoffensive out of context (or at least less offensive), and would be equivalent to art classes models for the purpose of training.
This would be doable, but expensive. You'd need to pay people to go through 10,000 pornographic images and manually blur out all of the fun bits.
It really is not difficult to find breasts, bottoms and well proportioned limbs on the Internet. Even in underwear if you must because you’re afraid of something.
I suspect it’s not a matter of “don’t use porn because porn is socially unacceptable” but “we don’t use copyrighted training data and all 99.9% porn is copyrighted by commercial entities who sue”
We know they do it and they don’t even really hide. Porn producers are not that different from photograph agencies and stock image sellers. Porn is also full of public domain pictures, just like any topic. OTOH, they go to great lengths to make sure that their model’s output does not show a nipple.
Good AI image generators handle those details well already. Even if you don't get it 100%, you can inpaint fix very quickly.
The current problem for them really isn't the details in isolation but rather cohesive details throughout the entire picture in one attempt. It's very lacking and requires a lot of manual input, filtering, reliance on multiple tools, etc.
The current problem for them really isn't the details in isolation but rather cohesive details throughout the entire picture in one attempt. It's very lacking and requires a lot of manual input, filtering, reliance on multiple tools, etc.
> Good AI image generators handle those details well already. Even if you don't get it 100%, you can inpaint fix very quickly.
But that should not be the case. A human body is not more complicated than a horse’s or a cat’s, and those are usually much better. There really is a problem in our relation with our own bodies.
But that should not be the case. A human body is not more complicated than a horse’s or a cat’s, and those are usually much better. There really is a problem in our relation with our own bodies.
I do think we have much more sensitivity to deviations in human appearance. We probably wouldn't notice a lot of "weird looking" cats that other cats would
Looking at these mangled bodies, it’s not small deviations. We would definitely notice a cat with 6 limbs or 3 ears.
Yes in this case for sure, just meant in general
>> Good AI image generators handle those details well already. Even if you don't get it 100%, you can inpaint fix very quickly.
>But that should not be the case.
What is your point here? Good AI should not make mistakes? Or good AI should not handle those details?
Go ahead and ask some human artist how difficult it is to draw hands.
>But that should not be the case.
What is your point here? Good AI should not make mistakes? Or good AI should not handle those details?
Go ahead and ask some human artist how difficult it is to draw hands.
> What is your point here? Good AI should not make mistakes? Or good AI should not handle those details?
Yeah, I should have been clearer. If you release a generator model for the general public, it needs to work. You cannot say that the user need to fix it themselves or learn what inpainting is. From a user’s point of view, it either works or is broken. That’s ok for specialist tools or technical audiences that love playing with the bleeding edge, but that’s about it.
Yeah, I should have been clearer. If you release a generator model for the general public, it needs to work. You cannot say that the user need to fix it themselves or learn what inpainting is. From a user’s point of view, it either works or is broken. That’s ok for specialist tools or technical audiences that love playing with the bleeding edge, but that’s about it.
Yeah, it's especially ironic given how big a role nude modelling plays in art schools - it's fundamental to drawing, painting and sculpting.
I've never seen a drawing book start from outside-in. We learn from the massed blocks, sketched curves, and mirrored proportions. The shapes, the skeleton, the muscles and skin.
Has genAI for images hit an asymptote in the last year or so? Can't quite tell if things have gotten noticeably better since around when DALLE 3 was launched, it all looks about the same quality.
Yeah, the mainstream stuff that you get to use while subjected to heavy surveillance and censorship is about the same. There's a whole universe underneath that, with no restrictions and basically unlimited creativity, if you have the required hardware.
Any pointers for where people working on the DIY side of image genai hang out? Any specific forums or subreddits?
Civit.ai, discord, 4chan, and huggingface
Unstable diffusion is where to go if you want to get into the NSFW community.
Unstable diffusion is where to go if you want to get into the NSFW community.
Thanks to the horseshoe [0] puritanism we will live in a safer world. It's all right, everything is all right, the struggle is finished.
0, https://en.wikipedia.org/wiki/Horseshoe_theory
0, https://en.wikipedia.org/wiki/Horseshoe_theory
Oh man do I mention Horseshoe alot... Its all extremism either way.
Just what I needed - some nightmare fuel before I go to sleep. But putting that aside - how is Stability still going? The VC money didn't dry out yet?
"Suppose you get a salamander. You know, a salamander can regrow its limbs if you cut them off. So all these nasty biology students do things like, they'll cut a limb of the salamander -- a hand, the arm off, just between the shoulder and the elbow, and at the same time, cut the same one between the elbow and the hand, flip around that segment, and re-sew it back on. Nasty thing to do to a salamander. What do you think you get? Does anybody here know? What you get is three elbows. It grows two new elbows to make up for the fact that the wrong thing is connected to the wrong thing." --Gerald Sussman, "We Really Don't Know How To Compute!" (https://www.youtube.com/watch?v=HB5TrK7A4pI&t=2m49s)
These images look like someone spliced salamander regeneration DNA into a human, cut them into many pieces, and connected the wrong thing to the wrong thing all over the place. Maybe that's what the AI wants to do to us, AM style (I Have No Mouth and I Must Scream)?
These images look like someone spliced salamander regeneration DNA into a human, cut them into many pieces, and connected the wrong thing to the wrong thing all over the place. Maybe that's what the AI wants to do to us, AM style (I Have No Mouth and I Must Scream)?
SD 1.5, on the the other hand, with the right checkpoints generates flawless human bodies. Older tech, much better results.
Can finetuning fix this?
Can finetuning fix this?
> generates flawless human bodies
wonder what the right checkpoints are. I could have sworn sd 1.5 will sometimes generate 3 flawless arms.
wonder what the right checkpoints are. I could have sworn sd 1.5 will sometimes generate 3 flawless arms.
Yeah, sometimes. But it can also do this, for example (NSFW!): https://files.catbox.moe/le4v1y.jpg
“I have no mouth and I must scream” territory.
Plot twist: This isn't monstrous; it's just how AI envisions our future!
I still don't understand the interest in these capabilities. Makes me think of many kids in the 80's playing around with synths - most of them work on banks now ; )
Caricature works, but I maintain a visceral disklike for seeing the human form distorted in imagery.
Cur that noise out.
Cur that noise out.
This is what AI creativity looks like.
AIs tend to do interesting things only by accident. But interesting accidents happen quite frequently.
What SD3 has done here is "good art," as modernity defines the term: It's unique, it's technically adroit, and, most of all, it's shocking, thought provoking, unsettling. You can only wonder what went through the mind of the "artist" -- what it was trained on, how it attained such a strange result. This is at least gallery-tier if not worthy of MOMA, and I'm 100% serious about this.
What SD3 has done here is "good art," as modernity defines the term: It's unique, it's technically adroit, and, most of all, it's shocking, thought provoking, unsettling. You can only wonder what went through the mind of the "artist" -- what it was trained on, how it attained such a strange result. This is at least gallery-tier if not worthy of MOMA, and I'm 100% serious about this.
I want to see artists create works by selectively removing concepts or elements from AI models. There have been many great works created by neuro-atypical artists or those with disabilities. Would it be similar?
So they looked at this and said "ship it"?
Stability has almost no money left.
And their only hope is to get more investors to prop them up.
So it kind of makes sense that they would go with a conservative model that was virtually immune to the AI porn / deepfake panic.
So it kind of makes sense that they would go with a conservative model that was virtually immune to the AI porn / deepfake panic.
Love it
[deleted]
[deleted]
Also, I found this quote interesting: "...Stability AI’s insistence on censoring adult content from SD3’s training data". Da Vinci figured this out hundreds of years ago, that to draw accurate pictures of humans, you need to understand the human body.