Teens exploited by fake nudes illustrate threat of unregulated AI

stopthatgirl7@kbin.social to Technology@lemmy.world – 121 points –
axios.com

Westfield is but one example of an issue all school districts are grappling with as the omnipresence of technology — including artificial intelligence — impacts students' lives, the district's superintendent Raymond González said in a statement.

38

You are viewing a single comment
View all commentsShow the parent comment

Photoshop was always something that required skill, and a computer to run it, and a copy of a paid program.

This stuff does not need a lot of those hurdles. It’s all about ease and how it’s usable on your pocket computer that you and all your classmates have with you all the time.

Your thought is still a fair one to have. But there are big differences between what was and this new stuff. In the past you woulda needed a ton more skill and the alignment of a bunch of things to casually generate fake nudes like the ones covered by this article.

and a copy of a paid program.

I pirated photoshop when I was 13

Sweet. Me too. In the 90s. This is partially where I draw my understanding of the situation from.

Specifically:

  • The idea that piracy of professional software isn’t as casual as phone apps or web apps.
  • The fact that it’s paid software that is professional software with a learning curve.

You need a hell of a lot more computer power to run a llm than you do photoshop.

While true, you can generate AI images with a potato, it just takes longer. For my setup, stable diffusion on my RTX 3060 generates the basic image in around 10 seconds while running on CPU only takes around five minutes, but the result is exactly the same.

Do the files exactly match to their hashes? I wonder if there's a fundamental difference generated by using different hardwares.

AI always generate different outputs for the same input (AI appears to be non-deterministic) so it would be impossible to confirm that exactly.

But I suppose what they mean is they appear to be of the same quality. Taking a longer time does not appear to decrease the quality of the output.

I suppose you could give an AI the same input resetting it after each input and then use statistical models to identify common traits. Then do the same thing on different hardware and run the same statistical analysis and see if there is a difference between group A in group B but as far as I'm aware no one has done this.

In theory hardware shouldn't matter, it's all mathematics basically and one plus one is always equal two, so there shouldn't be any fluctuations.

Yes, I suppose given equal input (model, keyword, seed, etc.) two Stable Diffusion installs should output same images; what I am curious about is whether the hardware configuration (e.g. gpu manufacturers) could result in traceable variations. As abuse of this tech gains prominence, tracing back the producer of a certain synthetic media by the specific hardware combination could become a thing.

While it could work like bullet forensics, where given access to the gun you can shoot it and compare it to the original bullet, there is no way to look at a generated image and figure out exactly what made it as there are simply way too many variables and random influences. Well, unless the creator is dumb enough to keep the metadata enabled, by default automatic1111 stable diffusion embeds all of it in the file itself as a png comment thingy.