Teen girls are being victimized by deepfake nudes. One family is pushing for more protections

MicroWave@lemmy.world to News@lemmy.world – 466 points –
Teen girls are being victimized by deepfake nudes. One family is pushing for more protections
apnews.com

A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls - that attend a high school in suburban Seattle, Washington.

The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.

351

You are viewing a single comment

The problem is how to actually prevent this. What could one do? Make AI systems illegal? Make graphics tools illegal? Make the Internet illegal? Make computers illegal?

Make "producing real or simulated CSAM illegal?"

Isn't it already? Has it provided any sort of protection? Many things in this world are illegal, and nobody cares.

Yes, I would argue that if CSAM was legal, there would be more of it...meaning it being illegal provides a level of protection.

I wonder why are you being downvoted, something being illegal puts fear in most people to not do it.

I've been wondering about this lately, but I'm not sure how much of an effect this has. There are millions of people in prison, and many of those will go on to offend again. Making things illegal can be seen as an agreement to a social contract (in a democracy), drive the activity underground (probably good thing in many cases), and prevent businesses (legal entities) from engaging in the activity; but I'm not sure how well it works on an individual level of deterrence. Like, if there were no laws, I can not really think of a law I would break that I wouldn't already break regardless. I guess I'd just be more open about it.

Though, people who cause harm to others should be removed from society, and ideally, quickly rehabilitated, and released back into society as a productive member.

1 more...

It is where I'm at. Draw Lisa Simpson nude and you get a visit from the law. Dunno what the punishment is though. A fine? Jail? Can't say.

Edit: Apparently I was wrong, it has to be a realistic drawing. See here: 2010/0064/COD doc.nr 10335/1/10 REV 1

What about making depictions of other crimes? Should depictions of theft be illegal? Depictions of murder?

Why should depictions of one crime be made illegal, but depictions of other heinous crimes remain legal?

Because a picture of someone robbing my house doesn't revictimize me. Even if it's simulated, every time they run into some rando who recognizes them or every time a potential employer runs a background/social media check, it impacts the victim again

A picture of a cartoon child having sex doesn't victimize you either, the same way a drawing of a robbery doesn't victimize you

You mean being raped. What it does is let pedos feel like it's OK to be pedos.

Lol just like violent video games makes people think it's ok to be violent in real life?

Who is being victimized with a drawing of Lisa Simpson?

1 more...

By dishing out punishment that really hurts.

Severity of punishment works poorly. Inevitability, on the other hand...

I think in this case less mild punishment would send the appropriate signal that this isn't just a little joke or a small misdemeanor.

There are still way too many people who believe sexual harassment etc. aren't that huge of a deal. And I believe the fact that perpetrators so easily get away with it plays into this.

(I am not sure how it is in the US, in my country the consequence of crimes against bodily autonomy are laughable.)

Require consent to take a person's picture and hold them liable for whatever comes from them putting it on a computer.

That's a whole fucking can of worms we don't need to open. Just make faking porn a crime similar to publishing revenge porn.

Nah. Use my image and pay me what I want. If I can't make a Mickey Mouse movie they shouldn't be able to make a porn staring me. Does a corporatation have more rights to an image than I have to my image?

That really depends on what you consider "using my image". Are you going to demand that people pay you because you were wandering around in the background of their family photo or their YouTube video? Will you ask to be compensated when people post group photos that include you on their social media? Does mom owe you money for all those pictures she took of you as a kid?

You already need consent to take a persons picture. Did it help in this case? I don't think so.

Very rarely do you need consent to take peoples pictures

*in the US.

In the US, the thought is that if you are in a public place, you have no presumption of privacy. If you're walking down the street, or shopping in a grocery store or whatever else, anyone can snap a picture of you.

Other countries have different values and laws such that you may need a person's permission to photograph them even if they are in a public place.

That thought is a pile of bull crap. If you really think you have zero presumption of privacy then I have the right to follow right behind you with a sign that says "idiot ahead". Laws like this are so written for the drug war and for big media not for us.

Not saying I agree with it, that's just the way the laws are written.

A good example of how crappy this law works out is paparazzi. They harass celebrities just to get any halfway decent photo. Then they can sell the photo, the celebrity has no say in the matter. And to make things even worse, if the celebrity happens to use the photo of themselves in any way, the photographer can demand payment because they own the copyright.

And this is exactly what I was talking about. We need tules that say you own your own image.

That much I can agree with. If someone takes a picture of me, I should have some say in how that image is used, even if the default assumption is that a person in public is plainly visible to everyone including photographers.

But there's a lot of nuance here. Maybe a celebrity, or any person really, doesn't want an unflattering image used. Fair enough I suppose, but to what extent is that actually enforceable?

Or maybe the subject wants to use the image of themselves for their own purposes. Does the photographer deserve compensation for their role in creating the image?

What about unflattering images of politicians or government employees? What about criminals? There's a line to be walked here as well. We already have this sort of concept in slander laws. Public figures have a higher bar to prove damages resulting from statements that might otherwise be considered slanderous or libelous. There are also free speech and freedom of the press issues associated with government entities.

Yes, you should have a right to decide how your image is used, and yes, you should probably have some shared ownership of images of yourself unless you agree otherwise. But the reality isn't so clear cut.

Admittedly, I haven't looked into how other parts of the world that don't default to lack of privacy in public handle this. Some of these questions must have already been hashed out.

Sorry, I forgot that the US is decades behind the rest of the world in privacy laws.

Well, maybe you could start with this aspect.

Really? Please show me the signed and notarized letter with the girl's name on it that says they agree to have their image used for AI porn. Also since she is a minor her legal guardians.

How would you possibly enforce that, or prevent people from just copying publicly available pictures for nefarious usage

It would have to be enforced after getting caught. As an add on charge. Like if an area has a rule against picking locks to commit a crime. You can never be charged with it alone but you can add that on to existing charges.

1 more...