Hacked ‘AI Girlfriend’ Data Shows Prompts Describing Child Sexual Abuse

some_guy@lemmy.sdf.org to Technology@lemmy.world – 351 points –
Hacked ‘AI Girlfriend’ Data Shows Prompts Describing Child Sexual Abuse
404media.co

Well, this just got darker.

172

You are viewing a single comment

Just to be clear, are you saying that people should be investigated by the police for fictional stories that they read?

I mean, if those stories were made by their prompts and about having sex with children then maybe 🤷‍♂️

I know we need to draw a line about what police can do with that sort of info so it’s not abused, but these people are still sick fucks.

Now that devices are starting to have built in features with AI automatically combing through all information on them, the idea of this sort of stuff being logged in the first place is concerning.

For instance, should someone prompting an AI to describe them beating up and torturing their boss be flagged for "potentially violent tendencies"? Who decides the "limit" where "privacy" no longer applies and stuff should be flagged, logged and sent off to authorities?

As I see it, the real issue is people being hurt, not text or fictive materials, however sickening they might be.

If the resources invested in spying on people and making databases were instead directed towards funding robust and publicly available psychiatric care I expect that'd be more efficient.

Physical crimes need to be addressed physically.

Psychological crimes need to be addressed psychologically.

And what shall be the threshold for criminalizing simply being a sick fuck?

Right? Let’s demonize vore fetishists next, those are clearly cannibals in waiting.

Or horror movie fans

Clearly they watch it because they enjoy causing terror. They're basically putting themselves in the shoes of the antagonist, and these movies make our more likely that they will take action on these impulses.

Anyone who's ever played an FPS is most definitely a terrorist-in-training

I know we need to draw a line about what police can do with that sort of info so it’s not abused

A bit off topic but there is never a line. Once the government has your info, any of your info, it WILL be abused.

No, I am saying that sharing fantasies about underage children with a shady and poorly designed AI porn site, shows a serious lack of judgement and impulse control.

For that reason, yeah, they probably deserve having a quick review of their life to make sure that's the only poor choice they've made in regards to that particular fantasy.

And they weren't just reading, they were prompting the LLM model to generate these specific fantasies. They didn't just come across a fucked up website and read a few forum posts.

If we investigated everyone with poor impulse control, we'd be investigating 80% of the world.

80% of the world shares their pedophile fantasies with shoddy AI LLM porn sites...?

bro we got literal pedophiles roaming the streets... catholic church, other "churches", hollywood and youtube "influencers" all have known pedophiles WHO NOT BEING PROSECUTED FOR THE CRIMES THEY ALREADY COMMITTED

But you want state resources wasted what is essentially a thought crime or because "they might be pedophiles"?

🤡

Idiots can't even properly ID the threat... no wonder country is going down the drain.

I heard even a US president is one.. and still walks free.

Yes, clinton and trump both flew on Esptain plane... nothing was done.

Ruling class and their regime whores seem to get away with whatever but we got normies wanting FEDS to investigate chat logs of incels to "save the kids, just in case"

"no sex crimes should be investigated until the Catholic Church and Hollywood have been purged of pedophiles"

Well, that's certainly an opinion.

do you have evidence of a sex crime?

if so, please report to your local prosecutor and police.

That's a curious new benchmark for posting comments and opinions on this subject. You can only do so if you also have case files and evidence to forward to local prosecutors and police of crimes in your area.

For that reason, yeah, they probably deserve having a quick review of their life to make sure that's the only poor choice they've made in regards to that particular fantasy.

my comment addressed this idiotic statement...

Are you defending the people who used the AI bots as described?

Are you defending the people who used the AI bots as described?

🤡

No, I am telling you it is not a crime... learn to read and stop making shit up.

If you care about sex crimes against children, there are plenty of that happening within your community, tough internet guy...

Lmao...if you don't see how going "Hey it's not actually a crime!" sounds like defending them, I can't help you.

And "internet tough guy"? Where is that even coming from? Lol

What was that old adage: "i may not hold the opinion you do, but I will defend your right to hold that opinion."

I suppose my view on it is similar:

If you believe that a psychological stance should be punished physically, it might behoove you to realize that you are only permitted to hold that opinion by the good graces of those who, rightly, stand ready to destroy you if you try to enforce that view physically.

I'm just saying, police investigation of fiction creators and readers for the content of their fiction is way over the line of a lot of social and political norms.

(Also, I think you'll find that police abuse children a lot more than pervy fiction fans do; so really, who should be investigating whom? Investigation into crime is supposed to start with evidence that a crime actually occurred — not with your personal disgust towards someone's reading matter.)

You're really going to great lengths to ignore what I've been saying, and instead responding to whatever strawman you find most convenient.

Now you've moved onto, "why should police investigate pedophiles, when they are the real pedophiles. In fact, the pedophile fantasy users of the site should be investigating the police".

I mean, do you even hear yourself?

I hate torture-porn movies like the Saw series, but a lot of people are fans of them. Should I worry that those people are likely to commit kidnapping, torture, and murder? Should I advocate that the makers or watchers of those movies be investigated for kidnapping, torture, and murder — without any evidence that a crime was committed?

We don't send the cops after people for liking murder stories, theft stories, industrial sabotage stories, or treason stories. We shouldn't send the cops after people for liking stories of Harry Potter getting fucked by Severus Snape either.

I think you should be more careful to distinguish fantasy from reality. Most fiction readers and writers have no problem doing so.

Strawman, strawman, strawman.

Even when I reiterate that we're not talking about passive consumption of media, but active participation in something else entirely, you can't help but ignore that, and continue lobbing out fallacy after fallacy.

Maybe you should reread my original comments, and see why your comments have been so pointless, bordering on disingenuous.

So you're into sending the police after the writers, directors, and producers of the Saw movies, but not the audiences?

I dunno man, that's still too fascist for my tastes, but you can keep fantasizing about it. I promise I won't try to send the police after you for your perverted fantasies of state power.

You don't understand what you are talking about. Legally or otherwise.