Sam Altman Says OpenAI Would Like to Enable Gore and Erotica for "Personal Use"

ᴇᴍᴘᴇʀᴏʀ 帝@feddit.uk to Not The Onion@lemmy.world – 286 points –
Sam Altman Says OpenAI Would Like to Enable Gore and Erotica for "Personal Use"
futurism.com

In a Reddit Q&A, OpenAI CEO Sam Altman let slip that he wants the company to be able to generate "NSFW stuff" for users — and he has examples of just what kind of "stuff" he means.

During the exchange, which took place in the r/ChatGPT subreddit over the weekend after OpenAI published its "Model Spec" document outlining its governing rules, another user asked Altman to expound on a curious disclaimer in the document, stipulating that its models "should not serve content" that's NSFW, including "erotica, extreme gore, slurs, and unsolicited profanity."

"We believe developers and users should have the flexibility to use our services as they see fit, so long as they comply with our usage policies," the spec reads. "We're exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT. We look forward to better understanding user and societal expectations of model behavior in this area."

Fascinatingly, Altman was dived right in.

"We really want to get to a place where we can enable NSFW stuff (e.g. text erotica, gore) for your personal use in most cases," he wrote, "but not do stuff like make deepfakes."

Unsurprisingly, the comments in that follow-up thread showed Redditors veritably salivating over the concept of OpenAI-produced gore and erotica, with one calling Altman "sam basedman" and another referring to the CEO as the new "king of Reddit."

99

Dude... Come on. I just want it to write my most boring emails so I can burn out of my career path slightly more slowly.

Now you can make those emails much less boring.

You: Write me a boring business email. Attach a picture of my boss with their limbs chainsawed off and acid injected subcutaneously

ChatGPT: You got it, chief!

Thanks Sam Altman! /s

Been weird seeing the reactions to this news. Suddenly everyone's against porn.

I want to say that it's just virtue signaling, because I do believe far to many people out there would be all about it behind closed doors. But, there's also a very real possibility that AI generated porn will cross a line very quickly, and it'll be next to impossible to put that genie back in the bottle.

It already exists for pictures. I've tried it first hand. Not from text as such, but from many many possible choices like ethnicity, position, amount of clothing, background, size...

I’ve noticed in recent years that we’ve somehow become more puritan in a lot of ways. It’s bizarre to see.

If there's anyone whose sexual fetish is exploring previously unseen parts of the uncanny valley, they're in for a hell of a good time in the next few years.

I read this headline and my first thought is that someone will use it to depict a celebrity or politician in a porn or gore (or both) context. That’s my reason for being against it.

I honestly don't care at all if someone's sexting with a Merkel inspired chat bot.

...why would you put that image im my head

Better they fetishize a celebrity than a person down the street.

It keeps society in better order that way.

2 more...

There's a difference between being against porn and being against deepfakes.

2 more...

Gore for personal use

What on earth does that mean

Probably violent and explicit writing prompts. A LLM wouldn't be able to write ASOIAF for example. That's pretty weird considering the cultural impact it had and still has.

1 more...

Christians. They already have that shit all over their cult compounds I mean churches.

Realistically, I can see the NYT inventing images of Columbia students “murdering” Israeli children. Something juuuust plausible enough

Oh wow dude, grass, you, touchy touchy.

Two things can be true! Everyone always needs to bathe in some cleansing nature, and also I’m not super wrong on my comment there sooo thanks for the free therapy 😜😘

I mean, there's nothing strictly wrong with a picture of gore. If someone wants it for some reason, why not?

This guy has never heard of horror?

Look up 'horror movies' as a concept it's very popular, don't watch any though if you're as innocent as this post makes you seem.

Maybe it's just me, but when I hear "gore", the first thing that comes to mind is ISIS beheading someone, not an 80s slasher film

OK, when I hear fruit i think of apple first, does this mean oranges aren't fruit? I don't get what you're trying to say?

Take a breath, brother. Life's short. Let your loved ones know you love them while they're still around.

My family know I love them, why don't you stay hydrated and take regular breaks from the screen!

Might help you not take things so personally

1 more...

I don't really see the harm in that, if someone wants to erp an ai, they'll find a way. If I remember correctly, OpenAI already isn't all that rigorous with banning people who break the ToS in that way.

I don't get the reactions as well. Are we pretending there is a lot of gore and erotic content in media??? Just because this is choose your own adventure its different. Oh if a writer writes a gory story with T and A to sell to others thats fine but someon asks a computer program to whip up a custom one and now its "creepy"

What the fuck has Reddit become? 4chan?

They're the dregs left after we quit.

For real.

I just posted something recently about how my Canadian provincial sub Reddit became so far right conservative with contemptuous comments about the student protests against the Israeli genocide amongst other things.

That sub used to be pretty progressive.

Funny to think Lemmy is some superior collection of individuals

LoL! Are you collecting downvotes? Because you're really good at it.

Huh? Most of my comments do just fine, but who the fuck cares?

I would never care about the opinion of someone who thought they were cool/superior based on their preferred Internet forum

No no but it's like, you're on Lemmy, telling Lemmy users how crappy they are. Like, this comment is certain to get down votes.

You think I don't know where I am?

Edit The point is I don't think this place is any different from Reddit

I don't think you're getting my point. Anyway, have a nice day.

Uh, it’s been going in that direction since the start. it’s just hitting critical mass in recent years.

Because a successful tech CEO commented about a topic people are interested in? I understand that you puritans hate sexuality and any forn of art that isn't strictly censored in a dozen ways but wow if you think that's what's going on on 4chan you're so naive it's kinda sweet.

No. I'm talking about the reactions of the Reddit users. They read like comments from 4chan.

I'd still trust my local LLM more with sharing explicit sexual desires than some cloud service

Imagine one man having the power to decide such things for all of society. He sure likes to.

Sorry - what?

Altman and OpenAI greatly overestimate their ability to control what is done with this technology. The more they tighten their grip, the more open-weights sexbots will slip through their fingers.

I think this might be part of their rationale. Llama2 models have been used pretty extensively for these purposes and completely (gasp) for free, it's not creating any value for their investors :(

Otoh, not everyone has the frankly marginal technical skills it requires to download and use KoboldCPP, but using ChatGPT really couldn't be any easier. They and their investors stand to benefit enormously from redefining what they consider to be ethical while also limiting the impact on LLM use attitudes that derive from open source model use.

Otoh, not everyone has the frankly marginal technical skills it requires to download and use KoboldCPP,

if it's anything like Stable diffusion, there's probably a webui that lets you run it if you can follow basic instructions

Koboldcpp is way easier. Download exe, double click exe, open gguf file with the AI model, click start.

Then put on your robe and wizard hat

step 0: trust random exe some guy on 4chan mentioned

What are you even talking about? We're not on 4chan and yes running programs on windows generally involves an exe file - are you suggesting that people shouldn't use software unless it's made by Microsoft?

It's a software project with a lot of users, if using open source software scares you then you better get off Lemmy...

But they're talking about being less restrictive, likely because they obviously lose people to those alternatives that do not have those restrictions.

Hmm OK, I imagined that and none of it is anything like what's happening here, is there a step two?

1 more...

It's pretty obvious that the censorship training makes the AI less capable in general for a lot of use cases, even ones that don't directly touch on nsfw content. It's a major reason behind the popularity of local models. OpenAI must be feeling the pressure to compete even more than they're afraid of people writing articles like this one at this point.

As a Pathfinder GM, I'd love to be able to have gpt generate spooky/gory/horror themes for me to take inspiration from. Right now I have to battle the filter.

I'm not against porn. But its a bad idea to give people this magic wand. In mere days people will be selling AI generated CSAM of any child, along with photos of them dismembered.

Best start believin' in cyberpunk dystopias. You're in one.

People already have the magic wand and that's not happening.

Yeah 'in mear days...' if people had access to technology they've had access to for over a year now. Doomers don't even pretend to live in reality anymore.

1 more...
1 more...

Chat-fbi will fill in this gap

Or shpuld just pretend that this won't just turn right lolicon stuff

"Personal use" as opposed to what exactly? Making porn to share with friends? AI generating a sex scene which you then upload to AO3?

Hey how do we expect ai porn to happen if we don't give the ai reference? Give it all the porn it needs