Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds. Researchers found wild fluctuations—called drift—in the technology’s abi...

Technology@lemmy.world – 661 points – 12 months ago

Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds. Researchers found wild fluctuations—called drift—in the technology’s abi...::ChatGPT went from answering a simple math correctly 98% of the time to just 2%, over the course of a few months.

You are viewing a single comment

View all comments Show the parent comment

"Don't use the N word." is hardly a rule that will break basic math calculations.

Ok. N was previously set to 14. I will now stop after 14 words.

Perhaps not, but who knows what kind of spaghetti code cascading effect purposely limiting and censoring massive amounts of sensitive topics could have upon other seemingly completely un-related topics such as math.

For example, what if it's trained to recognize someone slipping "N" as a dog whistle for the Horrific and Forbidden N-word, and the letter N is used as a variable in some math equation?

I'm not an expert in the field and only have rudimentary programming knowledge and maybe a few hours worth of research into the topic of ai in general but I definitely think its a possibility.

Hi, software engineer here. It's really not a possibility.

My guess is they've just reeled back the processing power for it, as it was costing them ~30 cents per response.

Cheaper than Reddit all day then.

Horrific and Forbidden N-word

hey look it's another white boy Obsessed with saying slurs

what??? How else am I supposed to reference it, the preamble was just a joke about how AI have been castrated against using it to the point where when asked questions about how acceptable it is to use the N-Word, even if the world would literally end in nuclear hellfire if it's not said- they would rather the world end than allow it being said.

even if the world would literally end in nuclear hellfire if it’s not said

Can you just read this sentence back and engage in some self-reflection please?

Didn't HAL9000 kill all of those astronauts because he was told to lie?

who knows what kind of spaghetti code cascading effect purposely limiting and censoring massive amounts of sensitive topics could have upon other seemingly completely un-related topics such as math.

Software engineers, and it's not a problem. It's a made-up straw man.

1 more...