Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’

Technology@lemmy.world – 354 points – 12 months ago

Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’::Experts are starting to doubt it, and even OpenAI CEO Sam Altman is a bit stumped.

You are viewing a single comment

View all comments Show the parent comment

I can tell GPT to do a specific thing in a given context and it will do so intelligently. I can then provide additional context that implicitly changes the requirements and GPT will pick up on that and make the specific changes needed.

It can do this even if I'm trying to solve a novel problem.

But the naysayers will argue that your problem is not novel and a solution can be trivially deduced from the training data. Right?

I really dislike the simplified word predictor explanation that is given for how LLM's work. It makes it seem like the thing is a lookup table, while ignoring the nuances of what makes it work so well.

1 more...