Google’s Search AI Says Slavery Was Good, Actually

stopthatgirl7@kbin.social to Technology@lemmy.world – 437 points –
futurism.com

Google's AI-driven Search Generative Experience have been generating results that are downright weird and evil, ie slavery's positives.

169

You are viewing a single comment

People think of AI as some sort omniscient being. It's just software spitting back the data that it's been fed. It has no way to parse true information from false information because it doesn't actually know anything.

And then when you do ask humans to help AI in parsing true information people cry about censorship.

Well, it can be less difficult, but still difficult, for humans to parse the truth also.

The matter of being what is essentially the Arbiter of what is considered Truth or Morally Acceptable is never going to not be highly controversial.

1 more...

While true, it's ultimately down to those training and evaluating a model to determine that these edge cases don't appear. It's not as hard when you work with compositional models that are good at one thing, but all the big tech companies are in a ridiculous rush to get their LLM's out. Naturally, that rush means that they kinda forget that LLM's were often not the first choice for AI tooling because...well, they hallucinate a lot, and they do stuff you really don't expect at times.

I'm surprised that Google are having so many issues, though. The belief in tech has been that Google had been working on these problems for many years, and they seem to be having more problems than everyone else.

Even though our current models can be really complex, they are still very very far away from being the elusive General Purpose AI sci-fi authors have been writing about for decades (if not centuries) already. GPT and others like it are merely Large Language Models, so don’t expect them to handle anything other than language.

Humans think of the world through language, so it’s very easy to be deceived by an LLM to think that you’re actually talking to a GPAI. That misconception is an inherent flaw of the human mind. Language comes so naturally to us, and we’re often use it as a shortcut to assess the intelligence of other people. Generally speaking that works reasonably well, but an LLM is able to exploit that feature of human behavior in order to appear to be smarter than it really is.

What's more worrisome are the sources it used to feed itself. Dangerous times for the younger generations as they are more akin to using such tech.

What's more worrisome are the sources it used to feed itself.

It's usually just the entirety of the internet in general.

Well, I mean, have you seen the entirety of the internet? It’s pretty worrisome.

The internet is full of both the best and the worst of humanity. Much like humanity itself.

1 more...