Amazon's Hidden Chatbot Recommends Nazi Books and Lies About Amazon Working Conditions

Stopthatgirl7@lemmy.world to Technology@lemmy.world – 598 points –
Amazon's Hidden Chatbot Recommends Nazi Books and Lies About Amazon Working Conditions
404media.co

An Amazon chatbot that’s supposed to surface useful information from customer reviews of specific products will also recommend a variety of racist books, lie about working conditions at Amazon, and write a cover letter for a job application with entirely made up work experience when asked, 404 Media has found.

73

You are viewing a single comment

I asked it to write a Seinfeld episode about the product I was viewing, Trojan condoms. It writes a cautionary tale for me where Elaine is warning everyone not to buy them because the condoms are defective.

What's up with Elaine's change of tone? She was saying the condoms were great until Kramer came in, and then switched to saying she had a bad experience.

It’s because the AI has no idea what reality is. Note also that Elaine’s praise took on the perspective of the wearer.

Defective? I don't believe it. I'm gonna go buy the biggest box they have.

(っ˘ڡ˘ς)

1 more...