Air Canada must pay damages after chatbot lies to grieving passenger about discount – Airline tried arguing virtual assistant was solely responsible for its own actions

ylai@lemmy.ml to Not The Onion@lemmy.world – 618 points –
Air Canada must pay after chatbot lies to grieving passenger
theregister.com
54

You are viewing a single comment

That seems like a stupid argument?

Even if a human employee did that aren't organisations normally vicariously liable?

That's what I thought of, at first. Interestingly, the judge went with the angle of the chatbot being part of their web site, and they're responsible for that info. When they tried to argue that the bot mentioned a link to a page with contradicting info, the judge said users can't be expected to check one part of the site against another part to determine which part is more accurate. Still works in favor of the common person, just a different approach than how I thought about it.

I like this. LLMs are powerful tools, but being rebranded as "AI" and crammed into ~everything is just bullshit.

The more legislation like this happens where the employing entity is responsible for the - lack of - accuracy, the better. At some point they'll notice they cannot guarantee the correct information is the only one provided as that's not how LLMs work in their function as stochastic parrots, and they'll stop using them for a lot of things. Hopefully sooner rather than later.

This is actually a very good outcome if achievable, leave LLMs to be used where there's nothing important on the line or have humans control them