Clinicians could be fooled by biased AI, despite explanations

L4sBot@lemmy.worldmod to Technology@lemmy.world – 126 points –
news.engin.umich.edu

Clinicians could be fooled by biased AI, despite explanations::Regulators pinned their hopes on clinicians being able to spot flaws in explanations of an AI model's logic, but a study suggests this isn't a safe approach.

5

You are viewing a single comment

Don't worry, it won't ever get that far... Insurance AI would have denied the imaging request.

I would laugh if only this wasn't a terrifying plausibility. Imagine you have pneumonia and need a chest x-ray to confirm that was denied because you were out of network. Imagine there is no recourse because all customer service has been outsourcedto a very friendly chat bot who will kindly tell you 'DENIED' after arguing with it for 30 minutes.