'Don't use AI detectors for anything important,' says the author of the definitive 'AI Weirdness' blog. Her own book failed the test

floofloof@lemmy.ca to Technology@lemmy.world – 116 points –
'Don't use AI detectors for anything important,' says the author of the definitive 'AI Weirdness' blog. Her own book failed the test
fortune.com
8

You are viewing a single comment

Using AI with humans-in-the-loop is a fantastically powerful combination. We can solve many problems with smart system design that humans alone cannot achieve.

Source: PhD on automated animal censusing: we can build visual databases of individual animals for passive and long-term conservation work.

Absolutely, but that’s not what she’s saying. She’s saying that the products that tout the capability to detect the usage of LLMs to cheat on essays and the like are really rubbish and give a lot of false positives.

She mentions that they’re particularly inaccurate when it comes to English-as-second-language speakers, meaning foreign/exchange students are more likely to get marked as cheaters even though they might not be.

I think the issue is that our education system is dated. Grades in general aren’t effective measures of knowledge, and they suck as motivators.

AI tools aren’t going anywhere so the education system will need to find a way of working with them. It’s time to modernise.

2 more...
2 more...