College student put on academic probation for using Grammarly: ‘AI violation’

L4sBot@lemmy.worldmod to Technology@lemmy.world – 345 points –
College student put on academic probation for using Grammarly: ‘AI violation’
nypost.com

College student put on academic probation for using Grammarly: ‘AI violation’::Marley Stevens, a junior at the University of North Georgia, says she was wrongly accused of cheating.

79

You are viewing a single comment

You may not agree with the policy or the tools used, but the rules were clear, and at this point she has no evidence that she did not use some other Generative AI tool. It’s just her word against another AI that is trained to detect generated material.

What is telling is her reaction to all of this, literally making a national news story because she was flagged as a cheater. I promise if she wasn’t white or attractive NY Post wouldn’t do anything. What a massive self own. Long after she leaves school this story will be the top hit on a google search of her name and she will out herself as a cheater.

You shouldn't put too much stock in these detection tools. Not only do they not work, they flag non-native English speakers for cheating more than native speakers.

And flags anything you've previously submitted, including plans.

they flag non-native English speakers for cheating more than native speakers.

Yes, and for me as a former it's absolutely clear why - because I'm doing the same thing as a generative model, imitating text in another language. Maybe with more practice in verbal communication and being more relaxed I could reduce this probability, but the thing is this is not something which should affect school tests at all.

These are people trying to use a specific kind of tools where it's fundamentally not applicable.

What clear rule did she violate though? Like, Grammerly isn't an AI tool. It's a glorified spell check. And several of her previous professors had recommended it's use.

What she did "wrong" was write something that TurnItIn decided to flag as AI generated, which it's incredibly far from 100% accurate at.

Like, what should she have done differently?

You can't create a relaiable AI to detect AI. Anyone that told you otherwise is selling you snakeoil.

i don't believe she cheated, but i also don't care.

i do think being a conventionally attractive blonde did help her get coverage.

i also want turn it in to die in a fire.

i'm very conflicted about your comment, but i'm not conflicted about this situation at all: stop using turn it in, and put the girl back in school.

i do think being a conventionally attractive blonde did help her get coverage.

No doubts, though conventions are a bit different where I live.

If that puts pressure on something systematic, that'd mean someone's individual attractiveness being good for everybody.

I can make an offline AI say absolutely anything in any way shape or form I would like. It is a tool that improves efficiency in those smart enough to use it. There is nothing about it that is different than what a human can write.

This is as stupid as all of the teachers that used to prevent us from using calculators for math 20 years ago. We should be encouraging everyone to adapt and adopt new technology that improves efficiency, and take on the real task of testing students with intelligent adaptive techniques. It is the antiquated mindset and academia that is the problem. Anyone that can't adapt should be removed. When the student enters the workforce, their use of such efficiency improving tools is critical.

3 more...

... No proof she didn't? What could possibly prove that?

Can you give me an example of this proof? And if so, is that something reasonable for a student to have?

Seriously, think it through.

If you write something in Word or an equivalent program, there will be metadata of the save files that shows creation and edit timestamps. If they use something like Google Docs, there's a very similar mechanism via the version history. I actually had the metadata from a Word document be useful in a legal case.

Ok, and that's proof of what exactly? That you made the file when you said you did?

Not to mention, you can set those to whatever value you want

I can see how it could be part of a court case, because it's one more little corroborating detail. It doesn't prove anything though

The edit history would show things like copy/pasting large blocks of text versus normally typed edits.

A quick search shows you can edit this as well... That is interesting though, I didn't know it existed

Give me a couple hours and I could build something that makes pastes appear to be keystrokes. Give me a weekend, and I can build something mathematically indistinguishable from a human typing that will hold up to intense scrutiny

It still doesn't prove anything, it's just one more piece of circumstantial evidence. Still, it's not unreasonable to paste the full text into it, or mix and match. Maybe you don't have word installed on your computer - I don't, I haven't since I was in school myself. It's reasonable to use word on school computers but do all of the work on an online text editor, then pasting into word on a school computer

You may not agree with the policy or the tools used, but the rules were clear,

OK, if you'll be consistent and agree that using Taro cards to determine who's cheating is normal, if rules say that.

and at this point she has no evidence that she did not use some other Generative AI tool

Your upbringing lacks in some key regards.

It’s just her word against another AI that is trained to detect generated material.

There are (or should be) allowances for the degree of precision where any tool can be trusted. If it is wrong in 1% of cases - then its use is unacceptable. In 0.1% - acceptable only if she doesn't argue it. In 0.01% something - acceptable with some other good evidence.

I'll help you become a bit less of an ape and inform you that an "AI" (or anything based on machine learning) can't be used as a sole detector of anything at all.

3 more...