Makes sense. AAVE is mostly a spoken thing, LLMs are mostly trained on the corpus of written text on the internet and in books. It's pretty rare for people to write in an AAVE style in those contexts.
Except it has no difficulty reading and understanding AAVE, because people use it online frequently...
Like, the article makes that abundantly clear, but everyone commenting just read the headline and assumed what it meant was it couldn't understand it...
I never said it can't understand it. I am agreeing with the notion that it has a bias against using it.
Yet another case of: garbage in - garbage out.
They can't possibly encounter much of it in training material... Of course they're not going to like it.
What?
It trains off social media, and even white kids use AAVE online. And kids make the most social media comments.
A lot of times when someone posts a text screenshot and everyone talks about how kids talk crazy, it's just a patois of AAEV mixed in with "regular" English.
It should be able to "read" it fine.
The bias part (as clearly stated in the article...) is when you ask a LLM to describe the person who would phrase something in AAVE, and the LLM replies back with stereotypes about Black people.
So it can read and interpret it fine, it just has a bias against people who talk like that
LLM’s don’t have a bias against anyone, it’s literally just data. And those models are by and large fed with traditionally grammatically correct data. They don’t understand dialects, you’re looking soooooo hard for something to be offended over
If you're going to revive a 3+ day old thread...
At least read the article first so you have a clue what other people were talking about
Is this the new term for ebonics and is ebonics offensive now or inappropriate?
Essentially, yes. Ebonics isn’t inherently offensive or inappropriate, as far as I can tell, but it has connotations that are not attached to AAE. Linguists avoid the term today, and modern uses of it tend to be derogatory.
So for those that didn't read the article, it basically explains how LLMs have a negative connotation about AAE. When asked to associate words with AAE written phrases, it used words like "aggressive". When given a normal English phrase and the same phrase but in AAE and then asked what jobs would suit this person, the LLM gave low income jobs for the AAE statement with broader options for the normal English one.
It's a serious problem because people that naturally write in AAE are most likely getting worse results. It stems mostly from old rascist newspaper articles and similar things.
It's a serious problem because people that naturally write in AAE are most likely getting worse results
Person using LLM built on grammatical rules of the English language has subpar results when operating outside of those rules. More at 6.
African Americans have a weak bias against writing in African American English -> Colleges have weak bias against accepting African Americans as graduate students -> Academic text have strong bias for text written by graduate students -> LLM training data has bias for academic texts -> LLMs have a strong bias for writing like training data.
The error occurs upstream a bit, don't point at the coders.
Writing in AAVE is silly, just like someone from the Deep South including southern drawl in their writing would be, or someone from Boston spelling “car keys” as “kha kees”
So
African Americans have a weak bias against writing in African American English -> Colleges have weak bias against accepting African Americans as graduate students
Is a bit of a jump. Someone writing in AAVE probably wouldn’t get accepted to college, because written word is supposed to transcend dialects and follow a set of rules to be universally understandable.
I'm not from USA, black, nor a native English speaker, but due to Linguistics I can give you guys some further info.
AAE (Afro-American English), in a nutshell, is a group of English varieties used by some speakers from USA and Canada. In a lot of aspects they resemble geographical varieties, like the ones you'd see in plenty other languages, but there's a key difference: it isn't used by people "of a certain region", but rather by people "of a certain race" (black people).
This is mostly but not completely spoken (cue to the term AAVE - the "V" stands for "vernacular"); it affects also the way that those people use the written language. So often you see AAE features in written English, like:
Negative concord - for example, "I don't want to hear nothing about this shit, man."
Habitual-be - for example, "They be talking about this everyday."
bits of non-standard spelling, due to phonetic differences
expressions and vocab typically used primarily by black people
What the article is saying is that LLMs are biased against those features. It's a rather strong bias, and not noticed for a geographical variety used as reference (Appalachian English). In other words: the LLM has been fed racist babble, and now it's regurgitating it.
Since they’re vernacular you’ll mostly hear them being spoken, they aren’t really written
AAVE is commonly "written" now because most writing is texts and social media comments. So even if they luck out and learn "proper" English, people still going to type on their phones the same way they talk.
Even for white kids, most of Gen Z slang is just taken from AAVE, when older people complaining about not being able to read zoomer slang from text or comments, it's just heavily influenced by AAVE.
There's been bleed over for centuries, but with the Internet and social media it's merging faster, which is common for dialects of people that interact frequently
Warning: I've edited the comment that you're replying to. I'm saying this for the sake of transparency, as you're clearly quoting the earlier version.
The key here is that AAVE is not written, but AAE is. That "V" is for vernacular, it excludes written English by definition.
Now, I'm not sure if those white kids are using AAE or simply borrowing things from AAE into their written English. I simply don't have data on that.
There’s been bleed over for centuries, but with the Internet and social media it’s merging faster, which is common for dialects of people that interact frequently
Varieties merging or splitting is rarely the result of just more contact between people; it's all about identity. If things are happening as you described them, it's simply that those white kids stopped seeing black people as "the others", to see them as "part of the same group as us".
That “V” is for vernacular, it excludes written English by definition.
Yeah. But most people "write" online like they speak...
If people followed rules about language, yeah, vernacular would just be spoken speech. But that's not how it works. The rules are made to reflect what people are doing. The rules don't control what people do.
So yes, while the word vernacular commonly meant only spoken words, there ain't nothing stopping nobody from typing like they speak.
And people been doing it for a long time
Yeah. But most people “write” online like they speak…
That's a common misconception.
While your written and spoken varieties do interact a fair bit, no, people don't "write like they speak". Not even online.
And that is not simply an "ackshyually". A lot of AAVE features simply don't transpose into writing - like prosody, non-rhoticity, /ɪ/-breaking, /äɪ/-monophtongisation... at most you can consciously approximate them into writing, but they won't be there.
If people followed rules about language, yeah, vernacular would just be spoken speech. But that’s not how it works. The rules are made to reflect what people are doing.
That is not about people following/not following "rules", it's about nomenclature - it's exactly the reason why "AAE" and "AAVE" are necessary as separated terms.
More and more people are using speech to text. And it does show how differently people speak than write (apparently I never say my be in because, for example).
But it also means that llms aren't only being fed text, but also speech converted into text.
Because there is no such thing as "African American English". There is proper English and then there is slang.
Never heard of AAVE? There isn’t one immutable version of English
Color or colour? Truck or lorry? Cookie or biscuit?Which one is "proper"?
Lmao get out you weird bigot
Slang is slang. It's always used verbally. I am not sure why someone would expect a llm to generate proper slang. Not sure at all how stating that fact makes one a "bigot".
What you call "proper English" (or "proper" any other language) is merely an arbitrary construct. It is not set on stone.
That applies to all levels of a language, by the way, not just vocabulary ("slang").
Who speaks proper English?
It's bad enough the American's are too stupid to use the proper one that we have to have two.
But people talking incorrectly is not a reason to write like that. Unless it's a character speaking or whatever.
Makes sense. AAVE is mostly a spoken thing, LLMs are mostly trained on the corpus of written text on the internet and in books. It's pretty rare for people to write in an AAVE style in those contexts.
Except it has no difficulty reading and understanding AAVE, because people use it online frequently...
Like, the article makes that abundantly clear, but everyone commenting just read the headline and assumed what it meant was it couldn't understand it...
I never said it can't understand it. I am agreeing with the notion that it has a bias against using it.
Yet another case of: garbage in - garbage out.
They can't possibly encounter much of it in training material... Of course they're not going to like it.
What?
It trains off social media, and even white kids use AAVE online. And kids make the most social media comments.
A lot of times when someone posts a text screenshot and everyone talks about how kids talk crazy, it's just a patois of AAEV mixed in with "regular" English.
It should be able to "read" it fine.
The bias part (as clearly stated in the article...) is when you ask a LLM to describe the person who would phrase something in AAVE, and the LLM replies back with stereotypes about Black people.
So it can read and interpret it fine, it just has a bias against people who talk like that
LLM’s don’t have a bias against anyone, it’s literally just data. And those models are by and large fed with traditionally grammatically correct data. They don’t understand dialects, you’re looking soooooo hard for something to be offended over
If you're going to revive a 3+ day old thread...
At least read the article first so you have a clue what other people were talking about
Is this the new term for ebonics and is ebonics offensive now or inappropriate?
Essentially, yes. Ebonics isn’t inherently offensive or inappropriate, as far as I can tell, but it has connotations that are not attached to AAE. Linguists avoid the term today, and modern uses of it tend to be derogatory.
Source
So for those that didn't read the article, it basically explains how LLMs have a negative connotation about AAE. When asked to associate words with AAE written phrases, it used words like "aggressive". When given a normal English phrase and the same phrase but in AAE and then asked what jobs would suit this person, the LLM gave low income jobs for the AAE statement with broader options for the normal English one.
It's a serious problem because people that naturally write in AAE are most likely getting worse results. It stems mostly from old rascist newspaper articles and similar things.
Person using LLM built on grammatical rules of the English language has subpar results when operating outside of those rules. More at 6.
African Americans have a weak bias against writing in African American English -> Colleges have weak bias against accepting African Americans as graduate students -> Academic text have strong bias for text written by graduate students -> LLM training data has bias for academic texts -> LLMs have a strong bias for writing like training data.
The error occurs upstream a bit, don't point at the coders.
Writing in AAVE is silly, just like someone from the Deep South including southern drawl in their writing would be, or someone from Boston spelling “car keys” as “kha kees”
So
Is a bit of a jump. Someone writing in AAVE probably wouldn’t get accepted to college, because written word is supposed to transcend dialects and follow a set of rules to be universally understandable.
I'm not from USA, black, nor a native English speaker, but due to Linguistics I can give you guys some further info.
AAE (Afro-American English), in a nutshell, is a group of English varieties used by some speakers from USA and Canada. In a lot of aspects they resemble geographical varieties, like the ones you'd see in plenty other languages, but there's a key difference: it isn't used by people "of a certain region", but rather by people "of a certain race" (black people).
This is mostly but not completely spoken (cue to the term AAVE - the "V" stands for "vernacular"); it affects also the way that those people use the written language. So often you see AAE features in written English, like:
What the article is saying is that LLMs are biased against those features. It's a rather strong bias, and not noticed for a geographical variety used as reference (Appalachian English). In other words: the LLM has been fed racist babble, and now it's regurgitating it.
AAVE is commonly "written" now because most writing is texts and social media comments. So even if they luck out and learn "proper" English, people still going to type on their phones the same way they talk.
Even for white kids, most of Gen Z slang is just taken from AAVE, when older people complaining about not being able to read zoomer slang from text or comments, it's just heavily influenced by AAVE.
There's been bleed over for centuries, but with the Internet and social media it's merging faster, which is common for dialects of people that interact frequently
Warning: I've edited the comment that you're replying to. I'm saying this for the sake of transparency, as you're clearly quoting the earlier version.
The key here is that AAVE is not written, but AAE is. That "V" is for vernacular, it excludes written English by definition.
Now, I'm not sure if those white kids are using AAE or simply borrowing things from AAE into their written English. I simply don't have data on that.
Varieties merging or splitting is rarely the result of just more contact between people; it's all about identity. If things are happening as you described them, it's simply that those white kids stopped seeing black people as "the others", to see them as "part of the same group as us".
Yeah. But most people "write" online like they speak...
https://commonwealthtimes.org/2021/02/18/aave-is-not-your-internet-slang-it-is-black-culture/
If people followed rules about language, yeah, vernacular would just be spoken speech. But that's not how it works. The rules are made to reflect what people are doing. The rules don't control what people do.
So yes, while the word vernacular commonly meant only spoken words, there ain't nothing stopping nobody from typing like they speak.
And people been doing it for a long time
That's a common misconception.
While your written and spoken varieties do interact a fair bit, no, people don't "write like they speak". Not even online.
And that is not simply an "ackshyually". A lot of AAVE features simply don't transpose into writing - like prosody, non-rhoticity, /ɪ/-breaking, /äɪ/-monophtongisation... at most you can consciously approximate them into writing, but they won't be there.
That is not about people following/not following "rules", it's about nomenclature - it's exactly the reason why "AAE" and "AAVE" are necessary as separated terms.
More and more people are using speech to text. And it does show how differently people speak than write (apparently I never say my be in because, for example).
But it also means that llms aren't only being fed text, but also speech converted into text.
Because there is no such thing as "African American English". There is proper English and then there is slang.
Never heard of AAVE? There isn’t one immutable version of English
Color or colour? Truck or lorry? Cookie or biscuit?Which one is "proper"?
Lmao get out you weird bigot
Slang is slang. It's always used verbally. I am not sure why someone would expect a llm to generate proper slang. Not sure at all how stating that fact makes one a "bigot".
What you call "proper English" (or "proper" any other language) is merely an arbitrary construct. It is not set on stone.
That applies to all levels of a language, by the way, not just vocabulary ("slang").
Who speaks proper English?
It's bad enough the American's are too stupid to use the proper one that we have to have two.
But people talking incorrectly is not a reason to write like that. Unless it's a character speaking or whatever.