I'm starting to see articles written by folks much smarter than me (folks with lots of letters after their names) that warn about AI models that train on internet content. Some experiments with them have shown that if you continue to train them on AI-generated content, they begin to degrade quickly. I don't understand how or why this happens, but it reminds me of the degradation of quality you get when you repeatedly scan / FAX an image. So it sounds like one possible dystopian future (of many) is an internet full of incomprehensible AI word salad content.
It's like AI inbreeding. Flaws will be amplified over time unless new material is added
It would be a fun experiment to fill a lemmy instance with bots, defederate it from everybody then check back in 2 years. A cordonned off Alabama for AI if you will.
Thanks, now I am just imagining all that code getting it on with a whole bunch of other code. ASCII all over the place.
Oh yeah baby. Let's fork all day and make a bunch of child processes!
I'm starting to see articles written by folks much smarter than me (folks with lots of letters after their names) that warn about AI models that train on internet content. Some experiments with them have shown that if you continue to train them on AI-generated content, they begin to degrade quickly. I don't understand how or why this happens, but it reminds me of the degradation of quality you get when you repeatedly scan / FAX an image. So it sounds like one possible dystopian future (of many) is an internet full of incomprehensible AI word salad content.
It's like AI inbreeding. Flaws will be amplified over time unless new material is added
It would be a fun experiment to fill a lemmy instance with bots, defederate it from everybody then check back in 2 years. A cordonned off Alabama for AI if you will.
Thanks, now I am just imagining all that code getting it on with a whole bunch of other code. ASCII all over the place.
Oh yeah baby. Let's fork all day and make a bunch of child processes!
It's knownas model collapse.