AI model output quality decreases when trained with AI models

shanghaibebop@beehaw.org to Technology@beehaw.org – 91 points –
AI Loses Its Mind After Being Trained on AI-Generated Data
futurism.com

"Our primary conclusion across all scenarios is that without enough fresh real data in each generation of an autophagous loop, future generative models are doomed to have their quality (precision) or diversity (recall) progressively decrease," they added. "We term this condition Model Autophagy Disorder (MAD)."

Interestingly, this might be a more challenging problem as we increase the use of generative AI models online.

57

You are viewing a single comment

Wow. How is this going to affect all the projects that fine-tune Meta's Llama model with synthetic training data?

2 more...