Model Collapse¶

(A.k.a. “AI inbreeding”... 😬)

Shumailov et al., “The Curse of Recursion”:

The web is filling with AI-generated content.
Future models are trained on the output of current models.
The Result: Model Collapse. The variance of the model disappears; it loses touch with reality and becomes “dumber.”

Security Context: This is a long-term Data Supply Chain vulnerability. If we build security tools (e.g., Malware classifiers) on future datasets, they may be trained on “synthetic garbage,” rendering them ineffective.