indiscriminate use of model-generated content in training causes irreversible defects in the resulting models, in which tails of the original content distribution disappear. We refer to this effect as ‘model collapse’
Fascinating to note the response that is invoked here - a sort of coprophagic disgust.