SOTA models of different architectures and parameter scales exhibit highly consistent failure patterns on the same set of hard samples, suggesting that the performance bottleneck stems from shared deficiencies in training data rather than architecture itself.
大多数人认为不同架构的模型会有不同的失败模式和弱点，但作者发现无论架构和参数规模如何，SOTA模型在相同困难样本上表现出高度一致的失败模式，这表明性能瓶颈源于训练数据的共同缺陷，而非架构差异，这一发现挑战了模型多样化的传统观点。
How do we engage in bottom-up whole system change? Perhaps we need a model for understanding who we are serving that transcends the bias and limitations of personas as they are used in user experience design (UX).
What is a more holistic model for understanding human perceptions, motivations, and behaviours?
The RAT model sees software development as an off-line program-construction activity composed of these parts: defining, decomposing, estimating, implementing, assembling, and finishing
This is what can lead to the 'there is only version 1.0' problem - and improvements / iterations fall to the sidelines.
This can have a number of consequences