AI software progress is about reducing the training compute you need to get to the same level of capability, through better algorithms or data.
Software progress redefined
Most think software progress = better algorithms, but author says it's about reducing compute needed through better algorithms OR data.