Experimental results show the best model, Gemini3-pro, achieves 56.3% overall accuracy, which falls significantly to 23.0% on Level-3 tasks
大多数人认为当前最先进的多模态大模型已经接近或超越人类在复杂任务上的表现。然而，作者的数据表明，即使是最好的模型在复杂现实任务上的表现也远低于预期，准确率从整体56.3%骤降至23.0%。这一发现挑战了AI领域对当前技术能力的乐观评估，揭示了现实世界多模态代理任务的极端复杂性。
The AI is actually very good at this, especially if you have a conversation with it beforehand. That's what Ask mode is for.
主流观点认为AI工具主要适合生成代码或自动化简单任务，但作者认为AI在代码审查和架构讨论方面表现优异，前提是事先进行充分对话。这挑战了人们对AI能力的传统认知，暗示AI可以作为架构讨论的平等伙伴，而不仅仅是代码生成工具。
We estimate that as of the end of 2025, Chinese companies collectively own just over 5% of the cumulative computing power of the leading AI chips sold in recent years
考虑到中国AI产业的快速发展和政府对AI的大力投资，大多数人可能认为中国拥有更大比例的全球AI计算能力，但作者认为中国公司仅拥有约5%的全球AI计算能力。这一数字远低于人们的预期，挑战了关于中国AI技术实力的普遍认知。
The edge models feature a 128K context window, while the larger models offer up to 256K
大多数人认为边缘设备/移动设备上的AI模型功能受限，尤其是在处理长上下文方面。但作者声称即使在移动设备上，Gemma 4也能提供128K的上下文窗口，挑战了边缘AI能力有限的普遍认知。
be able to quick Master any domain write trillions lines of code and read every research paper in every scientific field ever written
for - AI evolution - projections for capabilities by 2030
AI evolution - projections for 2030 - AI will be able to do things we cannot even conceive of now because their cognitive capabilities are orders of magnitudes faster than our own - Write billions of lines of code - Absorb every scientific paper ever written and write new ones - Gain the equivalent of billions of human equivalent years of experience