4 Matching Annotations
  1. Jun 2026
    1. Claude did all of this with pretty minimal help from me over the course of 1-2 days. I think if [a junior colleague] came back to me with results like this in the same span of time, I would be mildly impressed. The future is now.

      研究者说mildly impressed——不是震惊,是温和地印象深刻。这意味着Claude的表现已经进入正常聪明同事的参照系,而不再是「AI做到了这个!」的惊叹系。当前沿AI研究者用评价初级同事的标准来评价AI的工作产出,某种意义上这才是真正的图灵时刻——不是测试过了,而是基准系统已经悄悄切换了。

    2. Claude did all of this with pretty minimal help from me over the course of 1-2 days. I think if [a junior colleague] came back to me with results like this in the same span of time, I would be mildly impressed. The future is now.

      这个评价耐人寻味。研究者说mildly impressed——不是震惊,是温和地印象深刻。这意味着Claude的表现已经进入「正常聪明同事」的参照系,而不再是「AI做到了这个!」的惊叹系。当前沿AI研究者用评价初级同事的标准来评价AI的工作产出,某种意义上这才是真正的图灵时刻——不是测试过了,而是基准系统已经悄悄切换了。

    1. convergence does not occur at the level of source code, indicating that what converges is function rather than implementation

      表现型(行为)收敛,基因型(代码)不收敛——这个区分极为精妙。不同的代码实现了相同的功能,就像蜘螃和蛇各自独立演化出毒液但分子机制完全不同。对大模型研究的类比:不同架构、不同训练数据的模型可能在能力层面收敛,而在「实现层」保持多样性。评估 AI 能力时,只看代码/权重是不够的,必须看行为。

  2. Apr 2026
    1. New Anthropic Fellows Research: a new method for surfacing behavioral differences between AI models.

      令人惊讶的是,Anthropic将软件开发中的'差异比较(diff)'概念首次系统性地应用于AI模型行为分析,这标志着AI评估方法的重要转变。这种跨领域的技术迁移为开源模型比较提供了全新视角,可能彻底改变我们对AI模型间细微差异的理解方式。