2 Matching Annotations
  1. Last 7 days
    1. This progress is not the result of a concerted effort to improve the robotics capabilities of our models. These improvements, like so many others in the history of LLM development, have emerged from much more general scaling.

      大多数人认为AI在特定领域的进步需要针对性的优化和训练,但作者认为AI在机器人领域的进步主要来自于通用规模的扩大,而非专门针对机器人能力的改进。这与传统的AI发展理念相悖,暗示了AI能力可能具有不可预测的涌现特性。

  2. Dec 2022
    1. Emergent abilities are not present in small models but can be observed in large models.

      Here’s a lovely blog by Jason Wei that pulls together 137 examples of ’emergent abilities of large language models’. Emergence is a phenomenon seen in contemporary AI research, where a model will be really bad at a task at smaller scales, then go through some discontinuous change which leads to significantly improved performance.