1 Matching Annotations
  1. Aug 2022
    1. When I’ve been doing this with GPT-3, a 175 billion parameter language model, it has been uncanny how much it reminds me of blogging

      This is intriguing, seeing a similar return on prompting GPT-3 as from blogging. After reading this essay the first time, I played with GPT-3 myself, and even from a first attempt it is clear what he means. It feels like a similar process, prompting GPT-3 and pushing a notion, bookmark or question into my blog's feed. The first reactions on both types bring similar levels of surprial. What is however missing from GPT-3 in comparison with my blog is that blog networks are more than a 1-on-1 prompt and respons. They form larger feedback loops, which in turn lifts signals above the noise.