1 Matching Annotations
  1. Jul 2024
    1. https://web.archive.org/web/20240712174702/https://www.hyperorg.com/blogger/2024/07/11/limiting-ais-imagination/ When 18m ago I played with the temperature (I don't remember how or what but it was an actual setting in the model, probably something from huggingface) what stood out for me was that at 0 it was immediately obvious it was automated, and it yielded the same answer to the same prompt repeatedly as it stuck to the likeliest outcome for each next token. At higher temps it would get wilder, and it struck me as easier to project a human having written it. Since then I almost regard the temp setting as the fakery/projectionlikelihood level. Although it doesn't take much to trigger projection, as per Eliza. l n:: temp v modellen maakt projecte mogelijk