7 Matching Annotations
  1. Feb 2023
    1. Wordcraft Writers Workshop by Andy Coenen - PAIR, Daphne Ippolito - Brain Research Ann Yuan - PAIR, Sehmon Burnam - Magenta

      cross reference: ChatGPT

    2. LaMDA was not designed as a writing tool. LaMDA was explicitly trained to respond safely and sensibly to whomever it’s engaging with.
    3. LaMDA's safety features could also be limiting: Michelle Taransky found that "the software seemed very reluctant to generate people doing mean things". Models that generate toxic content are highly undesirable, but a literary world where no character is ever mean is unlikely to be interesting.
    4. language models are incredible "yes, and" machines, allowing writers to quickly explore seemingly unlimited variations on their ideas.
    5. For instance, if the user selects a phrase, a button to "Rewrite this phrase" is revealed along with a text input in which the user can describe how they would like the phrase to be rewritten. The user might type "to be funnier" or "to be more melancholy", and the Wordcraft application uses LaMDA and in-context learning to perform the task.
    6. The application is powered by LaMDA, one of the latest generation of large language models. At its core, LaMDA is a simple machine — it's trained to predict the most likely next word given a textual prompt. But because the model is so large and has been trained on a massive amount of text, it's able to learn higher-level concepts.

      Is LaMDA really able to "learn higher-level concepts" or is it just a large, straight-forward information theoretic-based prediction engine?

  2. Apr 2021
    1. dsDNA substrate is best for insertions or deletions greater than approximately 20 nucleotides, while ssDNA substrate is best for point mutations or changes of only a few base pairs.