23 Matching Annotations
  1. Last 7 days
    1. Including a prompt prefix in the chain-of-thought style encourages the model to generatefollow-on sequences in the same style, which isto say comprising a series of explicit reasoningsteps that lead to the final answer. This abilityto learn a general pattern from a few examples ina prompt prefix, and to complete sequences in away that conforms to that pattern, is sometimescalled in-context learning or few-shot prompt-ing. Chain-of-thought prompting showcases thisemergent property of large language model at itsmost striking.

      Emulating deductive reasoning with prompt engineering

      I think "emulating deductive reasoning" is the correct shorthand here.

    2. Dialogue is just one application of LLMs thatcan be facilitated by the judicious use of promptprefixes. In a similar way, LLMs can be adaptedto perform numerous tasks without further train-ing (Brown et al., 2020). This has led to a wholenew category of AI research, namely prompt en-gineering, which will remain relevant until wehave better models of the relationship betweenwhat we say and what we want.

      Prompt engineering

    3. In the background, the LLM is invisiblyprompted with a prefix along the following lines.

      Pre-work to make the LLM conversational

  2. Dec 2022
    1. If my interpretation of the Retrieval quadrant is correct, it will become much more difficult to be an average, or even above average, writer. Only the best will flourish. Perhaps we will see a rise in neo-generalists.

      This is probably true of average or poor software engineers given that GPT-3 can produce pretty reasonable code snippets

  3. Nov 2022
    1. partnerships, networking, and revenue generation such as donations, memberships, pay what you want, and crowdfunding

      I have thought long about the same issue and beyond. The triple (wiki, Hypothesis, donations) could be a working way to search for OER, form a social group processing them, and optionally support the creators.

      I imagine that as follows: a person wants to learn about X. They can head to the wiki site about X and look into its Hypothesis annotations, where relevant OER with their preferred donation method can be linked. Also, study groups interested in the respective resource or topic can list virtual or live meetups there. The date of the meetups could be listed in a format that Hypothesis could search and display on a calendar.

      Wiki is integral as it categorizes knowledge, is comprehensive, and strives to address biases. Hypothesis stitches websites together for the benefit of the site owners and the collective wisdom that emerges from the discussions. Donations support the creators so they can dedicate their time to creating high-quality resources.

      Main inspirations:

      Deschooling Society - Learning Webs

      Building the Global Knowledge Graph

      Schoolhouse calendar

    1. Misleading Templates There is no consistent re-lation between the performance of models trainedwith templates that are moderately misleading (e.g.{premise} Can that be paraphrasedas "{hypothesis}"?) vs. templates that areextremely misleading (e.g., {premise} Isthis a sports news? {hypothesis}).T0 (both 3B and 11B) perform better givenmisleading-moderate (Figure 3), ALBERT andT5 3B perform better given misleading-extreme(Appendices E and G.4), whereas T5 11B andGPT-3 perform comparably on both sets (Figure 2;also see Table 2 for a summary of statisticalsignificances.) Despite a lack of pattern between

      Their misleading templates really are misleading

      {premise} Can that be paraphrased as "{hypothesis}"

      {premise} Is this a sports news? {hypothesis}

    2. Insum, notwithstanding prompt-based models’impressive improvement, we find evidence ofserious limitations that question the degree towhich such improvement is derived from mod-els understanding task instructions in waysanalogous to humans’ use of task instructions.

      although prompts seem to help NLP models improve their performance, the authors find that this performance is still present even when prompts are deliberately misleading which is a bit weird

    3. Suppose a human is given two sentences: “Noweapons of mass destruction found in Iraq yet.”and “Weapons of mass destruction found in Iraq.”They are then asked to respond 0 or 1 and receive areward if they are correct. In this setup, they wouldlikely need a large number of trials and errors be-fore figuring out what they are really being re-warded to do. This setup is akin to the pretrain-and-fine-tune setup which has dominated NLP in recentyears, in which models are asked to classify a sen-tence representation (e.g., a CLS token) into some

      This is a really excellent illustration of the difference in paradigm between "normal" text model fine tuning and prompt-based modelling

    1. Antibiotic resistance has become a growingworldwide concern as new resistance mech-anisms are emerging and spreading globally,and thus detecting and collecting the cause– Antibiotic Resistance Genes (ARGs), havebeen more critical than ever. In this work,we aim to automate the curation of ARGs byextracting ARG-related assertive statementsfrom scientific papers. To support the researchtowards this direction, we build SCIARG, anew benchmark dataset containing 2,000 man-ually annotated statements as the evaluationset and 12,516 silver-standard training state-ments that are automatically created from sci-entific papers by a set of rules. To set upthe baseline performance on SCIARG, weexploit three state-of-the-art neural architec-tures based on pre-trained language modelsand prompt tuning, and further ensemble themto attain the highest 77.0% F-score. To the bestof our knowledge, we are the first to leveragenatural language processing techniques to cu-rate all validated ARGs from scientific papers.Both the code and data are publicly availableat https://github.com/VT-NLP/SciARG.

      The authors use prompt training on LLMs to build a classifier that can identify statements that describe whether or not micro-organisms have antibiotic resistant genes in scientific papers.

  4. Sep 2022
  5. Jun 2022
    1. https://www.youtube.com/watch?v=awce_j2myQw

      Francis Ford Coppola talks about his notes and notebook on The Godfather.

      He went to the Cafe Trieste to work.

      Coppola had an Olivetti typewriter. (4:20)

      Sections on pitfalls

      I didn't need a script cause I could have made the movie just from this notebook.

    1. Now he’s giving the public a peek into that creative process with The Godfather Notebook (Regan Arts, Nov. 15, $50), an exact reproduction of his original, right down to the handwriting, plus rarely seen photos. A signed $500 limited edition even comes in a replica three-ring binder.

      Francis Ford Coppola published an exact reproduction of his original prompt book for The Godfather called The Godfather Notebook (Regan Arts, 2016).

    2. To organize his thoughts, Coppola made a “prompt book,” a theater trick he learned in college at Hofstra. Into a three-ring binder he stuffed his annotated copy of the novel, scene-by-scene breakdowns, notes on the times and setting, cliches to avoid and casting ideas.

      Francis Ford Coppola created and used a prompt book to organize his notes and annotations on Mario Puzo's The Godfather to create the 1972 Paramount blockbuster.

      Having learned the stage managers' technique of keeping a prompt book at Hofstra, his contained an annotated copy of the novel with scene-by-scene breakdowns, notes on setting, cliches to avoid, and even casting ideas.

    1. a short documentary titled Francis Coppola’s Notebook3released in 2001, Coppola explained his process.

      I've seen a short snippet of this, but I suspect it's longer and has more depth.

      The citation of this documentary here via IMDb.com is just lame. Cite the actual movie and details for finding and watching it please.

      Apparently the entirety of the piece is just the 10 minutes I saw.

    2. Coppola’s strategy for making the complex, multifaceted filmrested on a technique he learned studying theater at HofstraCollege, known as a “prompt book.”
  6. Mar 2021
  7. Jan 2021
  8. Nov 2020
  9. Apr 2019