7 Matching Annotations
  1. Oct 2023
  2. arxiv.org arxiv.org
    RoBERTa: A Robustly Optimized BERT Pretraining Approach
    1
    1. mark.crowley 25 Oct 2023

      Introduction of the RoBERTa improved analysis and training approach to BERT NLP models.

      large-language-models nlp transformers rdgrp-s23 reading_group_crowley
    Visit annotations in context

    Tags

    Annotators

    URL

    arxiv.org/pdf/1907.11692
  3. cdn.openai.com cdn.openai.com
    Language Models are Unsupervised Multitask Learners
    1
    1. mark.crowley 25 Oct 2023

      GPT-2 Introduction paper

      Language Models are Unsupervised Multitask Learners A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, and I. Sutskever, (2019).

      large-language-models nlp machine-learning transformers gpt reading_group_crowley rdgrp-s23
    Visit annotations in context

    Tags

    Annotators

    URL

    cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
  4. arxiv.org arxiv.org
    1706.03762.pdf
    1
    1. mark.crowley 25 Oct 2023

      "Attention is All You Need" Foundational paper introducing the Transformer Architecture.

      transformers reading_group_crowley rdgrp-s23 large-language-models nlp
    Visit annotations in context

    Tags

    Annotators

    URL

    arxiv.org/pdf/1706.03762
  5. papers.nips.cc papers.nips.cc
    NeurIPS-2020-language-models-are-few-shot-learners-Paper.pdf
    1
    1. mark.crowley 25 Oct 2023

      GPT-3 introduction paper

      large-language-models nlp machine-learning transformers gpt reading_group_crowley rdgrp-s23
    Visit annotations in context

    Tags

    Annotators

    URL

    papers.nips.cc/paper_files/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf
  6. arxiv.org arxiv.org
    2105.03322.pdf
    1
    1. mark.crowley 25 Oct 2023

      "Are Pre-trained Convolutions Better than Pre-trained Transformers?"

      transformers deep-learning nlp large-language-models reading_group_crowley rdgrp-s23
    Visit annotations in context

    Tags

    Annotators

    URL

    arxiv.org/pdf/2105.03322.pdf
  7. arxiv.org arxiv.org
    2201.08239.pdf
    1
    1. mark.crowley 25 Oct 2023
      LaMDA: Language Models for Dialog Application

      "LaMDA: Language Models for Dialog Application" Meta's introduction of LaMDA v1 Large Language Model.

      transformers reading_group_crowley rdgrp-s23 large-language-models nlp
    Visit annotations in context

    Tags

    Annotators

    URL

    arxiv.org/pdf/2201.08239.pdf
  8. osf.io osf.io
    Attention Mechanism, Transformers, BERT, and GPT: Tutorial and Survey
    1
    1. mark.crowley 25 Oct 2023

      Benyamin GhojoghAli Ghodsi. "Attention Mechanism, Transformers, BERT, and GPT: Tutorial and Survey"

      reading_group_crowley transformers reading_group_crowley rdgrp-s23 nlp large-language-models
    Visit annotations in context

    Tags

    Annotators

    URL

    osf.io/m6gcn/