Hypothesis

2 Matching Annotations

Apr 2023
www.semanticscholar.org www.semanticscholar.org

[PDF] What Can Transformers Learn In-Context? A Case Study of Simple Function Classes | Semantic Scholar

2
1. mshook 01 Apr 2023
  
  in Public
  
  We use a decoder-only Transformer architecture [Vaswani et al., 2017] from the GPT-2family
  
  gpt2 gpt transformer
2. mshook 01 Apr 2023
  
  in Public
  
  a random function f
  
  a random function not many or several
  
  icl transformer gpt2 gpt function
Visit annotations in context

Tags

transformer

gpt

icl

function

gpt2

Annotators

mshook

URL

semanticscholar.org/reader/de32da8f5c6a50a6c311e9357ba16aa7d05a1bc9