Papers

Influential Papers in the field of Natural Language Processing in the last few years.

  1. 2017 June - Transformer: Attention is All You Need [arxiv]
  2. 2018 June - GPT: Improving Language Understanding by Generative Pre-Training [link]
  3. 2018 Oct - BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding [arxiv]
  4. 2019 Feb - GPT-2: Language Models are Unsupervised Multitask Learners [link]
  5. 2020 May - GPT-3: Language Models are Few-Shot Learners - [arxiv]
  6. 2022 March - InstructGPT: Training Language Models to Follow Instructions with Human Feedback [arxiv]
← Neural Networks
Attention is All You Need (2017) →