Papers on Language

• This repo was long due which consists all my re-implementations of various papers in Natural Language Processing that I read during the last few years.

• All papers follow this structure:

  • Paper Name
    • Original Paper
    • Code Reimplementation: Using PyTorch

• This repo will be updated once every month.

Papers List

• 2017

  • 04.Attention Is All You Need : Paper || Code || Summary

• 2019

  • 02.BERT-Pre-training of Deep Bidirectional Transformers for Language Understanding : Paper || Code || Summary
  • 03.DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter : Paper || Code || Summary

• 2021

  • 01.An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale : Paper || Code || Summary