My version of Pytorch implementation for Hyundai Motor Group's 2022 AGG.
You can see the paper review on my blog draft.
Every part of the code was implemented by me.
AGG 2022: Rare Tokens Degenerate All Tokens:Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings Paper URL : https://arxiv.org/pdf/2109.03127.pdf