Natural Language Processing (NLP) has made sizable advancements in current years, way to the improvement of modern language models consisting of Chat GPT and Google BERT. Both fashions are primarily based on transformer structure, which has revolutionized the sector of NLP.