Language modeling

July 18, 2022 ยท View on GitHub

Language modeling is the task of predicting the next word or character in a document.

ModelPaper / SourceCode
Zen 2.0: Continue training and adaption for n-gram enhanced text encodersZENOfficial
hULMonA: The Universal Language Model in ArabichULMonAOfficial
AraBERT: Transformer-based Model for Arabic Language UnderstandingAraBERTOfficial