Language modeling

Language modeling is the task of predicting the next word or character in a document.

Model	Paper / Source	Code
Zen 2.0: Continue training and adaption for n-gram enhanced text encoders	ZEN	Official
hULMonA: The Universal Language Model in Arabic	hULMonA	Official
AraBERT: Transformer-based Model for Arabic Language Understanding	AraBERT	Official