Language model pretraining
4 methods in the atlas attack this one problem. They are rivals: each wins something the others do not.
Phrasings that mean this problem
Language understandingLanguage generationStatistical language modeling
deep-learning
- BERTMasked language modelingcanondeep-learning
- GPTAutoregressive pretrainingcanondeep-learning
information-retrieval-nlp
- N-gram language modelKneser-Ney smoothingstandardinformation-retrieval-nlp
- N-gram language modelGood-Turing smoothingspecialistinformation-retrieval-nlp