Unigram language model tokenizer

Pairings in the atlas

EM subword pruningspecialistSubword tokenization information-retrieval-nlp

Rivals: other methods for the same problems

Where it sits

information-retrieval-nlp · Databases & Information Retrieval