Text preprocessing and normalization
7 methods in the atlas attack this one problem. They are rivals: each wins something the others do not.
Phrasings that mean this problem
Word normalizationText preprocessingText normalizationLanguage detection
nlp-tasks
- Porter stemmerSuffix-stripping rulescanonnlp-tasks
- Snowball stemmerstandalonestandardnlp-tasks
- LemmatizationDictionary plus morphologystandardnlp-tasks
- Language identificationCharacter n-gram profilesstandardnlp-tasks
- Language identificationNaive Bayes over byte n-gramsspecialistnlp-tasks
- Sentence segmentationPunctuation-plus-abbreviation rulescanonnlp-tasks
- Truecasingstandalonespecialistnlp-tasks