Similarity sketching and near-duplicates
8 methods in the atlas attack this one problem. They are rivals: each wins something the others do not.
Phrasings that mean this problem
Set-similarity estimationNear-duplicate detectionRecord linkageJaccard similarity estimationFast similarity estimationApproximate similarity joinDocument deduplication
information-retrieval-nlp
- Shingling near-duplicateMinHash-LSHstandardinformation-retrieval-nlp
probabilistic-streaming
- MinHashBottom-k signaturescanonfull lesson ▸probabilistic-streaming
- One-permutation hashingDensificationspecialistprobabilistic-streaming
- SimHashRandom hyperplane signaturesstandardprobabilistic-streaming
- Locality-sensitive hashingBanding amplificationstandardprobabilistic-streaming