Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc. - View it on GitHub