A scalable frontier for web crawlers - View it on GitHub