A distributed crawling framework. - View it on GitHub