A high-level distributed crawling framework. - View it on GitHub