Redis-based components for scrapy that allows distributed crawling - View it on GitHub