Scrapy project to scrape public web directories (educational) [DEPRECATED] - View it on GitHub