A lightweight distributed web crawler - View it on GitHub