A scalable web crawler framework for Java. - View it on GitHub