Pulsar is an advanced web crawler and Web mining framework. Highly modularized, pluggable components, full ajax support, various storage backend. - View it on GitHub