Distributed crawler, database and web frontend for public directories indexing - View it on GitHub