A worker that will consume GOV.UK URLs from a message queue and crawl them, saving the output to disk - View it on GitHub