Cross-platform persistent and distributed web crawler :link: - View it on GitHub