Example of how to process 500K items respecting rate limit of external APIs - View it on GitHub