NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider - View it on GitHub