A SQLite extension for parsing robots.txt files - View it on GitHub