PHP class for parse all directives from robots.txt files according to specifications - View it on GitHub