A tiny site demonstrating different ways to block search engine crawlers - View it on GitHub