# robots.txt - http://www.agri-tourisme.org User-agent: msnbot Crawl-delay: 15 User-agent: slurp Crawl-delay: 10 User-agent: * Disallow: /webalizer/