# /robots.txt file for http://grandriver.ca/ # mail webmaster@grandriver.ca for details #modifed by Mark & George 4:24 pm October 27th, 2006 to allow only certain bots #modifed by Phil 3:06 pm July 2nd, 2008 to disallow /Members User-agent: * Disallow: / User-agent: Googlebot Disallow: /CorporateStyleSheets Disallow: /Images Disallow: /bad-bots Disallow: /search Disallow: /datadissemination Disallow: /Members User-agent: Googlebot-Mobile Disallow: /CorporateStyleSheets Disallow: /Images Disallow: /bad-bots Disallow: /search Disallow: /datadissemination Disallow: /Members User-agent: Googlebot-Image Disallow: /CorporateStyleSheets Disallow: /bad-bots Disallow: /search Disallow: /datadissemination Disallow: /Members User-agent: msnbot Disallow: /CorporateStyleSheets Disallow: /Images Disallow: /bad-bots Disallow: /search Disallow: /datadissemination Disallow: /Members User-agent: Slurp Crawl-delay: 10 Disallow: /CorporateStyleSheets Disallow: /Images Disallow: /bad-bots Disallow: /search Disallow: /datadissemination Disallow: /Members