# Robots.txt for http://www.gazpacho.net User-agent: * Disallow: /webstart Disallow: /*? Allow: / User-agent: Slurp Disallow: / User-agent: Spinn3r Disallow: / User-agent: KSCrawler Disallow: / Sitemap: http://www.gazpacho.net/sitemap.xml