# Disallow all crawlers access to certain pages. User-agent: * Disallow: /Classes/ Disallow: /Inc/ Disallow: /bin/ Disallow: /imgs/ Sitemap: http://www.primehome.com/sitemap.xml User-agent: msnbot Crawl-delay: 10 User-agent: Teoma Crawl-delay: 10 User-agent: Slurp Crawl-delay: 10 User-agent: aipbot Disallow: / User-agent: BecomeBot Disallow: / User-agent: psbot Disallow: / User-agent: Speedy Spider Disallow: /