User-agent: * Disallow: /img/ Disallow: /photo/ Crawl-delay: 600 User-Agent: Yahoo! Slurp Disallow: / User-Agent: ia_archiver Disallow: / User-Agent: fast Disallow: / User-Agent: ZyBorg Disallow: / User-Agent: ArchitextSpider Disallow: / User-agent: DiaGem Disallow: / User-agent: SlySearch Disallow: / User-Agent: Cowbot* Disallow: / User-Agent: NaverBot* Disallow: / User-Agent: sitecheck.internetseer.com Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-Agent: Openbot Disallow: / User-agent: mogimogi Disallow: / User-agent: Hatena Antenna Disallow: /diary/