User-agent: * Disallow: /stats/ Disallow: /pa-nj/ Crawl-delay: 25 # slow down Yahoo User-agent: Slurp Crawl-delay: 50 # blocks access to the whole site User-agent: YandexDisallow: / User-agent: moget User-agent: ichiro Disallow: / User-agent: NaverBot User-agent: Yeti Disallow: / User-agent: Baiduspider User-agent: Baiduspider-video User-agent: Baiduspider-image Disallow: / User-agent: sogou spider Disallow: / User-agent: YoudaoBot Disallow: / #WP Import Export Rule User-agent: * Disallow: /wp-content/uploads/wp-import-export-lite/