User-agent: Adsbot-Google Disallow: User-agent: Googlebot Disallow: User-agent: duggmirror Disallow: / User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /wp-content/themes/ Disallow: /wp-login.php Disallow: /wp-register.php Disallow: /trackback Disallow: /feed Disallow: /comments Disallow: */trackback Disallow: /wp-content/ Disallow: */feed Disallow: */comments Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.php$ Disallow: /*?* Disallow: /*? Disallow: /wp-* Disallow: /2009/ Disallow: /20010/ Disallow: /?powerpress_pinw= Allow: /wp-content/uploads # allow the medapartners google bot to determine adsense content User-agent: Mediapartners-Google Allow: / # allow google to crawl all pages to measure page quality for AdWords User-agent: Adsbot-Google Allow: / # allow the Google image crawler to crawl all pages User-agent: Googlebot-Image Allow: / # allow the Google bot to craw all pages for its mobile index User-agent: Googlebot-Mobile Allow: /