# robots.txt optimized for Wordpress using a /[post-name] permalink structure User-agent: * Disallow: /cgi-bin Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/themes Disallow: /cache Disallow: /wp-login.php Disallow: /page/ Disallow: /photos/ Disallow: /feed/ Disallow: /comments/feed/ Disallow: /tag/ Disallow: /author/ Disallow: /category/ Disallow: */trackback Disallow: */feed Disallow: */comments Disallow: /*?* Disallow: /*? Disallow: /2000/ Disallow: /2001/ Disallow: /2002/ Disallow: /2003/ Disallow: /2004/ Disallow: /2005/ Disallow: /2006/ Disallow: /2007/ Disallow: /2008/ Disallow: /2009/ Disallow: /2010/ Disallow: /2011/ Disallow: /2012/ Disallow: /2013/ Disallow: /2014/ Disallow: /2015/ Disallow: /2016/ Disallow: /2017/ Disallow: /2018/ Disallow: /2019/ Disallow: /2020/ # Google Image User-agent: Googlebot-Image Disallow: Allow: /* # BEGIN XML-SITEMAP-PLUGIN Sitemap: http://blog.cryns.com/sitemap.xml.gz # END XML-SITEMAP-PLUGIN Sitemap: http://blog.cryns.com/sitemap.xml