User-Agent: * # Disallow all crawlers access to certain pages. Disallow: /wp-admin/ Disallow: /wp-admin Disallow: /wp-login.php Disallow: /wp-login.php* Disallow: /*ref=*