User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php DIsallow: /wp-includes/ Disallow: /tag/ Disallow: /author/