User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/themes/ Disallow: /trackback/ Disallow: /feed/ Disallow: */trackback/ Disallow: */feed/ Disallow: */comments/ Disallow: /*? Disallow: /*.php$ Disallow: /*?vn=* User-Agent: MJ12bot Disallow: User-Agent: msnbot Crawl-delay: 1 User-agent: ia_archiver Disallow: / User-agent: Boomtrain-Content-Bot* Disallow: Allow: /* Sitemap: https://www.techmediabooks.com/post-sitemap.xml