# Prevent Crawling Unnecessary Endpoints - Dynamically added by BigScoots User-agent: * Disallow: /cdn-cgi/ Disallow: /wp-admin/ Disallow: /wp-json/ Disallow: /*?s= Disallow: /*?attachment_id= Disallow: /*?add-to-cart= Disallow: /*&add-to-cart= Disallow: /*?add_to_wishlist= Disallow: /*&add_to_wishlist= User-agent: * Allow: /wp-admin/admin-ajax.php Allow: /wp-content/uploads/ Allow: /wp-content/ Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /? Disallow: /tmp/ Disallow: /junk/ Disallow: /search/ Disallow: /feed/ Disallow: /cart/ Disallow: /checkout/ Disallow: /comments/feed/ Disallow: /wp-admin/ Disallow: /*? Disallow: /wp-login.php/ Disallow: /wp-login.php? Disallow: /wp-json/ Disallow: /wp-content/uploads/private/ Disallow: /wp-content/uploads/wpo-plugins-tables-list.json # Explicitly allow LLM bots User-agent: GPTBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: YouBot Allow: / Sitemap: https://theprocurementschool.com/sitemap_index.xml