## Enable robots.txt rules for all crawlers User-agent: * ## Crawl-delay parameter: number of seconds to wait between successive requests to the same server. ## Set a custom crawl rate if you're experiencing traffic problems with your server. # Crawl-delay: 30 ## Do not crawl admin and technical folders Disallow: /cgi-bin Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/cache/ Disallow: /wp-trackback Disallow: /wp-feed Disallow: /wp-comments Disallow: /docs Disallow: */trackback Disallow: */feed Disallow: */comments ## WP SEO IMPROVEMENTS #Googlebot User-agent: Googlebot Allow: /wp-content/themes/ Allow: /wp-content/plugins/ Allow: /wp-content/uploads/ Allow: /wp-includes/css/ Allow: /wp-includes/js/ Allow: /wp-includes/images/ # Allow everything for Alexa bot User-agent: Alexabot Disallow: ## Do not crawl cart and checkout Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/ ##Do not crawl blank pages and disclaimers Disallow: /core-services/organizational-health-overview/ Disallow: /assessments/ Disallow: /6067-2/ Disallow: /events-insights/ Disallow: /welcome-message/ Disallow: /testimonials/ Disallow: /disclaimer/ Disallow: /legal-terms/ Disallow: /website-terms-of-service/ Disallow: /privacy-policy/ Sitemap: https://integrispa.com/sitemap_index.xml