# www.robotstxt.org/ # Allow crawling of all content User-agent: * Disallow: /admin/ Disallow: /test-pages/ Disallow: /training/ Disallow: /directories/offices-departments-directory/information-technology-services/password-help/ Disallow: /search/