Robots.txt

MD
S
Markdown

Prevent crawlers (who follow links and act on behalf of a human) from abusing from the website

If you’re trying to hide a page from search results use the 'noindex' instead:

https://developers.google.com/search/docs/advanced/crawling/block-indexing

Please ensure you have gone through the documentation before editing:

https://developers.google.com/search/reference/robots_txt

In case of conflicts, the less restrictive rules will prevail.

User-agent: * Disallow: /app* Disallow: /blacklist* Disallow: /documents$ Disallow: /event* Disallow: /internal* Disallow: /partials* Disallow: /s/* Disallow: /settings* Disallow: /team/*

User-agent: facebookexternalhit/1.1 User-agent: Slackbot-LinkExpanding 1.0 (+https://api.slack.com/robots) User-agent: Twitterbot Allow: /s/*

Sitemap: sitemap.xml

Created on 6/22/2021