# robots.txt for https://dispo.cc/ sitemap: https://dispo.cc/sitemaps-2-sitemap.xml sitemap: https://dispo.cc/news.xml # live - don't allow web crawlers User-agent: AmazonBot Disallow: / User-agent: SemrushBot Disallow: / # live - don't allow web crawlers to index cpresources/ or vendor/ User-agent: * Disallow: /cpresources/ Disallow: /vendor/ Disallow: /.env Disallow: /cache/ Disallow: /api$ Disallow: /weka/user/loginstate$ Disallow: /rss.xml$