# robots.txt for https://catholiccaretas.org.au/ sitemap: https://catholiccaretas.org.au/sitemaps-1-sitemap.xml sitemap: https://catholiccaretas.org.au/ar/sitemaps-1-sitemap.xml sitemap: https://catholiccaretas.org.au/fa/sitemaps-1-sitemap.xml sitemap: $NE_SITE_URL/sitemaps-1-sitemap.xml sitemap: $TI_SITE_URL/sitemaps-1-sitemap.xml sitemap: $OM_SITE_URL/sitemaps-1-sitemap.xml # live - don't allow web crawlers to index cpresources/ or vendor/ User-agent: * Disallow: /cpresources/ Disallow: /vendor/ Disallow: /.env Disallow: /cache/