User-agent: * Crawl-delay: 10 Disallow: */search/ Disallow: /search/ Disallow: */search? Disallow: /search? Disallow: /search-results Disallow: /file/ Disallow: /api/ User-agent: AhrefsBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: Applebot Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: OAI-SearchBot Disallow: / Sitemap: https://sitemap.royalacademy.org.uk/sitemap.xml