# AI Sexting Hub robots.txt # Main directives User-agent: * Allow: / # Ensure all URLs are crawlable for better SEO Disallow: /404 # Guide search engines to pre-rendered content # Crawl-delay removed for faster indexing # Ensure crawlers know where to find the sitemap Sitemap: https://www.aisextinghub.com/sitemap.xml