# Content signals (contentsignals.org). These express how this site's # publisher expects its content to be used. They are preferences, declared in # the form the AI Preferences work at the IETF is converging on. # # search=yes build a search index and link back to the source. # ai-input=yes use the content to ground an AI answer, with attribution. # ai-train=yes use it to train or fine-tune a model. # # All three are yes deliberately: this site wants to be found, cited and # learned from by assistants. Training is allowed (owner ruling AN, # 24 September 2026). # /landing-redirect/ is deliberately NOT disallowed, and must not be again. # The interstitial already carries noindex, nofollow in its own head, and # every link to it carries rel="sponsored nofollow". A Disallow stops # Googlebot FETCHING the page, so that noindex is never read: Google still # finds the URLs through the links and indexes them URL only, which is the # Search Console report "Indexed, though blocked by robots.txt". A crawl # rule cannot remove a URL from the index; only a noindex Google is allowed # to read can. User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / Sitemap: https://www.corretoraforex.com/sitemap-0.xml