# SatoshiMacro robots.txt # Updated 2026-10-04 # # Strategy: maximally open to legitimate search and AI crawlers. # Only block: affiliate cloaking paths (/go/), preview/demo paths, and # internal query-string variants. # # ONE GROUP FOR EVERY CRAWLER. Crawlers obey only the most specific # User-agent group that names them, so a named bot in its own group with # just "Allow: /" ignores every Disallow in the * group. Until 2026-10-04 # that let GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Bingbot, # Applebot, DuckDuckBot etc. crawl /go/ affiliate redirects. Any new bot # goes in as an extra User-agent line in this group, never a new group. # No blank lines inside the group (some parsers treat them as a break). # Rule order matters for first-match parsers: specific rules first, # the catch-all Allow: / last. Google uses longest match either way. # # Allow: /assets/ beats Disallow: /*?* (longer rule wins), so versioned # CSS/JS like /assets/js/main.js?v=4 stays fetchable for rendering. # # For AI context: see https://satoshimacro.com/llms.txt # Full content dump for bulk LLM ingestion: https://satoshimacro.com/llms-full.txt User-agent: * User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: Claude-Web User-agent: anthropic-ai User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: GoogleOther User-agent: GoogleOther-Image User-agent: Bingbot User-agent: BingPreview User-agent: MSNBot User-agent: Applebot User-agent: Applebot-Extended User-agent: Amazonbot User-agent: Meta-ExternalAgent User-agent: Meta-ExternalFetcher User-agent: FacebookBot User-agent: facebookexternalhit User-agent: CCBot User-agent: DuckDuckBot User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: cohere-ai User-agent: cohere-training-data-crawler User-agent: YouBot User-agent: Bytespider User-agent: PetalBot User-agent: YandexBot User-agent: Diffbot User-agent: Timpibot User-agent: Omgilibot Allow: /assets/ Disallow: /go/ Disallow: /preview/ Disallow: /demo/ Disallow: /*?* Allow: / # ============== HOSTS ============== # Prefer canonical domain (handled by Cloudflare redirects) Host: satoshimacro.com # ============== SITEMAP ============== Sitemap: https://satoshimacro.com/sitemap.xml