# MESA — Multidisciplinary Environment for Scientific Advancement # https://idss-mesa.github.io/ # This site is published for people AND for AI agents: crawling, indexing, # snippeting, and AI grounding of this content are all welcome. # # Crawlers read robots.txt only at the origin root, so this file governs # every path on idss-mesa.github.io, including the project sub-sites /docs/ # and /neon-mcp/ (their own robots.txt files are informational copies). User-agent: * Allow: / User-agent: Googlebot Allow: / User-agent: Google-Extended Allow: / User-agent: GoogleOther Allow: / User-agent: Google-CloudVertexBot Allow: / User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: cohere-ai Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: meta-externalagent Allow: / User-agent: Amazonbot Allow: / User-agent: DuckAssistBot Allow: / User-agent: MistralAI-User Allow: / Sitemap: https://idss-mesa.github.io/sitemap.xml Sitemap: https://idss-mesa.github.io/docs/sitemap.xml Sitemap: https://idss-mesa.github.io/neon-mcp/sitemap.xml # AI agents and harnesses: # Machine-readable outline: https://idss-mesa.github.io/llms.txt # Full corpus (one file): https://idss-mesa.github.io/llms-full.txt # OKF v0.2 bundle root: https://idss-mesa.github.io/okf/index.md # Markdown twin of any page (OKF v0.2 frontmatter: type, provenance, # trust, lifecycle): the in # the page's . # Agent guide: https://idss-mesa.github.io/about/ai-agents/ # Sub-site bundles (there, page URL + index.md returns its Markdown): # https://idss-mesa.github.io/docs/llms.txt # https://idss-mesa.github.io/neon-mcp/llms.txt