User-agent: * Allow: / # AI Agent Discovery # OpenAPI spec: https://crawlapi.net/openapi.json # LLMs.txt: https://crawlapi.net/llms.txt # AI Plugin manifest: https://crawlapi.net/.well-known/ai-plugin.json # MCP manifest: https://crawlapi.net/.well-known/mcp.json Sitemap: https://crawlapi.net/sitemap.xml