# AgentLine robots.txt # https://agentline.cloud User-agent: * Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /skill.md Allow: /index.md Allow: /blogs Allow: /blog/ Allow: /news Allow: /build Allow: /pricing Allow: /about Allow: /contact Disallow: /api/ Disallow: /dashboard/ Disallow: /auth/ Disallow: /login Disallow: /signup # Content-Signal directives (contentsignals.org) # Declares how automated systems may USE content after fetching it. # search = indexing and displaying results with links/excerpts # ai-input = grounding, RAG, real-time generative search answers # ai-train = training or fine-tuning AI models Content-Signal: search=yes, ai-input=yes, ai-train=no Sitemap: https://agentline.cloud/sitemap.xml Host: https://agentline.cloud