Perplexity robots.txt
Articles about "Perplexity robots.txt"
2 articles found
AI Search
PerplexityBot: Should You Block or Allow It? The Complete 2026 Guide
Should you block PerplexityBot? The nuanced 2026 answer: allow it for cited referral traffic — Perplexity says it doesn't train models — unless you need a full opt-out from AI search.
AI Search
PerplexityBot vs Perplexity-User Explained: The Two Agents Most Sites Confuse
PerplexityBot builds the index behind Perplexity citations and honors robots.txt. Perplexity-User fetches pages for people's questions and generally ignores it. Blocking the wrong one costs you traffic.