Does Perplexity Require PerplexityBot Access to Cite a Website?

What do Perplexity's two agents do?

Perplexity publishes IP address lists for both agents, and recommends allowlisting them in web application firewalls.

PerplexityBot vs Perplexity-User: scheduled crawling and user-triggered browsing

PerplexityBot works ahead of time. It crawls the web to build the index Perplexity searches when it answers, so a page it has indexed can be retrieved and cited for any relevant question. Perplexity-User works on demand. When someone asks Perplexity about a page, or its answer needs a page's current content, Perplexity-User fetches that page for that request. Perplexity says it is not used for web crawling.

The difference matters for control. Blocking PerplexityBot in robots.txt keeps your page text out of Perplexity's index, which is the main route to citations. Blocking Perplexity-User in robots.txt may have little effect, because Perplexity says that agent generally ignores robots.txt. To stop it, you would need a firewall rule. How Perplexity chooses what to cite is covered in how Perplexity retrieves and cites sources in real time.

What happens to citations if you block PerplexityBot?

According to Perplexity, a blocked page's full or partial text is not indexed, but its domain, headline and a brief factual summary may still be. In practice, that means:

• You can still appear, usually as a link or a short mention, especially for searches that name you.
• Answers about you draw on other sources, such as directories, reviews and articles that describe you.
• Detail suffers. When Cloudflare blocked Perplexity's crawlers on test sites, it reported that Perplexity turned to other websites to build its answers, and that those answers were less specific.

So blocking PerplexityBot does not make you invisible in Perplexity. It makes Perplexity rely on what others say about you.

Does Perplexity ignore website restrictions when it searches and summarizes pages?

It depends on the restriction:

• robots.txt and PerplexityBot: Perplexity says it respects it.
• robots.txt and Perplexity-User: Perplexity says this fetcher generally ignores robots.txt, because a person asked for the page. That is a stated policy, not a secret.
• Firewall blocks: this is where the dispute lies. In August 2025, Cloudflare reported tests in which it blocked Perplexity's declared agents on new, unpublished domains. It then observed requests from a generic Chrome browser user agent and IP addresses outside Perplexity's published ranges, rotating across networks. Perplexity still answered detailed questions about the test sites. Cloudflare said this happened across tens of thousands of domains, and removed Perplexity from its verified bots. Perplexity rejected the findings, saying the traffic was misattributed and came from a third-party browser automation service. It also argued that user-driven agents, which fetch only what a user requests, should not be treated like crawlers.

Earlier, in 2024, independent developers had also published tests suggesting Perplexity fetched pages that robots.txt disallowed. The record is contested, and we have not run our own tests. What is clear is that robots.txt alone will not reliably keep your content out of Perplexity's answers. If you need to know which requests are genuinely Perplexity's, check them against its published IP lists, as described in how to verify crawlers and detect spoofed bots.

Should you allow or block Perplexity?

For most businesses, allow both agents. Perplexity cites sources in its answers, and a page it can read in full can be quoted accurately, with a link. Blocking mostly removes your own description while leaving others' descriptions in place.

Block only if you have a clear reason, such as licensed content. If you do:

• Disallow PerplexityBot in robots.txt to keep text out of its index.
• Use firewall rules for Perplexity-User, matched on user agent and Perplexity's published IP ranges.
• Accept that some mention may remain, because Perplexity may still show your headline and summary, and cite other sites about you.

Rules for other companies' crawlers are covered in how to allow search AI bots while blocking training crawlers.

How do you make sure Perplexity can read your site?

1. Allow PerplexityBot and Perplexity-User in robots.txt, or leave them unblocked.
2. Allowlist Perplexity's published IP ranges in your firewall. Perplexity's documentation shows rules for Cloudflare and AWS WAF that combine the user agent with the IP ranges and set the action to allow.
3. Keep the IP lists current, since Perplexity updates them.
4. Check server logs for PerplexityBot visits and their response codes.
5. Help discovery with a sitemap and links from sites Perplexity already cites. IndexNow does not reach Perplexity, as covered in whether IndexNow improves Perplexity visibility.

Does Perplexity prefer fresh or well-structured pages once it can read them?

Access only makes a page eligible. Perplexity searches its index for each question and cites the pages that answer it best, and it often favours recent material for time-sensitive topics. Pages it cites tend to state facts plainly, near the top, with clear headings and dates. Because Perplexity shows its sources beside the answer, an accurate, specific page is more likely to be quoted than a vague one, and a page with outdated facts can be quoted wrongly long after you change it. Keeping key pages current matters as much as letting PerplexityBot in.

What might this look like in practice?

Consider an illustrative travel guide publisher, Wayfarer Notes, that blocked PerplexityBot in 2025 after reading about AI scraping. Perplexity kept mentioning the site, but its answers about Wayfarer's destination guides quoted a booking platform's descriptions, sometimes with outdated prices. The publisher reversed the block, allowlisted Perplexity's IP ranges in Cloudflare, and watched PerplexityBot return in its logs. Over the following weeks, Perplexity began quoting the guides directly and linking to them, and referral visits from perplexity.ai rose.

What do people ask about Perplexity and blocking?

Can Perplexity cite my site if I block PerplexityBot?

Yes, in a limited way. Perplexity says it may still index the domain, headline and a brief factual summary, and it can cite other sites about you.

Does Perplexity-User follow robots.txt?

Perplexity says it generally ignores robots.txt, because a user requested the page.

Is PerplexityBot used to train AI models?

Perplexity says it is not used to crawl content for AI foundation models.

How do I let Perplexity through my firewall?

Allow its published IP ranges together with the PerplexityBot and Perplexity-User user agents, as its documentation shows for Cloudflare and AWS WAF.