AI Crawler Directory

DuckAssistBot DuckDuckGo's ai search indexer

DuckAssistBot fetches pages to generate DuckAssist — the AI-generated answers in DuckDuckGo search results, which summarize sources with citations. It is a small-scale, well-behaved answer-engine fetcher rather than a bulk training crawler, and DuckDuckGo states the content is not used to train AI models.

AI search indexerReviewed August 2026
Quick facts
Operator
DuckDuckGo
Feeds
DuckAssist AI answers in DuckDuckGo search
Type
AI search indexer
robots.txt token
DuckAssistBot
Respects robots.txt
Yes
Official docs
duckduckgo.com

What is DuckAssistBot?

DuckAssistBot fetches source pages at answer time for summarization with citation links, drawing heavily on reference-quality sources.

Its volume is modest compared to the majors, in line with DuckDuckGo's search share, and DuckDuckGo's privacy-first positioning extends to a clean, documented bot.

How to identify DuckAssistBot

DuckAssistBot identifies itself with the following user-agent string:

Mozilla/5.0 (compatible; DuckAssistBot/1.0; +http://duckduckgo.com/duckassistbot)

Never trust the user-agent string alone. Scrapers routinely impersonate well-known crawlers to inherit their access. DuckDuckGo documents its bots on its help pages; DuckAssistBot identifies itself consistently and honors robots.txt.

Note that most AI crawlers and fetchers, DuckAssistBot included, do not execute JavaScript — so this traffic is invisible to GA4 and every script-based analytics tool. Server logs, CDN analytics, or a dedicated bot-analytics layer are the only places you will see it. For the full picture of measuring AI-driven visits, see our guide on how to track AI traffic.

Controlling DuckAssistBot with robots.txt

To refuse DuckAssistBot access to your entire site, add this to your robots.txt:

User-agent: DuckAssistBot
Disallow: /

To restrict it from specific sections only (for example, premium content) while leaving the rest open:

User-agent: DuckAssistBot
Disallow: /premium/
Disallow: /members/

Should you block or monetize DuckAssistBot?

The case for blocking: There is little to gain from blocking a low-volume, citing, non-training fetcher — unless you are simply blocking all AI answer surfaces on principle.

The case for allowing or monetizing: The return is citations in front of DuckDuckGo's privacy-conscious audience. Small but clean visibility, at negligible crawl cost.

Bottom line
Allow it. It's the model citizen of AI answer bots: identified, compliant, citing, and not training on your content.
Where Oasy fits

See exactly what DuckAssistBot does on your site — then decide what that access is worth.

Oasy detects and fingerprints 50+ AI crawlers with per-URL analytics, blocks the ones you exclude at the edge, and turns the rest into revenue — licensed RAG access and sponsored placement inside AI answers, settled weekly. Analytics scripts can't see this traffic; your server logs can, and so can we.

Join the waitlist

Frequently asked questions

Is DuckAssistBot used for AI model training?+

No — DuckDuckGo states DuckAssist content is used for on-demand answer generation with citations, not for training models.

How big is DuckAssistBot's crawl footprint?+

Small. It fetches sources for answers rather than bulk-crawling, so most sites see modest, query-driven traffic in proportion to DuckDuckGo's search share.

Stay informed on life in Europe as an expat. The Local delivers daily news, guides and essential info across 9 European countries. Sign up for the free newsletter at thelocal.com/free-newsletter