UCP // FLUENT
UCPFluentScanner
User-Agent: UCPFluentScanner/1.0 (+https://ucpfluent.com/bot)
What this bot does
UCPFluentScanner runs one-off, user-requested readiness scans of e-commerce storefronts: a merchant or their agency pastes a store URL into our scanner and we read the store's public surfaces to report how visible it is to AI shopping agents. A typical scan makes roughly 30 requests: the homepage, robots.txt, the sitemap, a handful of product pages, the store's public structured-data and UCP/MCP discovery endpoints, and nothing else.
How it behaves
- Identifies itself as UCPFluentScanner on every request, including the JavaScript-render pass — never a fake human browser. (A few requests per scan replay documented AI-crawler user-agents, e.g. ClaudeBot / PerplexityBot / OAI-SearchBot, solely to test whether your CDN blocks those crawlers.)
- At most 2 concurrent requests per host, with jittered delays between requests.
- Honors HTTP 429/503 and
Retry-Afterwith backoff. - Caches stable files (robots.txt, /.well-known/ucp) for 12–24 hours so repeat scans don't re-fetch them.
- Scans are user-initiated — we do not continuously crawl the web.
Opting out
Add this to your robots.txt and the scanner will refuse to scan your store:
User-agent: UCPFluentScanner Disallow: /
Or email us and we'll add your domain to the do-not-scan list directly.
Contact
UCP Fluent (Aurina AI LLC) — info@ucpfluent.com