AI Bot Crawl Statistics

Transparency dashboard — geolocus.ai, rolling 30 days.

Updated:

166
Crawls — 7 days
1,000
Crawls — 30 days
1,000
Crawls — all time
24.7%
AI bot share (30d)

AI Crawlers — Last 30 Days

247 crawls — 8 AI bot types.

Bot Crawls Share Last Seen
ClaudeBot (Anthropic) AI 76 30.8%
GPTBot (OpenAI) AI 71 28.7%
PerplexityBot AI 37 15.0%
Meta AI (Llama) AI 27 10.9%
ChatGPT (OpenAI) AI 18 7.3%
ChatGPT Search (OpenAI) AI 16 6.5%
You.com Bot AI 1 0.4%
ByteSpider (TikTok) AI 1 0.4%
Total AI247100%

Search & Other Crawlers — Last 30 Days

753 crawls — 5 bot types.

Bot Crawls Share Last Seen
Googlebot Search 726 96.4%
GoogleOther Search 16 2.1%
Bingbot (Microsoft) Search 9 1.2%
Facebook SEO/Other 1 0.1%
SEMrush SEO/Other 1 0.1%
Total753100%

Top Crawled Paths — Last 30 Days

Path Crawls Share of Total
/sitemap.xml 457 45.7%
/ 155 15.5%
/about 82 8.2%
/services 80 8.0%
/whitepaper 76 7.6%
/research/whitepapers/whitepaper-5-1 18 1.8%
/multi-site-survey 17 1.7%
/press 15 1.5%
/case-studies 15 1.5%
/privacy 11 1.1%
/faq 11 1.1%
/methodology 10 1.0%
/contact 9 0.9%
/methodology/sitemap-benchmark 8 0.8%
/crawl-stats 8 0.8%

Collection method: Every bot request to geolocus.ai is intercepted at the Cloudflare edge by the translation-layer CF Pages Function (functions/[[path]].js). 34 bot user-agent patterns are classified via vendor/aryah-shared/src/bot-classification.ts; matched requests are logged to bot_crawl_logs (Supabase Postgres). Cache-HIT requests are also logged via a direct PostgREST insert from the CF Pages Function so no crawl is silently missed.

Raw counts only. No rounding. This is a transparency dashboard — exact numbers are the point. Cross-check against Cloudflare Analytics at any time.

Dogfood: This page demonstrates GEO Signal 3 in action — bot crawl logging on our own property, measured exactly as we measure client properties.

Reference property: Top10Lists.us/crawl-stats — established property with 3M+ crawls/30d using the same methodology.