Get more sales from ChatGPT
and other AI
Like Google Analytics, but for the invisible layer of AI crawlers that read your site 24/7. We track how AI reads your site and help you understand how to increase it.
Reads the major AI crawlers & agents — GPTBot, ClaudeBot, PerplexityBot and more — verified against official IP ranges.
AI bots already read your site. Your analytics doesn't show it.
198.51.100.23 — "GET /pricing" 200 "ClaudeBot/1.0" 203.0.113.7 — "GET /blog/ai-email" 200 "GPTBot/1.2" 198.51.100.91 — "GET /compare/x" 200 "PerplexityBot/1.0" 192.0.2.44 — "GET /docs/api" 200 "Google-Extended" 203.0.113.88 — "GET /blog/best" 200 "CCBot/2.0"
- 01Hidden AI traffic
Crawlers hit your pages, but standard analytics fold them into "bot traffic" — or leave them buried in server logs you never open.
- 02No page-level visibility
You can't tell whether agents reached your pricing, docs or comparison pages — the ones that decide how AI describes you.
- 03Disconnected from AI search
Crawl activity sits apart from how your brand actually shows up in ChatGPT, Perplexity and Gemini answers.
From raw server logs to a weekly list of pages to fix
Point it at your logs
Server logs, CDN logs or a one-line script — whichever your stack already has.
Match every hit
Each request checked against known AI crawlers and verified against official IP ranges.
See what they read
Who visited, which pages they pulled, and how often they came back.
Get the next move
Specific SEO, GEO and content actions — not another wall of raw rows.
Your analytics calls it "bot traffic." We read who, what page, why.
- GPTBot — GET /pricing
- ClaudeBot — GET /docs/api
- PerplexityBot — GET /compare/x
- CCBot — GET /blog/best
Every agent, every page — one dense view
Verified and spoofed traffic separated, intent inferred, the next action surfaced. (Sample data.)
AI agents — last 7 days
| Agent | Visits | Top page | Intent |
|---|---|---|---|
| ClaudeBot | 248 | /pricing | Product research |
| GPTBot | 192 | /blog | Content scan |
| PerplexityBot | 87 | /compare | Comparison |
| Google-Extended | 64 | /docs | Indexing |
| CCBot | 53 | /blog | Content crawl |
Crawl volume · 14d
Detect the bots. Understand the intent. Act on it.
AI bot detection
Known crawlers and agent user-agents, verified against official IP ranges to catch spoofing.
Agent profiles
Behaviour by bot type — training, AI-search or on-demand fetcher.
Page-level analytics
Exactly which pages each agent reads, grouped by topic and intent.
Crawl-gap analysis
Crawler activity set against referrals and real human traffic.
Recommendations
Concrete next moves for SEO, GEO and content visibility.
Weekly reports
A short summary of AI crawler activity in your inbox every Monday.
Who reads their logs with Crawlytics
Track which AI crawlers read your SEO pages
See whether GPTBot and PerplexityBot reach your listicles and comparison content — the pages that decide how AI describes you.
Reach pricing & docs
Whether agents actually reach your pricing, docs and onboarding pages.
Find AI-visible articles
Which articles answer engines read most — and which they skip.
Measure crawl frequency
How AI crawlers consume your content — and how often they return.
Is your site readable to AI answer engines?
Crawlytics scores how visible your key pages are to AI systems and crawler-based discovery — and what to fix first.
Most key pages are AI-visible, but answer-engine signals are incomplete.
Suggested actions
Add a structured FAQ to your pricing page
Create comparison pages for high-intent queries
Add an llms.txt file to your root
Open product docs to selected AI crawlers
Write clear product descriptions for answer engines
One email a week: who crawled what, and what to fix
A short summary in your inbox — what changed, and the one action worth taking — instead of another dashboard to check.
Get Crawlytics →5 AI agents read 384 pages
/compare page — PerplexityBot keeps looking.Self-host Crawlytics — free & open source
Run it on your own server and read every AI crawler hitting your site — who, which page, why — straight from your own logs. No account, no SaaS, nothing leaves your box.
Built in the open. Launching soon.
Free · self-hosted · open source. Going public soon — ping me on X and I'll send you the repo the moment it's live.
Questions, answered
AI crawlers, detection, and what Crawlytics actually does.
A bot or agent that visits websites to read, retrieve or process content for AI systems and answer engines — like GPTBot (OpenAI), ClaudeBot (Anthropic) or PerplexityBot.
Known AI crawlers such as GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot and other agent user-agents — verified against official IP ranges to catch spoofing.
No. GA tracks humans via a page script that crawlers never run. Crawlytics reads server logs to focus on AI crawler behaviour, pages and AI-search visibility.
Not necessarily. Crawlytics works with manual log upload, CDN log export or a lightweight script — whichever fits your stack.
The MVP focuses on detection, analytics and recommendations. Blocking rules can come later.
SEO teams, SaaS companies, media sites, e-commerce teams, content marketers and founders who care about AI visibility.