LLM Bot Analyzer

Screaming Frog for AI Crawlers

Upload Access Log

Drop your Apache, Nginx, or custom pipe-delimited access log file here to analyze LLM and AI bot traffic.

Detection Methods:

  • User-Agent based: For standard Apache/Nginx logs (most accurate)
  • IP-based: For custom formats without User-Agent headers (less accurate)

Bot Detection

Identifies 25+ AI crawlers including GPTBot, ClaudeBot, and PerplexityBot

Traffic Analysis

Detailed breakdowns of URLs, status codes, and access patterns

404 Tracking

Identifies broken links and missing resources accessed by LLM bots