OpenAI crawlers IP ranges. Here are the complete and updated lists of OpenAI IP addresses

A plugin for wechat-gptbot that shows you short videos with pretty girls 🎉

Machine-readable AI permissions for websites. A consolidated spec at /.well-known/ai-policy.json for declaring how AI agents may train on, search, or use your content.

Continuously-updated public IP ranges for major cloud providers, SaaS services, and bots — one txt file per provider, refreshed every 4 hours via GitHub Actions. Drop-in for firewalls, allowlists, and geo blocks.

Self-hosted server log analytics for AI bot detection, AI agent monitoring, and AI visibility. Classifies GPTBot, ClaudeBot, ChatGPT-User, Perplexity & more from edge JSONL — no JS tag, no SaaS. Open-source alternative to Cloudflare AI Crawl Control.

A plugin for wechat-gptbot that offers you daily weather report for free🎉

Claude Code skill that generates and audits ai.txt, robots.txt (AI-crawler rules), llms.txt, and TDM opt-out files for websites.

🛡️ An GEO/SEO-friendly rate limiter for Go. Protects your server from abuse/DDoS while safely whitelisting verified Search Engines & AI Bots (Google, Bing, GPTBot, etc.) via IP/RDNS verification.

See which AI crawlers can read your site — GPTBot, ClaudeBot, PerplexityBot & 20 more. Curated, operator-sourced bot list + a zero-dep CLI and GitHub Action to audit robots.txt, test reachability, read access logs, and gate it all in CI.

🤖 Generate optimized robots.txt files for AI search engine crawlers (GPTBot, PerplexityBot, ClaudeBot, and more)

Complete database of AI search engine crawler user-agents (GPTBot, PerplexityBot, ClaudeBot) with robots.txt configuration examples

Validates whether GPTBot, ClaudeBot, PerplexityBot and other LLM crawlers are allowed by a robots.txt file.

Agent-native multi-bot web crawler simulator. See your site through the eyes of Googlebot, GPTBot, ClaudeBot, and PerplexityBot.

Interactive crawler IP intelligence dashboard for search, AI, and user-triggered fetchers.

Free CLI to scan AI-agent readiness (12/33 signals, MIT). Bad score? Get ready-to-install ZIP fix-pack with llms.txt, schema, A2A, MCP for $1/$29/$99 at agentfix.pro.

Free, open-source robots.txt tester — Google's retired tester rebuilt with RFC 9309 matching. Test any URL against Googlebot, GPTBot, ClaudeBot, PerplexityBot and more, with a one-click all-bots matrix.

Machine-readable reference of AI crawler user-agents (training vs. search/citation vs. user-action) with robots.txt tokens and a robots generator.

Visual robots.txt manager for the AI era. Block or allow GPTBot, ClaudeBot, PerplexityBot, and 20+ AI crawlers with one click.

See which AI crawlers your robots.txt allows or blocks (GPTBot, ClaudeBot, PerplexityBot, and 14 more), and generate a policy you actually chose.

Official IP ranges for AI bot crawlers (OpenAI, Anthropic, Google, Microsoft, Perplexity). Weekly auto-updates.