GETUtilityEndpoint checked
AI Crawler Checker
Checks a website's robots.txt, meta and header directives to see which AI crawlers (ChatGPT, Claude, Perplexity, etc.) are allowed or blocked. Returns a JSON verdict, per-bot rules, access scores, content signals and recommended robots.txt snippets.
OVERVIEW
Public API details
- HTTP method
- GET
- Category
- Utility
- Payment model
- x402 pay per call
- Network
- Arc Mainnet
- Authentication
- Public upstream access
- Endpoint status
- Endpoint checked
- AI score
- 4