---
title: "Pay per crawl defined | Agent Ready Checklist"
description: "Pay per crawl: Cloudflare AI Crawl Control feature (closed beta) that charges crawlers per request: 200 with payment intent, or 402 Payment Required with."
canonical: https://agentreadychecklist.com/glossary/pay-per-crawl
site: "Agent Ready Checklist"
last_updated: 2026-11-05
section: "Glossary"
---

# Pay per crawl defined | Agent Ready Checklist

> Pay per crawl: Cloudflare AI Crawl Control feature (closed beta) that charges crawlers per request: 200 with payment intent, or 402 Payment Required with.

Source: https://agentreadychecklist.com/glossary/pay-per-crawl
Site: Agent Ready Checklist
Last reviewed: 2026-11-05
Agent endpoints: https://agentreadychecklist.com/llms.txt (index), https://agentreadychecklist.com/openapi.json (API), https://agentreadychecklist.com/mcp (MCP server), https://agentreadychecklist.com/ask (search)
Access: https://agentreadychecklist.com/auth.md (no key). Pricing: https://agentreadychecklist.com/pricing.md (free).

# Pay per crawl

Cloudflare AI Crawl Control feature (closed beta) that charges crawlers per request: 200 with payment intent, or 402 Payment Required with pricing. Example: HTTP/1.1 402 Payment Required. WAF or Bot Management blocks override the pay per crawl charge rule. Cloudflare acts as Merchant of Record for the charge.

## Definition

Cloudflare AI Crawl Control feature (closed beta) that charges crawlers per request: 200 with payment intent, or 402 Payment Required with pricing.

## Example

```text
HTTP/1.1 402 Payment Required
```

## Asked about it

### Which Cloudflare checks have no AgentReady requirement?

Content Signals, markdown negotiation, OAuth discovery as a standalone file, Agent Skills discovery, and items such as DNS-AID, Auth.md and Personal Agent Protocol. Pay per crawl is a Cloudflare feature but not listed as a scanner check on 2026-11-04.

## Sources

-   [developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/)read 2026-11-04
-   [isitagentready.com](https://isitagentready.com/)read 2026-11-04

Last reviewed 2026-11-05. AgentReady v2.0, read 2026-11-04.