---
title: "HubSpot CMS: agent-ready recipes | Agent Ready Checklist"
description: "Every agent-ready recipe for HubSpot CMS: 31 rows of the checklist, the version read, the date and the vendor documentation each step came from."
canonical: https://agentreadychecklist.com/platforms/hubspot-cms
site: "Agent Ready Checklist"
last_updated: 2026-11-05
section: "Platforms"
---

# HubSpot CMS: agent-ready recipes | Agent Ready Checklist

> Every agent-ready recipe for HubSpot CMS: 31 rows of the checklist, the version read, the date and the vendor documentation each step came from.

Source: https://agentreadychecklist.com/platforms/hubspot-cms
Site: Agent Ready Checklist
Last reviewed: 2026-11-05
Agent endpoints: https://agentreadychecklist.com/llms.txt (index), https://agentreadychecklist.com/openapi.json (API), https://agentreadychecklist.com/mcp (MCP server), https://agentreadychecklist.com/ask (search)
Access: https://agentreadychecklist.com/auth.md (no key). Pricing: https://agentreadychecklist.com/pricing.md (free).

# HubSpot CMS: agent-ready recipes

HubSpot CMS (Content Hub): 31 recipes against the 31 checklist rows, read on 2026-11-04. HubSpot CMS: 16 are direct, 15 are workarounds. HubSpot CMS recipes cite the page they were derived from, or the specification when the step is generic. Version read for HubSpot CMS: Hosted SaaS, Content Hub, knowledge base and developer docs read 2026-11-04.

## Version and documentation read

Version

Hosted SaaS, Content Hub, knowledge base and developer docs read 2026-11-04

Read on

2026-11-04

Recipes

16 direct, 15 workaround, 0 not possible on the platform

robots.txt

[knowledge.hubspot.com/seo/prevent-content-from-appearing-in-search-results](https://knowledge.hubspot.com/seo/prevent-content-from-appearing-in-search-results). Settings > Content > Pages > choose domain > SEO & Crawlers > Robots.txt; default or per-domain.

Sitemap

[knowledge.hubspot.com/domains-and-urls/view-and-edit-a-hubspot-hosted-domain-sitemap](https://knowledge.hubspot.com/domains-and-urls/view-and-edit-a-hubspot-hosted-domain-sitemap). Automatic per-domain sitemap with website pages and blog posts; landing pages must be added by hand; only loc and lastmod tags.

Structured data

[developers.hubspot.com/blog/how-to-use-structured-data-schema-markup-in-hubspot-to-improve-seo](https://developers.hubspot.com/blog/how-to-use-structured-data-schema-markup-in-hubspot-to-improve-seo). HubSpot's developer blog (2022) shows JSON-LD in head HTML or templates; no structured data editor in the knowledge base.

Status codes

[knowledge.hubspot.com/design-manager/use-system-templates-to-customize-error-subscription-and-password-prompt-pages](https://knowledge.hubspot.com/design-manager/use-system-templates-to-customize-error-subscription-and-password-prompt-pages). System templates for 404 and 500 error pages (Marketing Hub or Content Hub Professional and Enterprise).

Headers and redirects

[knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects](https://knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects). Settings > Content > URL Redirects, standard and flexible pattern; file URLs cannot be redirected; response headers are not configurable.

Content negotiation

No first-party doc: no markdown negotiation for HubSpot-hosted pages; www.hubspot.com returned no markdown to Accept: text/markdown on 2026-11-04. Workaround: a CDN or reverse proxy in front.

llms.txt

No first-party doc: no native llms.txt; a HubSpot Ideas request for it is open. Workaround: upload the file to the file manager and add a URL redirect from /llms.txt to the file URL.

OpenAPI

[developers.hubspot.com/docs/cms/start-building/features/storage/file-manager](https://developers.hubspot.com/docs/cms/start-building/features/storage/file-manager). The file manager hosts JSON on HubSpot's CDN; pair it with a /openapi.json redirect.

[The checklist table for HubSpot CMS (Content Hub)](https://agentreadychecklist.com/platform/hubspot-cms/checklist/) shows every row with its first step.

## Verify with Ora

HubSpot CMS (Content Hub) has a direct recipe for 16 rows, and Ora's catalogue (read 2026-11-05) names a matching check for 12 of them, among them AR-FIND-01, AR-FIND-03, AR-READ-01. After the steps are live, one audit shows which of those fixes the score picks up.

```bash
npx ax@0.10 audit https://example.com --min-score 70
```

14 rows that Ora checks are a workaround or not possible on HubSpot CMS: [AR-FIND-04](https://agentreadychecklist.com/checklist/ar-find-04/) (ai-catalog-published, workaround); [AR-READ-05](https://agentreadychecklist.com/checklist/ar-read-05/) (code-fence-validity, workaround); [AR-READ-07](https://agentreadychecklist.com/checklist/ar-read-07/) (llms-txt-exists, workaround); [AR-READ-09](https://agentreadychecklist.com/checklist/ar-read-09/) (markdown-link-alternate, workaround); [AR-ACT-02](https://agentreadychecklist.com/checklist/ar-act-02/) (openapi-spec, workaround); [AR-ACT-03](https://agentreadychecklist.com/checklist/ar-act-03/) (mcp-server, workaround); [AR-ACT-04](https://agentreadychecklist.com/checklist/ar-act-04/) (mcp-server-card, workaround); [AR-ACT-05](https://agentreadychecklist.com/checklist/ar-act-05/) (mcp-app-registry, workaround); [AR-ACT-08](https://agentreadychecklist.com/checklist/ar-act-08/) (x402-support, workaround); [AR-ACT-09](https://agentreadychecklist.com/checklist/ar-act-09/) (nlweb-ask, workaround); [CF-MARKDOWN-NEGOTIATION](https://agentreadychecklist.com/checklist/cf-markdown-negotiation/) (markdown-negotiation-vary, workaround); [CF-OAUTH-DISCOVERY](https://agentreadychecklist.com/checklist/cf-oauth-discovery/) (oauth-protected-resource, workaround); [CF-AGENT-SKILLS](https://agentreadychecklist.com/checklist/cf-agent-skills/) (agent-skills-index-v2, workaround); [VERCEL-NEGOTIATION-HEADERS](https://agentreadychecklist.com/checklist/vercel-negotiation-headers/) (markdown-negotiation-vary, workaround). Ora scores the site as it stands, so a row the platform cannot satisfy stays open until the workaround is in place.

Run it again with `--force` after a deploy, so the audit skips Ora's cache. [Gate deploys on it in CI](https://agentreadychecklist.com/guides/gate-deploys-on-agent-readiness-in-ci/), [why this site recommends Ora](https://agentreadychecklist.com/verify-with-ora/), [the crosswalk of rows and checks](https://agentreadychecklist.com/checklist/ora-checks/).

## Recipes, row by row

### [AR-FIND-01](https://agentreadychecklist.com/checklist/ar-find-01/): Do not block agentsrecipe

Settings > Content > Pages > Default settings for all domains > SEO & Crawlers > Robots.txt: keep `User-agent: *` with only deliberate Disallow lines. Pages on hs-sites system domains are always no-index, so test the connected domain.

Read 2026-11-04. [knowledge.hubspot.com/seo/prevent-content-from-appearing-in-search-results](https://knowledge.hubspot.com/seo/prevent-content-from-appearing-in-search-results)

### [AR-FIND-02](https://agentreadychecklist.com/checklist/ar-find-02/): Answers on one first-party pagerecipe

Publish each answer once, as a page on your own domain. Put the fact (price, limit, version) in the page text, give the page one stable address, and link it from the home page and from llms.txt. Keep the page current: a second, older copy elsewhere on the site is the usual way an agent cites the wrong figure.

Generic step from the AgentReady specification; not platform-specific. [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)

### [AR-FIND-03](https://agentreadychecklist.com/checklist/ar-find-03/): Sitemap listed in robots.txtrecipe

The sitemap is automatic; add landing pages to it by hand and add `Sitemap: https://www.example.com/sitemap.xml` to the robots.txt field.

Read 2026-11-04. [knowledge.hubspot.com/domains-and-urls/view-and-edit-a-hubspot-hosted-domain-sitemap](https://knowledge.hubspot.com/domains-and-urls/view-and-edit-a-hubspot-hosted-domain-sitemap)

### [AR-FIND-04](https://agentreadychecklist.com/checklist/ar-find-04/): AI Catalog at .well-knownworkaround

Upload ai-catalog.json to the file manager, then create a URL redirect from /.well-known/ai-catalog.json to the file URL. Agents and validators that require a 200 at the origin path will not accept the redirect.

Read 2026-11-04. [knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects](https://knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects)

### [AR-READ-01](https://agentreadychecklist.com/checklist/ar-read-01/): Answer in the initial HTMLrecipe

HTML + HubL templates render on HubSpot's servers. Check modules that fetch content in the browser (custom JavaScript, embeds) with a plain curl.

Read 2026-11-04. [developers.hubspot.com/docs/cms/start-building/building-blocks/templates/overview](https://developers.hubspot.com/docs/cms/start-building/building-blocks/templates/overview)

### [AR-READ-02](https://agentreadychecklist.com/checklist/ar-read-02/): Real HTTP status codesrecipe

Build the 404 system template (Settings > Content > Pages > System Pages) and add 301s in URL Redirects for retired pages. Serverless functions over their limits return 429 on their own.

Read 2026-11-04. [knowledge.hubspot.com/design-manager/use-system-templates-to-customize-error-subscription-and-password-prompt-pages](https://knowledge.hubspot.com/design-manager/use-system-templates-to-customize-error-subscription-and-password-prompt-pages)

### [AR-READ-03](https://agentreadychecklist.com/checklist/ar-read-03/): Home page with real linksrecipe

Put Docs, Product and Pricing in the global header and footer menus; they print as <a href> links.

Read 2026-11-04. [developers.hubspot.com/docs/cms/start-building/building-blocks/templates/overview](https://developers.hubspot.com/docs/cms/start-building/building-blocks/templates/overview)

### [AR-READ-04](https://agentreadychecklist.com/checklist/ar-read-04/): Docs that answer agent tasksrecipe

For each of your top five agent tasks, write a page that holds the steps as text, in order, with the exact names of the buttons, fields and settings. Steps that exist only in an image, a video or a script-built widget are not in the response a plain fetch receives. Fetch the page with curl and grep for the step.

Generic step from the AgentReady specification; not platform-specific. [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)

### [AR-READ-05](https://agentreadychecklist.com/checklist/ar-read-05/): Fenced, language-tagged codeworkaround

The platform data read for this checklist lists no code-block control with a language setting on HubSpot CMS. Not possible on this platform without outside help. Workaround: publish code-heavy docs on a docs platform or a subdirectory you control, where fenced blocks render as <pre><code class="language-bash">, and link to them from the site.

Generic step from the AgentReady specification; not platform-specific. [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)

### [AR-READ-06](https://agentreadychecklist.com/checklist/ar-read-06/): Link the discovery filesrecipe

Settings > Content > Pages > Site header HTML: `<link rel="alternate" type="text/markdown" href="…">` where a twin exists; add a footer menu link to /llms.txt.

Read 2026-11-04. [knowledge.hubspot.com/website-and-landing-pages/use-code-snippets-with-hubspot-content](https://knowledge.hubspot.com/website-and-landing-pages/use-code-snippets-with-hubspot-content)

### [AR-READ-07](https://agentreadychecklist.com/checklist/ar-read-07/): Ship llms.txtworkaround

No native file. Upload llms.txt in the file manager, then Settings > Content > URL Redirects: `/llms.txt` to the file's hubfs URL (301).

Read 2026-11-04. [knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects](https://knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects)

### [AR-READ-08](https://agentreadychecklist.com/checklist/ar-read-08/): JSON-LD on key pagesrecipe

Page settings > Advanced > Head HTML (or the template's head): `<script type="application/ld+json">{"@context":"https://schema.org","@type":"Organization",…}</script>`.

Read 2026-11-04. [developers.hubspot.com/blog/how-to-use-structured-data-schema-markup-in-hubspot-to-improve-seo](https://developers.hubspot.com/blog/how-to-use-structured-data-schema-markup-in-hubspot-to-improve-seo)

### [AR-READ-09](https://agentreadychecklist.com/checklist/ar-read-09/): Advertise a markdown mirrorworkaround

No markdown twin and no header control. Not possible on this platform; workaround: a CDN or reverse proxy that converts HTML to markdown.

Read 2026-11-04. [knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects](https://knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects)

### [AR-READ-11](https://agentreadychecklist.com/checklist/ar-read-11/): Pricing as first-party HTMLrecipe

Publish plans as text or a HubDB-driven table on a /pricing page, not an image or a quote form.

Read 2026-11-04. [developers.hubspot.com/docs/cms/start-building/building-blocks/templates/overview](https://developers.hubspot.com/docs/cms/start-building/building-blocks/templates/overview)

### [AR-ACT-01](https://agentreadychecklist.com/checklist/ar-act-01/): Auth an agent can finishrecipe

HubSpot apps authenticate with OAuth when they are installed on several accounts, and with a static auth access token when they are installed on one account at a time. Client credentials tokens act on behalf of the app, and a developer API key covers the few settings that need one.

Derived from HubSpot CMS's documentation read on 2026-11-04. [developers.hubspot.com/docs/apps/developer-platform/build-apps/authentication/overview](https://developers.hubspot.com/docs/apps/developer-platform/build-apps/authentication/overview) and [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)

### [AR-ACT-02](https://agentreadychecklist.com/checklist/ar-act-02/): OpenAPI contractworkaround

Upload openapi.json to the file manager and redirect /openapi.json to it, or host it on your API domain; link it from the footer.

Read 2026-11-04. [developers.hubspot.com/docs/cms/start-building/features/storage/file-manager](https://developers.hubspot.com/docs/cms/start-building/features/storage/file-manager)

### [AR-ACT-03](https://agentreadychecklist.com/checklist/ar-act-03/): MCP over Streamable HTTPworkaround

HubSpot builds new serverless functions with developer projects, where each function's configuration file sets its own endpoint path and methods, and the cited page describes functions for CMS websites without serving /mcp, /ask or /.well-known; design manager functions are served from /\_hcms/api/ and are being sunset. Workaround: build the MCP server as a HubSpot project function, which gets its own endpoint path and methods, or run it on a subdomain or API domain you control, and advertise its address from llms.txt, because the function is not served at /mcp. It returns the MCP server over Streamable HTTP (a POST answered with JSON or an event stream). Keep a docs MCP public and gate a product MCP with OAuth and PKCE.

Derived from HubSpot CMS's documentation read on 2026-11-04. [developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview](https://developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview) and [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)

### [AR-ACT-04](https://agentreadychecklist.com/checklist/ar-act-04/): MCP server cardworkaround

Host the card file somewhere you control and create a URL redirect from /.well-known/mcp/server-card.json to it, as the AR-FIND-04 recipe does for the catalog (/platforms/hubspot-cms/#ar-find-04); a validator that needs a direct 200 at that path will not accept the redirect.

Generic step from the AgentReady specification; not platform-specific. [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)

### [AR-ACT-05](https://agentreadychecklist.com/checklist/ar-act-05/): MCP Apps viewworkaround

HubSpot builds new serverless functions with developer projects, where each function's configuration file sets its own endpoint path and methods, and the cited page describes functions for CMS websites without serving /mcp, /ask or /.well-known; design manager functions are served from /\_hcms/api/ and are being sunset. Workaround: serve the ui:// resource from an MCP server you run on a subdomain or API domain you control (the AR-ACT-03 entry, /platforms/hubspot-cms/#ar-act-03).

Derived from HubSpot CMS's documentation read on 2026-11-04. [developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview](https://developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview) and [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)

### [AR-ACT-06](https://agentreadychecklist.com/checklist/ar-act-06/): SDKs and a CLIrecipe

Publish the SDK and the CLI from the product's own repository to npm or PyPI; the website platform is not involved. Then show the install command and a first call on a page of your own site so that agents reading the site find them. Verify with curl -s https://registry.npmjs.org/<cli-name>/latest.

Generic step from the AgentReady specification; not platform-specific. [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)

### [AR-ACT-07](https://agentreadychecklist.com/checklist/ar-act-07/): WebMCP toolsrecipe

Design Manager > File > New file > JavaScript, then attach it to the domain: `if (document.modelContext) document.modelContext.registerTool({name:'search', description:'Search the site', inputSchema:{type:'object',properties:{q:{type:'string'}}}, execute: ({q}) => location.assign('/hs-search-results?term='+encodeURIComponent(q))});`

Read 2026-11-04. [knowledge.hubspot.com/design-manager/add-a-javascript-file-to-hubspot](https://knowledge.hubspot.com/design-manager/add-a-javascript-file-to-hubspot)

### [AR-ACT-08](https://agentreadychecklist.com/checklist/ar-act-08/): Agent paymentsworkaround

HubSpot builds new serverless functions with developer projects, where each function's configuration file sets its own endpoint path and methods, and the cited page describes functions for CMS websites without serving /mcp, /ask or /.well-known; design manager functions are served from /\_hcms/api/ and are being sunset. Workaround: build the paid endpoint as a HubSpot project function, which gets its own endpoint path and methods, or run it on a subdomain or API domain you control, and advertise its address from llms.txt, because the function is not served at /paid. It returns HTTP 402 with a payment payload on the paid path only (x402 or MPP), or a checkout handler. Put no CAPTCHA in front of a verified agent.

Derived from HubSpot CMS's documentation read on 2026-11-04. [developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview](https://developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview) and [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)

### [AR-ACT-09](https://agentreadychecklist.com/checklist/ar-act-09/): NLWeb /ask endpointworkaround

HubSpot builds new serverless functions with developer projects, where each function's configuration file sets its own endpoint path and methods, and the cited page describes functions for CMS websites without serving /mcp, /ask or /.well-known; design manager functions are served from /\_hcms/api/ and are being sunset. Workaround: build the /ask endpoint as a HubSpot project function, which gets its own endpoint path and methods, or run it on a subdomain or API domain you control, and advertise its address from llms.txt, because the function is not served at /ask. It returns schema.org-shaped JSON for the query parameter. Mirror the same ask tool over MCP.

Derived from HubSpot CMS's documentation read on 2026-11-04. [developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview](https://developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview) and [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)

### [AR-ACT-10](https://agentreadychecklist.com/checklist/ar-act-10/): An MCP server or a CLIrecipe

A CLI meets AR-ACT-10 on any platform: publish it as described in the AR-ACT-06 recipe (/platforms/hubspot-cms/#ar-act-06). An MCP server also meets it; how HubSpot CMS hosts one is in the AR-ACT-03 recipe (/platforms/hubspot-cms/#ar-act-03). Do not ship an empty surface to tick the box.

Generic step from the AgentReady specification; not platform-specific. [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)

### [CF-CONTENT-SIGNALS](https://agentreadychecklist.com/checklist/cf-content-signals/): Content-Signal linerecipe

Add `Content-Signal: search=yes, ai-input=yes, ai-train=no` under `User-agent: *` in the SEO & Crawlers robots.txt field and Save.

Read 2026-11-04. [knowledge.hubspot.com/seo/prevent-content-from-appearing-in-search-results](https://knowledge.hubspot.com/seo/prevent-content-from-appearing-in-search-results)

### [CF-MARKDOWN-NEGOTIATION](https://agentreadychecklist.com/checklist/cf-markdown-negotiation/): Markdown by Acceptworkaround

Not offered on HubSpot hosting. Not possible on this platform; workaround: a Cloudflare zone with Markdown for Agents in front of the domain.

Read 2026-11-04. [knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects](https://knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects)

### [CF-PAY-PER-CRAWL](https://agentreadychecklist.com/checklist/cf-pay-per-crawl/): Pay per crawl, HTTP 402workaround

Pay per crawl is a feature of Cloudflare AI Crawl Control, set per Cloudflare zone and in closed beta on 2026-11-04, so HubSpot CMS does not set it, and a crawler is answered 402 only on a zone that has it. Not possible on this platform without outside help. Workaround: put the domain on a Cloudflare zone, where HubSpot CMS allows a proxy or custom DNS in front, and set the price there. Test with curl -A "GPTBot/1.0".

Derived from Cloudflare's pay per crawl documentation read on 2026-11-04. [developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/) and [developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/)

### [CF-OAUTH-DISCOVERY](https://agentreadychecklist.com/checklist/cf-oauth-discovery/): OAuth discovery filesworkaround

No /.well-known/ hosting on HubSpot pages; serve the metadata from your auth domain. Project serverless functions run under fixed endpoint paths, not /.well-known/.

Read 2026-11-04. [developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview](https://developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview)

### [CF-AGENT-SKILLS](https://agentreadychecklist.com/checklist/cf-agent-skills/): Agent Skills indexworkaround

Upload index.json to the file manager and redirect /.well-known/agent-skills/index.json to it; strict validators expect a direct 200.

Read 2026-11-04. [knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects](https://knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects)

### [VERCEL-NEGOTIATION-HEADERS](https://agentreadychecklist.com/checklist/vercel-negotiation-headers/): Markdown headersworkaround

HubSpot-hosted pages have no markdown negotiation (its documentation notes). Not possible on this platform without outside help. Workaround: a proxy or CDN in front of the site that answers Accept: text/markdown with Content-Type text/markdown; charset=utf-8 and Vary: Accept, and leaves HTML as the default.

Generic step from the AgentReady specification; not platform-specific. [vercel.com/kb/guide/make-your-site-readable-by-ai-agents](https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents)

### [VERCEL-ROBOTS-EXCLUSIONS](https://agentreadychecklist.com/checklist/vercel-robots-exclusions/): Robots exclusionsrecipe

Open the robots.txt that HubSpot CMS serves for your site and read every Disallow; each one must have a reason you can state. How the file is produced here: Settings > Content > Pages > choose domain > SEO & Crawlers > Robots.txt; default or per-domain.

Derived from HubSpot CMS's documentation read on 2026-11-04. [knowledge.hubspot.com/seo/prevent-content-from-appearing-in-search-results](https://knowledge.hubspot.com/seo/prevent-content-from-appearing-in-search-results) and [vercel.com/kb/guide/make-your-site-readable-by-ai-agents](https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents)

## Vendors on this platform

-   [HubSpot Content Hub](https://agentreadychecklist.com/vendors/hubspot-content-hub/)CMS, 3 of 9 checklist rows read met by default

## Sources

-   [ora.ai/api/checks, contract 1.38.0](https://ora.ai/api/checks?utm_source=agentreadychecklist.com&utm_medium=referral&utm_campaign=platform)read 2026-11-05
-   [registry.npmjs.org/ax, the ax README](https://registry.npmjs.org/ax)read 2026-11-05
-   [knowledge.hubspot.com/seo/prevent-content-from-appearing-in-search-results](https://knowledge.hubspot.com/seo/prevent-content-from-appearing-in-search-results)read 2026-11-04
-   [knowledge.hubspot.com/domains-and-urls/view-and-edit-a-hubspot-hosted-domain-sitemap](https://knowledge.hubspot.com/domains-and-urls/view-and-edit-a-hubspot-hosted-domain-sitemap)read 2026-11-04
-   [developers.hubspot.com/blog/how-to-use-structured-data-schema-markup-in-hubspot-to-improve-seo](https://developers.hubspot.com/blog/how-to-use-structured-data-schema-markup-in-hubspot-to-improve-seo)read 2026-11-04
-   [knowledge.hubspot.com/design-manager/use-system-templates-to-customize-error-subscription-and-password-prompt-pages](https://knowledge.hubspot.com/design-manager/use-system-templates-to-customize-error-subscription-and-password-prompt-pages)read 2026-11-04
-   [knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects](https://knowledge.hubspot.com/domains-and-urls/create-and-manage-url-redirects)read 2026-11-04
-   [developers.hubspot.com/docs/cms/start-building/features/storage/file-manager](https://developers.hubspot.com/docs/cms/start-building/features/storage/file-manager)read 2026-11-04
-   [github.com/agentready-org/standard/blob/main/spec/spec.md](https://github.com/agentready-org/standard/blob/main/spec/spec.md)read 2026-11-04
-   [developers.hubspot.com/docs/cms/start-building/building-blocks/templates/overview](https://developers.hubspot.com/docs/cms/start-building/building-blocks/templates/overview)read 2026-11-04
-   [knowledge.hubspot.com/website-and-landing-pages/use-code-snippets-with-hubspot-content](https://knowledge.hubspot.com/website-and-landing-pages/use-code-snippets-with-hubspot-content)read 2026-11-04
-   [developers.hubspot.com/docs/apps/developer-platform/build-apps/authentication/overview](https://developers.hubspot.com/docs/apps/developer-platform/build-apps/authentication/overview)read 2026-11-04
-   [developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview](https://developers.hubspot.com/docs/cms/start-building/features/serverless-functions/overview)read 2026-11-04
-   [knowledge.hubspot.com/design-manager/add-a-javascript-file-to-hubspot](https://knowledge.hubspot.com/design-manager/add-a-javascript-file-to-hubspot)read 2026-11-04
-   [developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/)read 2026-11-04
-   [vercel.com/kb/guide/make-your-site-readable-by-ai-agents](https://vercel.com/kb/guide/make-your-site-readable-by-ai-agents)read 2026-11-04

Edition

Data

2026-11-04

Reviewed

2026-11-05

Spec

AgentReady v2.0, 273d2d7

Crawl

13,071 rows, 2026-11-04

Ora

132 checks, contract 1.38.0, 2026-11-05

Verify with Ora

The scanner this site recommends for the whole checklist. 132 checks, a score out of 100, no account.

`npx ax@0.10 audit <url> --min-score <n>`

[Why Ora, and its limits](https://agentreadychecklist.com/verify-with-ora/)

Method

-   [How rows, commands and rates are made](https://agentreadychecklist.com/method/)
-   [How an Ora check is matched to a row](https://agentreadychecklist.com/checklist/ora-checks/)
-   [Pass rates by rank band](https://agentreadychecklist.com/data/by-rank/)

Sources and read dates sit at the foot of the page.

Last reviewed 2026-11-05. AgentReady v2.0, read 2026-11-04.
