Robots Meta Checker
Score whether crawlers may index this URL from meta robots and X-Robots-Tag — not a ranking trick.
What this tool gives you
Check robots meta
Fetch a public page or paste the head. The checker scores index/follow hygiene — not a ranking folklore tool.
What this checker looks for
meta robots and X-Robots-Tag say whether a URL may be indexed. They do not make ChatGPT cite you.
index / noindex
Public pages default to index. Thank-you URLs should noindex.
follow / nofollow
nofollow only when this page should not pass crawl credit.
No conflicts
Never ship index and noindex on the same URL.
X-Robots-Tag
Headers cover PDFs and images that have no HTML head.
googlebot
A googlebot override is optional. Keep it consistent.
Snippet caps
max-snippet and max-image-preview are optional, not ranking levers.
How to use the checker
Public pages can stay silent. Private or thank-you URLs need an explicit noindex.
Check the live page
Fetch the public URL or paste the head from view-source.
Name the intent
index,follow for public URLs. noindex on thank-you, search and account pages.
Recheck after CMS changes
Plugins inject noindex silently. Re-run after launches.
What healthy robots meta usually includes
One intent. No index/noindex clash. Optional snippet caps. Headers for non-HTML files.
| Part | Job | Default for public sites |
|---|---|---|
| meta robots | Index this HTML URL? | Omit, or index, follow |
| X-Robots-Tag | Index this HTTP response? | Omit unless the file has no HTML |
| noindex | Keep this URL out of the index | Thank-you, search, account, staging |
| nofollow | Do not pass crawl credit | Rare on public marketing pages |
| none | Shortcut for noindex, nofollow | Same as both flags together |
| max-image-preview | Share-card image size | large, or omit |
Related GEO pages
Decide indexability, then lock crawl access, then name the canonical.
AI Crawler robots.txt Checker
Confirm GPTBot, ClaudeBot, PerplexityBot and Google-Extended are not blocked.
Canonical URL Checker
Score one absolute HTTPS rel=canonical and matching og:url.
JSON-LD Checker
Score schema.org identity, page type and review hygiene.
GEO Visibility Checklist
Score citation-ready content, entity clarity and weekly mention tracking.
hreflang Checker
Score BCP 47 hreflang links, absolute HTTPS hrefs and x-default.
XML Sitemap Checker
Score sitemap.xml loc hygiene: HTTPS URLs, unique paths and lastmod.
Twitter Card Checker
Score twitter:card, title, description and HTTPS twitter:image.
Tools Lab
More generators, calculators and GEO workflows.
Robots meta FAQs
Does a robots meta tag make ChatGPT cite my page?
No. robots meta and X-Robots-Tag only say whether crawlers may index or follow. Citations still depend on crawl access, answer-ready content and corroboration.
Do public pages need meta robots?
No. Missing the tag means index, follow. Add an explicit tag when you want snippet caps, or use noindex on thank-you, search and account URLs.
What is the difference from robots.txt?
robots.txt blocks crawling of URL paths. meta robots and X-Robots-Tag control indexing of one already-fetched URL. A Disallow cannot replace noindex on a URL that still gets linked.