Indexability

Indexability is the technical eligibility of a page to be included in a search engine's index. A page is indexable when it returns a 200 status, allows crawler access, declares itself indexable via Robots Meta Tag (or absence of noindex), and has a self-referencing or compatible Canonical Tag.

Indexability is distinct from indexed. A page can be perfectly indexable yet not appear in Google's index because Google decided the page is low quality, thin, duplicate of something already indexed, or below the discovery threshold. This is a common confusion in audits — "the page is technically indexable, why isn't it indexed?" — and the answer is that indexability is necessary but not sufficient.

The standard indexability checklist: HTTP 200 response (no 4xx, 5xx, or redirect chains); allowed in Robots.txt; no "noindex" in robots meta or X-Robots-Tag header; canonical tag points to self or a logical canonical URL (not a redirected or noindexed destination); content is renderable without JavaScript or, if JavaScript-dependent, server-side rendered or pre-rendered for crawlers; not blocked by login walls; not deliberately deindexed via Search Console's removal tool.

Common indexability bugs: staging environments accidentally left with site-wide noindex when promoted to production; canonicalising all paginated pages to page one (which Google treats as a signal to drop the deeper pages); pointing canonicals at redirected URLs; using robots.txt to "noindex" pages (which prevents the crawler from seeing the actual noindex directive); and serving different content to bots versus users (cloaking), which can flag the site for manual review.

For sites at scale, indexability monitoring is best done through Search Console's Page Indexing report (formerly Coverage). The report groups URLs into Indexed, Indexed though blocked by robots.txt, Discovered – not indexed, Crawled – not indexed, and various error states. Each bucket points to a different root cause.

Audit indexability per template, not per URL. Most indexability bugs are template-level — once you find one broken pattern on one URL, you typically find the same bug on thousands.