Skip to main content

Noindex Tag Test

What is it?

A noindex directive, set in the robots meta tag or in an X-Robots-Tag HTTP header, tells search engines to render a page but never include it in their index, which means the page can never appear in search results no matter how strong its content or backlinks. The directive is useful when applied deliberately to thin or utility pages, but devastating when left over from staging or applied to content that should rank. This test checks whether your page is currently excluded from indexes via a noindex directive and where the directive originates.

Why this test matters

A noindex on the wrong page is one of the most common ways important content silently disappears from search results. Staging sites are typically noindexed by default, and the directive is sometimes left in place after launch. SEO plugins often noindex archives, tag pages, or paginated lists by default, which is sensible for some sites but harmful for others. A custom theme can apply noindex globally based on a stale configuration. In every case, the symptom is the same: a page that should rank simply does not appear in search results.

Conversely, noindex is a useful tool when applied deliberately. Internal search results, login pages, thin or duplicate content, and pages that exist for utility rather than for ranking all benefit from being excluded from indexes. The right answer is not "no noindex anywhere" but "noindex exactly where it belongs and nowhere else."

Common situations this test catches

  • Site-wide noindex left over from staging, the most common cause of accidental exclusion.
  • Per-page noindex set in the CMS by mistake, where a SEO toggle was disabled on the wrong page.
  • X-Robots-Tag header set by server config, applying noindex to entire URL paths.
  • Noindex on category or tag pages that should rank, often because an SEO plugin's defaults were never customized.

This test reports whether the page is currently noindexed and where the directive originates. The fix guide below covers removing the directive from the major content management systems, server configurations, and framework metadata APIs, plus how to verify with Google Search Console that the page is now indexable.

Pass rate:

  • Top 100 websites: 99%
  • All websites: 96%
Pass rates of Top 100 US websites
2021

99%

2022

100%

2023

98%

2024

99%

100

75

50

25

0

How do I fix it?

This test fails when the page is being excluded from search engine indexes via a noindex directive in the robots meta tag or X-Robots-Tag HTTP header. A noindex on the wrong page is one of the most common ways important content silently disappears from search results. Fixing this issue means removing the directive from any page that should rank.

Where to make the change

  • Raw HTML: remove <meta name="robots" content="noindex"> from the <head> of pages you want indexed.
  • Server configuration: remove or update X-Robots-Tag: noindex response headers for affected URL paths.
  • WordPress: in the post or page editor, your SEO plugin has a "Search engine visibility" toggle. Make sure it is set to allow indexing. Also check Settings, Reading, "Discourage search engines" — this site-wide flag must be off.
  • Shopify: certain templates and resource types (search results, cart) are noindexed by default and should stay that way. For other URLs, edit theme.liquid to remove the conditional noindex.
  • Headless or framework sites: remove the meta tag from the page's metadata configuration or layout file.

Common causes and how to resolve them

  • Site-wide noindex left over from staging: the most common cause. Disable the global setting after launch.
  • Per-page noindex set in the CMS by mistake: review the page's SEO settings and toggle indexing back on.
  • X-Robots-Tag header set by server config: check the server or CDN rules; remove the header for production URLs.
  • Noindex on category or tag pages that should rank: some SEO plugins noindex archives by default. Override the setting for archives that earn organic traffic.

Best practices

  • Verify with URL Inspection in Search Console: the live test confirms whether Google currently sees the page as indexable.
  • Audit after migrations: staging sites are usually noindexed; verify the directive is removed before traffic resumes.
  • Keep noindex for thin or duplicate pages: not every page should rank. Internal search results, paginated archives, and login pages benefit from noindex.

Dominate search today on Google and AI Engines.

Join 85,000+ SaaS Marketers, Growth Agencies, Content-Led Companies and E-commerce Brands.

See Pricing
Dashboard preview showing SEO site checkup metrics, page group insights, and issue prioritization