137 Pages Crawled but Not Indexed: The Cut We Finally Made
Published August 17, 2026 · By DomainOptic · 6 min read
Where July's Numbers Went
In July we published a case study of our own Search Console data: 100 pages indexed, 120 crawled but not indexed, and a promise to fix causes rather than symptoms. Here is the honest follow-up: it got worse before we acted properly.
By mid-August the property showed 87 indexed and 173 not indexed, with 137 in "Crawled - currently not indexed." Performance for May 15 through August 14: 52 clicks, 21,946 impressions, average position 37.2. The indexed line fell off a cliff around June 11 and never recovered.
The Query That Decided It
We filtered Performance to pages containing /glossary/ over 90 days. The result for all 121 glossary URLs combined:
Not low. Zero. The glossary was 61 percent of our submitted sitemap, the majority of the crawled-not-indexed pile, and it earned nothing at all. Google's own framing of this state is that it reflects a site-level quality judgment, not a page-level accident: a large templated section the crawler keeps visiting and declining to index tells Google something about the whole property.
What We Did
- All 120 glossary term pages are now noindex, follow. They remain on the site for readers who reach them from our tools, and internal links still pass through them. They just stopped competing for the index.
- The glossary sitemap now lists one URL, the hub. Our total sitemap went from 199 URLs to 79, every one of them a page we actually want in search results, which is what Google's sitemap documentation says the file is for.
- We did not bulk-refresh lastmod dates. Google's current guidance is blunt about this: lastmod is trusted only while it is consistently accurate, and it should change only when page content meaningfully changes. Our unchanged sitemaps stayed byte-identical.
What We Deliberately Did Not Do
- No indexing services. The paid "get indexed fast" tier works by pointing crawl-frequency link networks at your URLs. It can force a crawl; it cannot force Google to consider a thin page worth keeping, which was our actual problem.
- No Request Indexing marathon. Google's documentation for crawled-not-indexed says resubmission is unnecessary, and the URL Inspection tool is rate-limited precisely because it was never meant as a bulk lever.
- No sitemap pinging. The ping endpoint has been dead since 2023. If a tool sells you sitemap pings for Google in 2026, it is selling weather reports for a planet that no longer exists.
What Happens Next
Recovery from a site-level reassessment is measured in recrawl cycles, not days. The plan is the boring one that survives audits: fewer, deeper pages; effort concentrated on the pages with a real shot, starting with our domain comparison tool, which already reaches page two on its queries; and earned links to pages that deserve them, starting with first-party research instead of another launch link to the homepage.
If your Search Console shows the same shape, run the numbers before you buy anything: filter Performance to your templated section and see what it actually earns. Ours earned zero, which made the decision simple, if not comfortable.
Check what your site tells search engines and AI
Search Visibility
Continue with visibility evidence
Scan your domain