"Crawled - Currently Not Indexed": Why Directory Pages Get Skipped and How to Fix It
Directories and pSEO sites see whole groups of pages land in Crawled - currently not indexed. How to diagnose the status in batches by page template, decide what should be indexed, and fix the pages that should rank.
You open Search Console, click Pages, and there it is: a long grey bar labelled Crawled - currently not indexed. On a directory, that bar is rarely ten URLs. It is often hundreds of listing pages, or whole category branches, that Google fetched, read, and decided not to keep.
This guide is for directory and programmatic sites specifically. Generic advice ("improve your content quality") is not wrong, but it does not tell you which of your 4,000 pages to touch first. Here is a way to diagnose the status in batches, by page type, and the fixes that match what you find.
What "Crawled - currently not indexed" actually means
Google's own definition is short. In the Page indexing report documentation, the status means the page was crawled by Google but not indexed. Google adds that it doesn't index all pages across the web, so this is a common message for many sites and doesn't necessarily indicate an issue that needs attention.
Two things follow from that.
Google can reach the page. This is not a robots.txt block, a 404 or a server error. Those have their own statuses. Googlebot loaded the URL and looked at it.
Google chose not to keep it, for now. Nothing in the report tells you why. That is the frustrating part, and it is why you need a method instead of a checklist.
It is also different from its neighbour, Discovered - currently not indexed, where Google knows the URL but has not crawled it yet. Google's documentation says that status usually means a crawl was expected to overload the site and was rescheduled. Crawled means the visit happened. Discovered means it did not.
Why directory pages land here so often
A directory produces pages from data. Every new listing, every category, every filter combination can become a URL. That is the strength of the format and also the reason this status shows up so much.
The usual patterns on directory sites:
- Listing pages with almost nothing on them. A name, a one-line description, a website link. The same layout as 3,000 other pages on your site, with very little that differs.
- Category or location pages with one or two entries. A page for "Coworking in Ghent" with a single listing does not answer the query better than that listing does.
- Near-duplicates created by filters and sorting. Google's documentation names this case directly: pages that filter or sort a common collection, with parameters like color=green or sort=price, probably shouldn't be indexed.
- Pages that are only reachable from the sitemap. If the only internal link to a listing sits on page 14 of a paginated category, Google sees a page your own site does not seem to value.
None of these are bugs. They are signals about how much each page adds. Fixing the status means changing those signals for the pages that deserve to rank, and accepting that some pages should not be indexed at all.
Step 1: don't trust the example list to be complete
The Page indexing report shows example URLs for each status, and Google is explicit that this list is limited to 1,000 rows and isn't guaranteed to show all URLs with that issue. On a 300-page directory that is fine. On a site with 12,000 listings, the 1,000 examples are a sample, not your problem set.
So before fixing anything, get the full picture:
- Export the examples for Crawled - currently not indexed from the report.
- Pull every URL from your sitemap.
- For URLs that matter and are not in the export, check them one by one with URL Inspection, or in batches with the URL Inspection API.
The API has a per-site quota of 2,000 inspections per day and 600 per minute (Search Console API usage limits, Google for Developers, read on 10/11/2026). For a 10,000-page directory that means about five days to inspect everything once. Plan it as a batch job, not a one-off afternoon.
Step 2: group the URLs by page template
This is the step most guides skip, and it is the one that makes a directory manageable.
Tag every non-indexed URL with its template: listing, category, sub-category, location, tag, filter, blog post. Then count. You usually get a very uneven result. For example, a site might find that most of its skipped URLs are listing pages in two thin categories, a large group are tag pages nobody links to, and only a handful are blog posts.
That breakdown tells you where the fix lives. You do not fix 2,000 listing pages one at a time. You fix the listing template, and the data behind it.
A useful second cut is by category. If listings in one category are indexed and listings in another are not, compare them. The difference is almost always the amount of distinct data per listing, or the number of internal links pointing in.
Step 3: decide which pages should be indexed at all
Not every URL deserves a place in Google's index, and Google says so: it's fine for a URL not to be indexed for the right reasons, such as a duplicate, a filtered view, or a page with no meaningful information.
Go through your template groups and sort them into three buckets:
- Should rank. Category pages with real depth, listings with complete data, guides.
- Should exist but not be indexed. Sort orders, filter combinations, internal search results, empty or near-empty tag pages. Use noindex or a canonical to the main version, and remove them from the sitemap.
- Should not exist. Expired listings with nothing left on them, categories with zero entries. Remove or redirect them. A sitemap full of these makes the useful URLs harder to spot.
Shrinking the set of URLs you ask Google to index is often the fastest improvement, because it stops you from spending effort on pages that were never going to rank.
Step 4: fix the pages that should rank
For the "should rank" bucket, the fixes are about making each page clearly distinct and clearly important.
Give each listing data no other page has. Typed attributes specific to your niche (opening hours, price range, accessibility, supported integrations, whatever your visitors compare on) turn a listing into something worth indexing. Long generic intros rarely do. We covered this in more detail in Directory SEO in 2026: Strategies That Actually Work.
Set a minimum for category pages. If a category or location page has fewer listings than your threshold, merge it into its parent or keep it out of the index until it fills up.
Link to the pages you want indexed. Every listing should be reachable from its category in a few clicks, and related listings should link to each other. Pages that only exist in the sitemap look orphaned. See Internal Linking for Directories: The Structure Google Rewards for the hub structure.
Clean the sitemap. Only canonical, indexable URLs. Google's sitemap documentation says it uses lastmod when it is consistently and verifiably accurate, and ignores priority and changefreq. So set lastmod to the real date of the last significant change, not to today's date on every build.
Check the rendered page. In URL Inspection, run a live test and look at the rendered HTML. On JavaScript-heavy directories, the content Google sees is sometimes much thinner than what a visitor sees.
Step 5: validate, then measure by template
Once a template is fixed, use Validate fix in the report. Google's documentation says validation typically takes up to about two weeks and sometimes longer. A practical tip from the same page: submit a sitemap containing only your most important pages and filter the report by it before validating, so the check runs on a smaller set.
Then measure the same way you diagnosed: indexed count per template, per category. If listings in your fixed category move to Indexed and the others don't, you have evidence that the change worked, and a template to repeat.
Requesting indexing URL by URL has its place for a few key pages. It does not scale to a directory, and Google's documentation is clear that indexing is never instant, even when you submit a crawl request directly.
What not to do
- Don't mass-request indexing for thousands of thin pages. If the page did not earn a place the first time, asking again changes nothing.
- Don't block the pages in robots.txt to hide them. Google recommends noindex for keeping a page out of the index, and a robots.txt block stops Google from seeing that noindex.
- Don't panic over a few URLs. On a large site, some pages in this status is normal. Look at the trend for the templates that matter.
FAQ
Is "Crawled - currently not indexed" a penalty?
No. It is not a manual action and it does not mean your site is penalised. It means Google crawled the page and chose not to index it for now. Manual actions have their own report in Search Console.
How long does it take for these pages to get indexed after a fix?
There is no fixed delay. Google says validation of a fix typically takes up to about two weeks, and longer in some cases. Pages are reconsidered when they are recrawled.
Should I delete the pages that are not indexed?
Only the ones with no value: empty categories, expired listings, duplicates. Pages that should rank need better data and better internal links, not deletion.
Can I check more than 1,000 URLs?
Yes. The report's example list stops at 1,000, but the URL Inspection API lets you check up to 2,000 URLs per day for one site (Google's published quota, read on 10/11/2026).
Does a sitemap guarantee indexing?
No. A sitemap helps Google find your URLs. Whether they get indexed depends on the pages themselves.
Where to go next
Start with the count by template. Once you know which part of your directory Google skips, the fix is usually one template and one dataset, not thousands of pages.
Run a directory? DirectoryFast is building an indexing check for directory sites: connect Search Console and your sitemap, and see which pages to fix, by template. See what DirectoryFast is building →
Related reading
- Directory SEO in 2026: Strategies That Actually Work
- Internal Linking for Directories: The Structure Google Rewards
- The Free Tier Trap: Is Your Directory Even Indexed?
- Programmatic SEO for Directories in 2026: What Still Works
Sources
- Google Search Console Help, Page indexing report: https://support.google.com/webmasters/answer/7440203 (read on 10/11/2026)
- Google for Developers, Search Console API usage limits: https://developers.google.com/webmaster-tools/limits (read on 10/11/2026)
- Google Search Central, Build and submit a sitemap: https://developers.google.com/search/docs/crawling-indexing/sitemaps/build-sitemap (read on 10/11/2026)