AD Search Studio

Technical SEO

Shopify Indexation Bloat: Fixing Collections, Tags and Filters

Key takeaways

  • Most Shopify bloat comes from four sources: collection-scoped product links, tag pages, filter and sort parameters, and internal search.
  • Fix internal links first. Removing the within: collection filter from product cards stops the biggest crawl leak on many themes.
  • Noindex before you disallow. A URL blocked in robots.txt cannot show Google its noindex tag.
  • Judge success in the Page indexing report and Crawl stats over several weeks, not on the day you ship.

Shopify indexation bloat is when Google crawls and stores far more URLs than your store has real pages, mostly products reached through collection paths, tag-filtered collections, filter and sort parameters, and internal search results. The fix is to stop linking to the duplicate URLs, noindex the low-value templates, block pure parameter crawl in robots.txt.liquid once those URLs have dropped out, and confirm it in Search Console's Page indexing report. Most stores need a few theme edits for this, not an app.

I run a bootstrapped Shopify brand myself (Livonna Fashion, occasion wear), and I have done catalogue and category architecture for D2C brands such as Kapiva, Innovist, Clensta and Coal Clean Beauty. The process below is the one I follow on any Shopify store before I touch content.

Where Shopify's duplicate URLs come from

Shopify's URL structure is fixed. You cannot rename /products/ or /collections/, and the platform generates several routes to the same content. These are the ones that cause real bloat.

1. Collection-scoped product URLs

Every product loads at /products/blue-linen-shirt and also at /collections/shirts/products/blue-linen-shirt, /collections/new-in/products/blue-linen-shirt and so on for every collection it belongs to. Shopify canonicalises all of these to the /products/ version by default, which is good. The problem is that many themes build product card links with the Liquid filter within: collection, so every internal link on a collection page points to the collection-scoped version. Google follows those links, crawls the duplicate, reads the canonical and moves on. A product in eight collections can mean eight crawled URLs for one page.

2. Tag-filtered collections

Product tags create URLs such as /collections/shirts/linen, and combining tags gives /collections/shirts/linen+blue. Older themes and some apps expose these as clickable filters, so they get linked and crawled. Most of them are thin: the same products as the parent collection, the same description, a slightly shorter grid.

3. Filter and sort parameters

The Search & Discovery app's storefront filters add parameters like ?filter.v.price.gte=500&filter.v.price.lte=2000, ?filter.p.m.custom.fabric=linen or ?filter.v.option.size=M. Sorting adds ?sort_by=price-ascending. Each combination is a new URL. With five filters and a handful of values each, the number of possible URLs for one collection grows very quickly.

4. Internal search pages

/search?q=anything returns a page for any string a person or bot types. Search result pages have no place in Google's index.

Smaller sources worth checking

  • Variant parameters such as ?variant=123456. These canonicalise to the product and rarely cause trouble on their own.
  • Pagination such as ?page=2. Normal and fine to crawl, but it multiplies with filters and sorts.
  • Near-duplicate products that a store has created as separate products for each colour, with the same copy. This is a content problem, not a URL problem, and it often shows up in the same report.

Why it matters, and when it does not

A small store with a hundred products will not run out of crawl budget in the textbook sense. The cost shows up in other ways. Google spends its visits on duplicates instead of your new collection. It sometimes picks its own canonical when your signals conflict, and that choice is not always the URL you want ranking. Thin tag and filter pages dilute what Google thinks your store is about. And the reports become so noisy that real problems, such as an important collection marked "Crawled - currently not indexed", get lost.

On a larger catalogue the crawl cost becomes direct. In my experience the stores that feel it most are the ones with many overlapping collections, heavy tag use and five or more storefront filters.

Diagnose it first: Search Console and Screaming Frog

Do not start editing robots.txt on a hunch. Get the evidence from two places.

Search Console: Page indexing report

Open Indexing, then Pages, and look at the reasons pages are not indexed. Click into each reason and export the example URLs. These are the statuses that matter on Shopify:

Status in Search ConsoleWhat it usually means on ShopifyWhat to do
Alternate page with proper canonical tagCollection-scoped product URLs, variant URLs, filtered collections. The canonical is working.Fine on its own. If the list is huge, fix the internal links that generate these URLs.
Duplicate without user-selected canonicalPages Google sees as duplicates where no canonical was found or respected, often tag pages or near-identical products.Check the page source for a canonical tag. Noindex tag pages, merge or rewrite near-duplicate products.
Duplicate, Google chose different canonical than userYour canonical says one thing, your links and sitemap say another.Make internal links, sitemap and canonical all point to the same URL.
Crawled - currently not indexedGoogle fetched the page and chose not to index it. Common for thin tag, filter and search URLs, and sometimes for weak collections.If the URLs are junk, noindex or stop linking them. If real products or collections appear here, that is a content quality problem to fix separately.
Indexed, though blocked by robots.txtURLs disallowed in robots.txt that Google indexed from links anyway.Remove the disallow, let Google see a noindex, then reconsider blocking.

Then check two more things. Run your top collection and two or three products through URL Inspection and compare the "User-declared canonical" with the "Google-selected canonical". And open Settings, then Crawl stats, to see which file types and URLs Googlebot is spending its requests on. If parameter URLs dominate the sample, that confirms the problem.

Search Console tells you what Google found. A crawl tells you why. Crawl the store with Screaming Frog using default settings, so it follows internal links the way a bot would, then check:

  • The Canonicals tab, "Canonicalised" filter. If it is full of /collections/.../products/... URLs, your product cards use collection-scoped links.
  • The Inlinks for one of those URLs, to find the exact template (collection grid, related products, search results) that creates them.
  • The URL tab, "Parameters" filter, to see whether filter and sort URLs are being linked as plain anchors.
  • The Directives tab, to confirm which pages already carry noindex.

For a broader pass beyond Shopify-specific issues, my technical SEO audit checklist covers the rest of the crawl.

Free playbook

The Shopify SEO Fix Kit

Find and fix Shopify indexation bloat, then build collection pages that rank.

  • A diagnosis routine using Page indexing, Crawl stats and Screaming Frog
  • A URL pattern table with the right treatment for each Shopify URL type
  • Theme edits for internal links, noindex, canonicals and robots.txt.liquid

Free. Instant access. No spam, unsubscribe any time.

The fix, in the right order

Order matters here. The most common mistake I see is blocking URLs in robots.txt first, which freezes them in the index because Google can no longer crawl them to see any noindex.

  1. Fix internal links to products. In your theme code, search the snippets folder for within: collection. It usually sits in the product card snippet, for example {{ product.url | within: collection }}. Change it to {{ product.url }}. Check related products and quick-view snippets too. This one edit removes the largest source of duplicate crawl on many themes, and breadcrumbs can still show the collection if your theme handles them separately.
  2. Decide which tag and filter pages deserve to rank. Some do. If people search "linen shirts for men" and you have twenty of them, that should be a real collection with its own handle, title, description and internal links, not a tag page. Build those collections first. My post on category page SEO for D2C brands covers how to choose and structure them.
  3. Noindex the rest. In theme.liquid, inside the head, add conditions for the templates you do not want indexed. {% if current_tags %} catches tag-filtered collection pages. {% if template.name == 'search' %} catches search results. Output <meta name="robots" content="noindex"> inside each condition. Check first that your theme or an SEO app is not already printing a robots meta tag, so you do not end up with two.
  4. Check the canonical on filtered URLs. Load a collection with a filter and a sort applied, view the source and read the canonical tag. In my experience most themes using Shopify's canonical_url object point it at the clean collection, but confirm it on your theme before relying on it.
  5. Wait for the noindex to be processed. Watch the "Excluded by 'noindex' tag" count rise in the Page indexing report for the URL patterns you targeted.
  6. Then trim crawl with robots.txt.liquid. Only once the junk is out of the index, block the pure parameter patterns that waste crawl. Details below.
  7. Clean up the sitemap and links. Shopify's sitemap lists canonical product and collection URLs, so it rarely needs work. The things to check are menus, footer links and blog posts linking to tag, filter or collection-scoped URLs. Point them at the clean URL.

Editing robots.txt on Shopify safely

Shopify's default robots.txt already disallows a set of paths, such as cart and checkout pages. Before adding anything, open yourstore.com/robots.txt and read the live file so you do not duplicate rules that are already there.

To change it, open the theme code editor, add a new template and choose robots.txt. Shopify creates robots.txt.liquid with a loop over robots.default_groups that reproduces the default file. Keep that loop. Add your own lines inside the condition for the user agent *, so they are appended to the default rules rather than replacing them.

Typical additions, after checking they are not already covered:

  • A rule for filter parameters, such as Disallow: /collections/*?*filter., if Crawl stats show Googlebot spending heavily on filtered collections.
  • A rule for sort parameters, such as Disallow: /collections/*sort_by*, if sorted URLs appear in your crawl data.

Test any new pattern against real URLs before publishing. A wildcard that is one character too broad can block your collections. Keep a copy of the default file so you can roll back.

How to check the fix worked

Google needs to recrawl the affected URLs, so judge this over weeks, not days. Use this checklist:

  • A fresh Screaming Frog crawl finds no internal links to /collections/.../products/... URLs.
  • The "Alternate page with proper canonical tag" count stops growing, then falls as old collection-scoped URLs are crawled less.
  • Tag and search URLs move into "Excluded by 'noindex' tag".
  • "Duplicate, Google chose different canonical than user" shrinks, and URL Inspection on key products shows the user-declared and Google-selected canonical matching.
  • Crawl stats show a larger share of requests going to products and collections you care about.
  • New products and collections get indexed sooner after launch. Use URL Inspection on a new product to see when it was first crawled.
  • No important collection or product has slipped into "Blocked by robots.txt".

Repeat the crawl every quarter, and after every theme change or new filter app. Theme updates are the most common way collection-scoped links come back. Crawl and indexation fixes were part of my freelance programme for Bombay Shaving Company, alongside long-tail landing page clusters, and the lesson from that kind of work holds for every store: the clean-up only lasts if someone checks it after each change. If you want a second pair of eyes on your store, see how I approach technical and e-commerce SEO.

Abhishek Dwivedi
Written by Abhishek Dwivedi

Founder of AD Search Studio and a Senior SEO Lead with 7 years in search, running SEO and AEO/GEO programmes across D2C, B2B SaaS and banking brands.

View Abhishek's portfolio

FAQ

Commonquestions.

Still unsure? Ask us directly.

Get in touch

Yes. Every product can load at /products/handle and at /collections/any-collection/products/handle, and collections can be loaded with tags, filters and sort parameters. Shopify adds a canonical tag pointing to the main product URL, but the duplicates still get crawled if your theme links to them.

Free AI search audit

See how Googleand AI see you.

Send your site and our founder reviews it personally. You get a clear, prioritised read on what is holding your search growth back.

  • Technical health: crawl, indexation and speed issues that cap growth
  • AI visibility: how ChatGPT, Perplexity and AI Overviews describe your brand
  • Content gaps: the high-intent queries competitors win and you don't
  • The three fixes worth the most revenue, in order

Free, no obligation. Your details are only used to reply to you.

Talk to the founder

Ready to bethe answer?

Tell us what you want to rank for and where growth has stalled. We will tell you straight whether search is the right lever, and what it is worth.

Abhishek DwivediFounder and Lead Strategist, AD Search Studio

Abhishek Dwivedi