Content strategy

Why your own pages compete for the same AI answer

Two of your passages saying nearly the same thing split the signal rather than doubling it. Here is how to find them and what to do.

Lawrence Dauchy Lawrence Dauchy · · 10 min read
Illustration for Why your own pages compete for the same AI answer

Publishing a second page about a topic you already cover usually makes you less visible in AI answers, not more. Retrieval selects passages, and two of your own passages saying nearly the same thing in nearly the same words split the signal rather than doubling it. SQSEO surfaces this the moment you map your prompt set against your own content: the questions where you rank worst are frequently the ones you have answered three times.

Cannibalisation moved from pages to passages

Classic SEO had a version of this problem. Two pages targeting one keyword competed, and the fix was consolidation or clear differentiation.

The AI search version operates one level down. Your pages are chunked into passages, and it is passages that compete. That means two pages can coexist perfectly well while a section inside each of them competes, and it means a single long page can compete with itself if it covers the same ground twice in different sections.

Retrieval works by comparing an encoded query against encoded passages, the mechanism established by dense passage retrieval and measured across models in benchmarks such as MTEB. When several candidate passages sit at almost the same point in that space, none is clearly the best match, and the practical outcome is that the engine may take one arbitrarily, take a competitor’s clearer passage instead, or blend two of yours into something you did not write.

What duplication actually costs you

SituationWhat happens in retrievalVisible symptomFix
Two pages, same question, similar depthSimilar vectors, no clear winnerInconsistent citation, different URL each runConsolidate into one, link from the other
One long page, topic covered twiceTwo near identical chunksVague answers citing your pageDelete one, deepen the other
Series of posts each restating basicsMany shallow matching passagesCited for basics, never for specificsKeep one primer, make the rest specific
Localised pages with same contentDuplicate across languagesWrong language version citedWrite natively per market
Product page and blog post overlapCommercial and editorial competeBlog cited for buying queriesDifferentiate by intent

The row that surprises teams most is the third. Publishing consistently is good advice, and it turns into a problem when every post opens with three paragraphs defining the category. Those introductions are near identical passages across dozens of URLs, and collectively they teach retrieval that your site is a source of definitions rather than of specifics.

How to find your own competing passages

You do not need a tool. You need a list of questions and a list of pages.

Write out the questions your site actually answers, one line each, phrased as a buyer would ask them. Then for each question, list every URL on your site containing a section that answers it. Any question with more than one URL at similar depth is a candidate.

The second pass is to read the competing sections side by side. Sometimes they genuinely differ, one for beginners and one for practitioners, and the fix is to make that difference explicit in the opening sentence of each. Often they are the same answer written twice, and one should become a link.

A quick proxy when the site is large: search your own domain for a distinctive phrase from the question. If several pages return with substantially the same passage, you have found a cluster.

Consolidate at section level, not page level

The classic instinct is to merge two pages into one and redirect. That is often too blunt now, because the pages may serve different purposes even while one section overlaps.

The lighter move is to remove the overlapping section from the weaker page and replace it with a sentence and a link. The page keeps its purpose and its URL, and the topic now has one canonical passage on your site rather than two competing ones.

Choose the survivor by retrieval history rather than by which page you prefer. The page already being cited has accumulated the signals, and moving the canonical answer to a fresher page means competing with your own incumbent. This is the same reasoning behind updating old content rather than republishing it.

Differentiation is usually better than deletion

Deleting content feels decisive and is frequently wrong. Two pages covering adjacent ground can both be valuable if each is sharpened to a distinct question.

The test is whether you can write, in one sentence, who each page is for and what specific question it answers, without the two sentences overlapping. If you can, rewrite the opening of each to say exactly that, and trim the parts that stray into the other’s territory. If you cannot, one of them is redundant.

Sharpening usually means getting more specific rather than broader. Two general pages compete; a general page and a narrow one do not, because their passages land in different regions of the space. Specificity is what separates them, which is the same property that makes any single passage retrievable at all, and the same logic behind writing RAG friendly content.

The introduction problem

Most content management workflows encourage every article to stand alone, which produces a definitional preamble on every post. Across a hundred posts that is a hundred near identical passages.

The fix is not to remove context, since chunks do need to carry their own subject. It is to make the context specific to that article rather than generic. Instead of three paragraphs defining the category, one sentence naming the subject in the context of this article’s particular question. That preserves chunk independence without manufacturing duplicates.

A useful rule: context should orient the reader to this question, not to the field. If the opening paragraph could be moved to any other article on the site without editing, it is a duplicate passage.

Programmatic and templated pages need special care

Sites generating pages from a template, one per city, per integration, per use case, create duplication at scale by construction. The template text is identical across hundreds of URLs and only the variable parts differ.

Where the variable content is genuinely substantial, the pages are fine. Where it is a name swapped into boilerplate, every page produces effectively the same passage, and the set collectively matches nothing well. Search engines have long treated this as thin content, and Google’s own framing of scaled content abuse applies to the same behaviour.

The practical bar is whether each page contains at least one passage that could only have been written about that specific variant. If not, fewer and deeper pages will outperform the set.

Intent collision between commercial and editorial pages

A distinct flavour of self competition happens between a product page and a blog post covering the same ground. Both are yours, both are legitimate, and they answer the same question with different motives.

The blog post usually wins retrieval, because it is written to explain and therefore contains more complete claims, while the product page is written to persuade and contains more positioning. That sounds fine until you notice what it means: buying intent queries get answered from an educational page that does not mention pricing, availability or how to start.

The resolution is to split by intent explicitly. Let the educational page own the how and why, and make sure the commercial page owns the what it costs, who it suits and how to begin, in prose rather than in interface elements. Then link them, so a reader arriving at either can reach the other. That division also stops the two pages producing similar passages, because their claims genuinely differ.

Series, hubs and the pillar that repeats its spokes

Hub and spoke structures are good for navigation and risky for duplication. The failure mode is a pillar page that summarises every spoke in enough depth to answer the same questions the spokes answer.

A pillar that works is an index with orientation: it says what each spoke covers and who should read it, and it answers the one question none of the spokes answer, which is usually how the pieces fit together. A pillar that competes is a long article restating each spoke’s conclusions. The first produces one distinctive passage plus clear routes onward. The second produces a diluted duplicate of every spoke.

The same applies to series. If part four opens by recapping parts one to three, that recap is three duplicate passages. Link instead, and trust readers arriving mid series to follow a link, which they will.

Fixing duplication is cheaper than publishing more

The instinctive response to poor AI visibility is to publish more, and on a site that already has overlapping coverage that instinct makes things worse. Each additional page on a covered topic adds another near identical passage to the pool your own content is competing in.

Auditing existing coverage first is faster and cheaper than a content sprint, and it frequently frees capacity. The forty post example below took two weeks of editing against what would have been months of new writing, and it moved more. Research on generative engine optimization points the same way in a different register: what changes how engines use a source is the quality and explicitness of the claims inside it, not the number of documents carrying them.

The planning rule that falls out of this is to check whether a question is already answered on your site before commissioning anything, and if it is, decide whether to sharpen the existing answer rather than add a competing one.

Measuring whether consolidation worked

Track two things before and after: which URL is cited for each target question, and how consistently. The improvement from fixing duplication shows up first as consistency, because the failure mode was arbitrary selection among similar candidates.

Use equal run counts before and after, and hold the prompt set fixed, or the comparison is void. Expect a lag: the old passages remain in caches and indexes for weeks after you edit them, so a fair read needs a month. The full timeline is set out in how long it takes to appear in AI answers.

Also watch for the opposite outcome. If consolidation reduced coverage, because the removed section was the only thing matching a related query, citations for that adjacent question will drop. That is recoverable by restoring a sharpened version of the section, targeted at the adjacent question specifically.

A worked example: forty posts, one answer

A company had 40 blog posts on one subject area and was cited for general definitional queries but never for buying queries.

The audit mapped 18 buyer questions against those posts. Fourteen of the questions had three or more posts each containing a section that answered them, all at similar depth, all opening with the same category definition.

The consolidation took two weeks. Each question got one canonical section on one page, chosen by existing citation history. The other posts kept their unique material and replaced their overlapping sections with a sentence and a link. Generic introductions were replaced with article specific openers.

Nothing new was published. Across the following six weeks, citation consistency for the 14 questions rose sharply and four buying queries began citing the company for the first time, because the canonical passages were finally distinct enough to match a specific query rather than a definitional one.

Key takeaways

Cannibalisation now happens between passages, so two pages can coexist while their sections compete, and one long page can compete with itself. Near identical passages produce arbitrary selection, blended answers, or a competitor’s clearer passage winning instead. Map your buyer questions against the URLs that answer them, consolidate at section level rather than merging whole pages, and pick the survivor by citation history rather than preference. Replace generic introductions with article specific ones, since a preamble that could sit on any post is a duplicate passage by construction.

Frequently asked questions

Sources

  1. Dense Passage Retrieval for Open-Domain Question Answering (Karpukhin et al.)
  2. MTEB: Massive Text Embedding Benchmark (Muennighoff et al.)
  3. Google Search Central: Spam policies for Google web search
  4. GEO: Generative Engine Optimization (Aggarwal et al.)

Frequently asked questions

Can my own pages compete with each other in AI search?

Yes, and it happens at passage level rather than page level. Two pages can coexist fine while a section inside each competes, and one long page can compete with itself. Near identical passages sit at almost the same point in the retrieval space, so none is clearly best and selection becomes arbitrary. SQSEO surfaces this when you map prompts against your own content.

How do I find duplicate passages on my site?

List the questions your site answers as a buyer would phrase them, then for each question list every URL containing a section that answers it. Any question with two or more URLs at similar depth is a candidate. Read the competing sections side by side: either they genuinely differ and you sharpen the difference, or one becomes a link.

Should I merge duplicate pages or delete one?

Usually neither. Remove the overlapping section from the weaker page and replace it with a sentence and a link, keeping both pages and both URLs. Full merges are too blunt when the pages serve different purposes and only one section overlaps. Choose the surviving canonical section by citation history, not by which page you prefer.

Why are generic introductions a problem?

Because a preamble defining the category appears on every post, producing dozens of near identical passages across your site. Collectively they teach retrieval that you are a source of definitions rather than specifics. Keep context, but make it specific to that article's question: if the opening could move to any other post unedited, it is a duplicate passage.

Do templated or programmatic pages cause this?

By construction, when the variable part is thin. If each page is boilerplate with a name swapped in, every page yields effectively the same passage and the set matches nothing well. The bar is whether each page contains at least one passage that could only have been written about that specific variant. If not, fewer and deeper pages perform better.

When should you not consolidate overlapping content?

When the two versions genuinely serve different readers or different depths, and you can state each page's distinct question in one non overlapping sentence. The limit of consolidation is that removing a section can cost you an adjacent query it was quietly matching, so watch for citation drops on related questions and restore a sharpened, narrower version if they appear.

Find the longtail searches your competitors ignore

Turn one seed keyword into hundreds of intent-grouped queries across SEO, AI Overviews, and GEO. Free forever for core research.

Generate free longtails