Internal Link Structure: How To Organize Links For Google And AI Crawlers

Internal link structure for Google and AI crawlers: page levels, link templates, anchors, faceted navigation, JavaScript risk, orphan pages and a quarterly audit.

RankControl10 min read
Internal Link Structure: How To Organize Links For Google And AI Crawlers

A strong guide goes up, gets added to the sitemap, and everyone moves on. Months later it has a handful of backlinks, almost no internal links, and a ranking stuck on page two. That's an internal link structure problem, and it costs you twice now.

Googlebot follows your links to find pages and decide which matter. The AI crawlers running for OpenAI, Anthropic and Perplexity lean on the same links, and they're pickier about how those links get built.

This guide starts with page levels, link templates, anchors and faceted URLs, then moves into what AI crawlers can read, orphan pages and a quarterly audit. Every source here was checked on October 19, 2026.

Strip it down and it's just the map of which pages on your site link to which, and through what kind of link. A page outside that map leans entirely on your sitemap to get found.

Most sites settle into three levels without really planning to.

LevelExamplesIts job in the link map
HomeThe homepageLinks to every hub and gets the most links from other sites
HubsCategory pages, product pages, pillar guidesGroup related pages and link down to each one
ArticlesBlog posts, docs, help pagesLink up to their hub and across to close neighbors

Click depth is how many clicks a page sits from your homepage, and three or fewer is the number everyone repeats. None of the three top-ranking guides for this keyword actually cites a source for that figure, and Google's own SEO Starter Guide doesn't give one either. It only calls links "a crucial resource" for helping Google find your pages. Treat three clicks as a habit worth keeping, since Google has never once said it enforces it as a rule.

Deciding which pages deserve the most links is its own job, covered in our cornerstone content guide. Grouping pages by topic is another, covered in topic clusters vs content hubs. This post is about the wiring between pages once you've decided what matters.

Most internal links on a site come from a handful of templates that repeat on every page, which is why one broken template can wreck thousands of links at once.

TemplateWhat it tells crawlersHow it usually breaks
Main navWhich hubs matter mostMenus built by scripts, or mega menus with 200 links where nothing stands out
BreadcrumbsWhere a page sits in the levelsSchema added to pages that show no trail
In-body linksWhich pages explain a point furtherVague anchors like "click here"
Related postsWhich pages are close neighborsPicked by date instead of topic

Breadcrumbs do something the others don't: they state the hierarchy outright on the page, and hand deep articles a link straight back up to their hub.

A common habit is slapping BreadcrumbList schema across every template and calling it done. An r/WebsiteSEO thread asked whether that schema belongs on every page, and the top reply made a point most guides skip: the markup is supposed to describe a trail a reader can see. Inject it where no trail shows, and it stops matching the page.

r/WebsiteSEO· u/Several_Fly694· Aug 4, 2026

Should Breadcrumb schema (JSON-LD) be added to every single page for optimal SEO?

guys,Quick question regarding Breadcrumbs and Structured Data: I know that setting up Breadcrumbs with BreadcrumbList schema helps Google better understand a site's structure and can generate rich snippets in SERPs. My question is: Is it be...

↑ 8 upvotes19 comments
Via Reddit

Related-post widgets are the template nobody checks. Plenty pull from whatever's newest, so the same handful of recent articles gets linked from every page while older ones sink. Switch the widget to pull by topic, and older pages get links from neighbors that make sense.

Your competitors are getting cited by AI. You're not.

Every day without citation tracking is a day your competitors pull ahead in ChatGPT, Perplexity, and Claude.

Show me who's getting cited →2-minute overview · real case-study numbers

Anchor text that tells crawlers where they land

Google's crawlable links doc, updated December 10, 2025, asks for anchor text that's "descriptive, reasonably concise, and relevant." It warns against "click here" and against cramming keywords into every link.

The clearest data on anchors comes from Cyrus Shepard, who studied 23 million internal links across 1,800 sites and roughly 520,000 URLs for Zyppy. Pages with at least one exact-match anchor got about five times the traffic of pages with none.

So aim one link per key page at the exact words people search, and let the rest vary naturally. A link reading "internal link audit" tells both kinds of crawler far more than one that just says "this post."

The same study found something else worth knowing about raw link counts. URLs at zero to four internal links averaged roughly two clicks from Google Search, while URLs at 40 to 44 pulled in about four times that. Past roughly 45, traffic dips again. Shepard calls his own work a correlation study, and he's right to hedge. Strong pages collect links partly because editors enjoy linking to them, so cause and effect may run both ways.

Faceted navigation and the crawl it wastes

Shop and listing filters are where link structure falls apart at scale. Every combination of color, size and price can spin off into its own URL, and a crawler can't tell which are worth fetching without fetching them.

In a December 2024 Search Central post, Google's Gary Illyes wrote that faceted navigation is "by far the most common source of overcrawl issues site owners report to us." Google later folded that post into a standing doc, last updated December 18, 2025, which offers two real paths forward.

  1. Block it. Disallow filter URLs in robots.txt, or push filters into URL fragments, the part after #, which never affects crawling. Keep crawlable links pointed only at the unfiltered listing and each product.
  2. Make it crawlable. Use the standard & between parameters, hold filters in the same order every time, and return a proper 404 for empty results rather than a redirect. Use rel="canonical" to point filtered variants back at the main page.

An r/TechSEO thread about one small shop's filters landed on a calm consensus: crawl budget isn't a real concern for a small site, and a few thousand filter URLs is fine. A few hundred just need their canonicals fixed. Millions is where you reach for robots.txt first.

What AI crawlers can and can't follow

Most top-ranking guides give AI crawlers a single throwaway sentence. That's a real gap, since these bots may not run the scripts Googlebot runs. Google's own doc says links added through JavaScript still count once they render as a proper <a> element with an href.

The AI crawlers aren't nearly as upfront. I read the crawler pages from OpenAI, Anthropic and Perplexity on October 19, 2026. Each explains what its bot is for and how to block it, but none says whether it runs JavaScript. Anthropic's page carried a date of April 7, 2026; the other two carried none.

The only sizable measurement published is already getting old. Vercel's December 2024 study of traffic on its own network found that none of the major AI crawlers rendered JavaScript, naming GPTBot and ClaudeBot among them. GPTBot fetched script files on 11.5% of its requests, and ClaudeBot on nearly a quarter of its own, but neither ran the code. That data is nearly two years old and covers only Vercel sites, so read it as a warning sign, not proof of how these bots behave today.

Call this the view-source test. Open a page, view its raw source before any script runs, and search for your main nav links. Plain <a href> tags mean every crawler can follow them. A menu that only appears after scripts load means the AI crawlers likely see a page with no way out.

Every vendor runs more than one bot, too. Per OpenAI's crawler docs, GPTBot gathers training data while OAI-SearchBot finds pages for ChatGPT search: blocking GPTBot alone leaves you in ChatGPT search, blocking OAI-SearchBot alone takes you out of it. Anthropic splits traffic into ClaudeBot, Claude-User and Claude-SearchBot, and Perplexity keeps PerplexityBot and Perplexity-User separate too. Our guide on whether to block AI crawlers covers that call, and auditing AI crawlers in server logs shows which bots actually reach your pages.

RANKCONTROL

200+ SaaS teams already track their AI citations.

They know exactly when ChatGPT mentions their brand, and when it stops. Do you?

Show me the plan →One plan · everything included

An orphan page has zero internal links pointing to it. A thin-linked page has exactly one. In Ahrefs' 2023 audit of just over a million domains, Patrick Stox found that 66.2% of sites had at least one page hanging on a single dofollow internal link. Ahrefs sells a site audit tool, so finding problems suits its business, though a million domains is still a large sample.

Don't link every orphan the moment you find it, though. An r/bigseo thread on cleaning up orphan pages settled on advice most agreed with: check what each page actually is first. Old campaign pages, thin variants, paginated lists and tag archives usually need a noindex or outright removal instead of a fresh batch of links.

What the orphan isWhat to do
A page that still answers a real questionLink it from its hub and from two or three close articles
A near copy of a better pageRedirect it to that page
A dead campaign or thin pageNoindex it or remove it

For pages you keep, one r/WebsiteSEO user suggested links from at least three other pages as a sane floor.

Most people only look at internal links once something's broken. An r/seogrowth thread asking how often people check found most reach for it only when a page underperforms, with just a few running real monthly or quarterly passes. One reply flagged a useful signal: a page whose impressions keep climbing while its position stays stuck on page two.

r/seogrowth· u/Individual-Hold733· Sep 23, 2026

How often do you actually check your internal linking?

↑ 24 upvotes33 comments
Via Reddit

A calendar beats waiting around for a drop to notice. Once a quarter, run through these five steps.

  1. Open Search Console's Links report and export the "Top linked pages" table under internal links.
  2. Sort fewest links to most. Pages you care about near the top of that list are under-linked.
  3. Crawl the site and compare what it reaches against your sitemap. Sitemap pages the crawl never touches are your orphans.
  4. Run the view-source test on one page from each template.
  5. For every page stuck on page two, add one link from a strong related page with a clear anchor. Our guide to pages stuck on page two covers the rest.

Google Search Console Help page for the Links report, with an Open the links report button and notes saying links are grouped by canonical URL, duplicate links are combined and tables stop at 1,000 rows

Google's Links report help page says tables stop at 1,000 rows and show a sample of links, not all of them. Duplicate links from the same source to the same target only count once. On a big site, trust your own crawl over the report. Our walkthrough of backlinks in Search Console covers the external half.

When nothing fits any of this, leave it alone and note it so next quarter's audit skips past it. By hand, the first pass on a site with a few hundred pages takes about a day, and each quarterly check after that takes a few hours.

Doing it by hand or having it done

The first audit is the easy part. Keeping new pages wired in is harder, since every new article starts life as an orphan until something links to it.

RankControl's content engine handles that for every article. Each new article links to existing pages on your site, found by scanning your sitemap, and to other articles RankControl has already published.

You can run this audit yourself every quarter with Search Console, a crawler and a spreadsheet. Or RankControl's agents can write and link new articles every month while you fix the templates.

RANKCONTROL

How often does ChatGPT mention your brand?

Most founders have no idea. The answer might surprise you.

Show me my mentions →50 tracked questions · all 7 AI models

Frequently Asked Questions

The map of which pages on your site link to which, and through what kind of link. Most sites run three levels: homepage, hubs, articles. Both Google and AI crawlers walk that same map to find your pages.

Three or fewer is the common rule of thumb, though no top-ranking guide cites a real source for it and Google's own Starter Guide gives no number at all. Treat it as a habit, not a hard rule.

Assume not. None of OpenAI, Anthropic or Perplexity say whether their bots run JavaScript, and a Vercel study found none of the major ones did. Keep your main links as plain HTML.

Crawl your site and compare what it reaches against your sitemap. Anything listed but never reached likely has no path a crawler can follow, so check what the page actually is before you link it.

It can. Google's Gary Illyes called it the most common overcrawl complaint site owners report. Either block filter URLs in robots.txt or make them crawlable with consistent parameters and canonicals.

RANKCONTROL

Your competitors are already optimizing for AI search

Content that ranks on Google and gets cited by AI search engines. Published on your domain. Citations tracked weekly.

Related Articles

Content Relevance: How Google And AI Engines Judge A Page

Nov 14, 2026 · 8 min read

Content Relevance: How Google And AI Engines Judge A Page

What content relevance actually means to Google and to AI engines, in their own words: keyword matching, content beyond the keyword, interaction data and passages for Google, and query fan-out for AI Mode and ChatGPT. Plus what we found checking top and tenth-place pages for three searches.

Product Page SEO Content That Works In Google And AI Shopping

Nov 13, 2026 · 9 min read

Product Page SEO Content That Works In Google And AI Shopping

The content side of product page SEO: unique descriptions over manufacturer copy, titles, answers to buyer questions, reviews, images and the product data AI shopping reads, with Google's and OpenAI's own guidance and a check of what nine live product pages actually carry.

Ecommerce SEO Audit: A Checklist For Google And AI Shopping Answers

Nov 11, 2026 · 9 min read

Ecommerce SEO Audit: A Checklist For Google And AI Shopping Answers

An ecommerce SEO audit checklist for any store platform: crawl and URL parameters, faceted navigation and pagination, product structured data, review markup rules, Merchant Center and free listings, out-of-stock handling and readiness for ChatGPT shopping, each item sourced to Google or OpenAI documentation.

Content Audit Template: What To Keep, Update, Merge, Or Delete

Nov 6, 2026 · 9 min read

Content Audit Template: What To Keep, Update, Merge, Or Delete

A content audit template you can copy: the columns to pull from Search Console and GA4, the rules for keeping, updating, merging, redirecting or deleting each page, and how Google says to remove or redirect pages safely.

How A/B Testing A Landing Page Affects SEO Rankings And Conversions

Nov 4, 2026 · 10 min read

How A/B Testing A Landing Page Affects SEO Rankings And Conversions

A/B testing a landing page won't hurt SEO rankings if you split traffic the right way. Google's four rules, what AI crawlers see, and how to test safely.

Best Shopify SEO Tools In 2026 For Google And AI Search

Nov 2, 2026 · 12 min read

Best Shopify SEO Tools In 2026 For Google And AI Search

The best Shopify SEO tools in 2026, checked on each vendor's pricing page and App Store listing: what Shopify already does for free, which apps fix what, and which tools write and publish the pages.

Technical SEO Audit Checklist For Google And AI Crawlers

Oct 31, 2026 · 10 min read

Technical SEO Audit Checklist For Google And AI Crawlers

A technical SEO audit checklist that covers Googlebot and AI crawlers, built from Google and crawler docs and our own October 19, 2026 audit of 50 business sites: robots rules, firewalls, JavaScript, sitemaps, structured data and the soft block a status code won't show.

How Long Does SEO Take To Work? Real Timelines For New And Older Sites

Oct 30, 2026 · 8 min read

How Long Does SEO Take To Work? Real Timelines For New And Older Sites

How long does SEO take? We checked the ages of 309 pages on Google's first page for 40 searches. The median page was 2.2 years old, and only 3% sat on domains younger than two years.

Shopify SEO: How To Rank Your Store In Google And ChatGPT

Oct 30, 2026 · 9 min read

Shopify SEO: How To Rank Your Store In Google And ChatGPT

Shopify SEO from real ranking pages: we pulled the Shopify collection and product pages that rank on Google for eight product searches, and the Shopify product page ChatGPT cited, to see what they have in common.

THE SIGNAL

Insights on AI and Google search strategy. No fluff.

Get the latest on AI citations, Google rankings, and content strategy.

No spam. Unsubscribe anytime.