How Do Search Systems Decide Which Websites Matter?

Millions of pages on the web say much the same thing. So how do Search Systems like Google decide which ones matter? How do you differentiate yours above all others?
Diagram showing how search engines evaluate web pages through crawling, indexing, relevance and authority, and how internal website links influence search visibility.

Scattered pages left to chance beside a house built on internal links that lead up to the website’s most important page.Don’t Leave Your Website’s Success to Chance

You wouldn’t build a house without a foundation and a plan. A website is no different. The pages that matter most to the business shouldn’t be left for Google to discover by chance.

If you want to be found on the web, you need to improve your chances of being discovered for the important pages. Every time someone searches for something, search systems must decide which websites and pages are most relevant to that search. Your website is competing with many others for that opportunity. Being found is therefore not guaranteed. It is a question of probability.

Gordon Barker

Founder of own digital agency

I’m Gordon Barker. I’ve worked in SEO for 30 years, since founding my own digital business, Epnet, in South Africa in 1997. Now based in the UK, I analyse website structure using the same kind of network maths search systems rely on, and explain it in plain English.

Examples:

A website shown first as separate pages, then as a linked network where a general page gets the most weight and the key page gets less than it should.Your domain is a network of knowledge

A website is more than a collection of individual pages. It is a network of connected information in which the relationships between pages help search systems discover content, understand subjects and identify which pages may be important.

Graph theory provides a way to examine these relationships, while Markov chain models help us understand how movement and probability can be distributed across a website’s internal link structure.

By examining these relationships, we can identify whether important pages are receiving less structural emphasis than they should.

Example 1.

Use cars website illustrationUsed cars: the site grew, its structure didn’t

A used car dealer was ranking well on page one, then slowly started slipping. Nothing was broken. But the main Used Cars page, the reason the business exists, held under 4% of the site’s structural weight, less than its contact and utility pages.

Read the used cars case study

Example 2.

Pharmacy UK researchPharmacy UK: Why a Pharmacy Website Remained on Page 2 Despite a Strong Internal Link Network

This UK pharmacy website looked strong on paper. It had 374 indexable pages, more than 30,000 internal links and plenty of content. Yet for the keyword search term it cared about most, “Pharmacy UK”, sat on page 2 of Google. The problem wasn’t a lack of authority. The site treated almost every page as equally important.

Read the pharmacy case study

Example 3.

Holiday Travel researchHoliday travel: the most important page was the Privacy Policy

According to our internal link analysis, the Privacy Policy received greater structural prominence than the pages responsible for selling holidays.

Read the travel case study

What the analysis reveals

Three websites, one pattern. In each of these, the pages the business cared about most were the pages its own links treated as least important.

The purpose of a structural website review is to understand whether the relationships between pages are supporting the organisation’s search visibility objectives.

By examining internal linking, structural authority distribution and the probability of movement between pages, we can identify where a website’s architecture reinforces its priorities and where it may be working against them.

The findings provide a basis for informed decisions about the website’s structure, rather than relying on assumptions about individual pages.

See how the review works or view pricing.
See how the review works or see pricing.

Getting started

Align Your Architecture With Your Commercial Goals
If your search visibility has plateaued despite consistent content investment, the friction is rarely on the page—it is in the network topology beneath it. Send me your website address and a line or two about what’s bothering you. That’s plenty to begin with. Get in touch.

Want to dig deeper?

By: T.G. Barker | See how the strategic authority review works | Last reviewed: 12/10/2026.

Insights into Artificial Intelligence and Search

Stop Chasing GEO, AEO and the Next Three-Letter Acronym
Recently, terms such as Generative Engine Optimisation (GEO), Answer Engine Optimisation (AEO) and a growing collection of AI-focused optimisation strategies have become the latest talking points.
Why Anchor Text Matters for Website OwnersWhy Anchor Text Matters for Website Owners
Why You Still Need Anchor Text Even If Your Website Has a Main Menu. Many website owners reasonably assume that if their key pages are already linked in the main menu, there is no need to add additional links inside their content.
An infographic for tgbarker.co.uk titled "Why Your Website Navigation Cannot Scale." On the left, a vintage wooden machine represents a limited "Navigation Menu" overflowing with content. This overflow feeds into a large, glowing digital brain network on the right representing "Google’s Internal Model." Inside the network, individual pages act as nodes connected by flowing light paths of "Internal Links," converging into bright "Authority Hubs" and "Topic Hubs" that ultimately broadcast a signal labeled "Visibility Emerges." Two professionals stand at the bottom right observing the data visualization.Why Your Website Navigation Cannot Scale — And What Google Does Instead
How Google uses internal links, authority flow and structural relationships to determine which pages matter most.
Diagram illustrating AI crawlability: Open access allows AI crawlers to process pages and generate citations, while blocked access prevents answer engines from citing contentWhy Server-Side Analytics Is Essential for Identifying AI Crawlers
Search System Behaviour | how do they move through my website?
AI crawlability is the ability of AI crawlers and answer engines (GPTBot, ClaudeBot, PerplexityBot, Google-Extended and the rest) to find, access, understand and revisit your content.  The logic is brutally simple: if an answer engine can’t crawl your page, it can’t cite it. And if it can’t cite you, you don’t exist in AI search, no matter how strong your classic rankings are. Most analytics measure visitor activity. System Flow Analysis measures search system behaviour.
Google Analytics demographic dataGoogle analytics and server-side behavioural analysis
Monitoring a website: beyond Google Analytics. Traditional analytics can tell us where a request appears to come from. Server-level behavioural analysis can help tell us what actually made the request and what it was doing. That distinction is becoming increasingly important. Server-level behavioural analysis can help tell us what actually made the request and what it was doing.
Architectural blueprint showing a website structure foundation, illustrating how commercial hub pages, pillar content, and supporting blog posts connect to direct PageRank and authority flowYour Website Needs a Foundation
If you have a website, there is a good chance you have asked the same question as everyone else: How do I get my website onto Page One on Google? You wouldn’t normally start building a house by choosing the kitchen, painting the walls and buying the furniture, first  you need a building plan. A website is much the same. Before worrying about keywords, content, backlinks or individual page rankings, search systems need to understand the structure underneath it — how the pages connect, which pages are important, and how authority flows through the website which ends up explaining your system.