How Do Search Systems Decide Which Websites Matter?

Millions of pages on the web say much the same thing. So how do Search Systems like Google decide which ones matter? How do you differentiate yours above all others?

 

Diagram showing how search engines evaluate web pages through crawling, indexing, relevance and authority, and how internal website links influence search visibility.

Don’t Leave Your Website’s Success to Chance

You wouldn’t build a house without a foundation and a plan. A website is no different. The pages that matter most to the business shouldn’t be left for Google to discover by chance.

If you want to be found on the web, you need to improve your chances of being discovered. Every time someone searches for something, search systems must decide which websites and pages are most relevant to that search. Your website is competing with many others for that opportunity. Being found is therefore not guaranteed. It is a question of probability.

Your domain is a network of knowledge

A website is more than a collection of individual pages. It is a network of connected information in which the relationships between pages help search systems discover content, understand subjects and identify which pages may be important.

Graph theory provides a way to examine these relationships, while Markov chain models help us understand how movement and probability can be distributed across a website’s internal link structure.

By examining these relationships, we can identify whether the website’s structure supports its intended priorities or whether important pages are receiving less structural emphasis than they should.

1. Understanding Your Website’s Structure

Every internal link creates a relationship between pages. Together, these relationships form a network that can be measured and analysed. By mapping this network, we can identify which pages occupy central positions, how supporting content connects to important subjects and where structural weaknesses may exist. The objective is to understand how the website is organised, rather than simply examining individual pages in isolation.

2. Understanding How Authority Is Distributed

Not every page within a website receives the same structural emphasis. Using graph-based measurements and probability models, we can examine how internal linking distributes structural importance across the website. This helps identify whether the pages most important to the organisation are being reinforced by the surrounding structure, or whether that emphasis is being directed elsewhere.

3. Comparing Structure With Business Priorities

A website may contain excellent content yet fail to give its most important pages sufficient structural support. By comparing the measured network with the organisation’s objectives, we can identify where changes to internal relationships may improve the website’s foundation for search visibility. The outcome is a clearer understanding of the website’s structural strengths, limitations and opportunities for improvement.

Case Studies – three websites, one pattern

In each of these, the pages the business cared about most were the pages its own links treated as least important.

Used cars: the site grew, its structure didn’t

A used car dealer was ranking well on page one, then slowly started slipping. Nothing was broken. But the main Used Cars page, the reason the business exists, held under 4% of the site’s structural weight, less than its contact and utility pages.

Read the used cars case study

Pharmacy: 30,000 links pointing nowhere in particular

A UK pharmacy website had 374 pages and over 30,000 internal links. Yet it sat on page 2 for the search it wanted most. The problem wasn’t a lack of authority. The site treated almost every page as equally important.

Read the pharmacy case study

Holiday travel: the most important page was the Privacy Policy

According to our internal link analysis, the Privacy Policy received greater structural prominence than the pages responsible for selling holidays.

Read the travel case study

What the analysis reveals

The purpose of a structural website review is to understand whether the relationships between pages are supporting the organisation’s search visibility objectives.

By examining internal linking, structural authority distribution and the probability of movement between pages, we can identify where a website’s architecture reinforces its priorities and where it may be working against them.

The findings provide a basis for informed decisions about the website’s structure, rather than relying on assumptions about individual pages.

See how the review works or view pricing.
See how the review works or see pricing.

Getting started

Align Your Architecture With Your Commercial Goals
If your search visibility has plateaued despite consistent content investment, the friction is rarely on the page—it is in the network topology beneath it. Send me your website address and a line or two about what’s bothering you. That’s plenty to begin with. Get in touch.

.

Insights into Artificial Intelligence and Search

Stop Chasing GEO, AEO and the Next Three-Letter Acronym
Recently, terms such as Generative Engine Optimisation (GEO), Answer Engine Optimisation (AEO) and a growing collection of AI-focused optimisation strategies have become the latest talking points.
Why Anchor Text Matters for Website OwnersWhy Anchor Text Matters for Website Owners
Why You Still Need Anchor Text Even If Your Website Has a Main Menu. Many website owners reasonably assume that if their key pages are already linked in the main menu, there is no need to add additional links inside their content.
A technical SEO case study infographic titled 'Pharmacy UK: Markov Chain SEO Analysis'. The left side illustrates 'The Symmetry Problem' with a dense, chaotic web graph of 374 pages and over 30,000 links showing a flat stationary distribution of authority. The right side illustrates the 'Target State' with an optimized, clean hierarchical directed graph flowing from the Homepage down to commercial category hubs and thematic clusters, establishing clear authority signals for search systems.Pharmacy UK Case Study: Markov Chain SEO Analysis
Why a UK Pharmacy Website Remained on Page 2 Despite a Strong Internal Link Network. Target Search Phrase: Pharmacy UK Methodology: Directed Graph Analysis, Markov Chain Modelling and Structural Authority Review
Diagram illustrating AI crawlability: Open access allows AI crawlers to process pages and generate citations, while blocked access prevents answer engines from citing contentWhy Server-Side Analytics Is Essential for Identifying AI Crawlers
Search System Behaviour | how do they move through my website?
AI crawlability is the ability of AI crawlers and answer engines (GPTBot, ClaudeBot, PerplexityBot, Google-Extended and the rest) to find, access, understand and revisit your content.  The logic is brutally simple: if an answer engine can’t crawl your page, it can’t cite it. And if it can’t cite you, you don’t exist in AI search, no matter how strong your classic rankings are. Most analytics measure visitor activity. System Flow Analysis measures search system behaviour.
Google Analytics demographic dataGoogle analytics and server-side behavioural analysis
Monitoring a website: beyond Google Analytics. Traditional analytics can tell us where a request appears to come from. Server-level behavioural analysis can help tell us what actually made the request and what it was doing. That distinction is becoming increasingly important. Server-level behavioural analysis can help tell us what actually made the request and what it was doing.
Architectural blueprint showing a website structure foundation, illustrating how commercial hub pages, pillar content, and supporting blog posts connect to direct PageRank and authority flowYour Website Needs a Foundation
If you have a website, there is a good chance you have asked the same question as everyone else: How do I get my website onto Page One on Google? You wouldn’t normally start building a house by choosing the kitchen, painting the walls and buying the furniture, first  you need a building plan. A website is much the same. Before worrying about keywords, content, backlinks or individual page rankings, search systems need to understand the structure underneath it — how the pages connect, which pages are important, and how authority flows through the website which ends up explaining your system.