Cookie Consent by Free Privacy Policy Generator
AI & Agentic
  • November 21, 2025

Introducing the LLM IP verification tool and API

For around six months I have been tracking LLM bot behaviour and their user-agents across my own sites and across other projects. Patterns are changing...

Read More
Technical SEO
  • November 21, 2025

How a simple hosting migration improved crawl behaviour and site speed

Every so often, you make a change to your own site that reminds you how important the basics are. Recently, I moved my personal website...

Read More
Technical SEO
  • September 19, 2025

Do LLMs / AI Assistants respect the X-Robots-Tag?

I asked this recently on LinkedIn and got silence. So let’s dig into it properly here. The question is simple: do LLMs and AI assistants...

Read More
Technical SEO
  • September 17, 2025

How to fix Shopify crawl issues in Screaming Frog and Sitebulb using Web Bot Auth

If you’ve ever tried crawling a Shopify site at scale, you’ll know how quickly those dreaded 429 Too Many Requests errors can derail your audit....

Read More
Technical SEO
  • June 23, 2025

How I Integrated Google NLP with Screaming Frog Using a PHP Proxy

Google’s Natural Language API is seriously underrated in SEO. It gives you insight into how Google might interpret a piece of content beyond just keywords,...

Read More
SEO Guides
  • June 15, 2025

How to spot Technical SEO Problems yourself (before you call in a Consultant)

Technical SEO sounds complicated from the outside. And to be fair, sometimes it is. But you don’t need to be an expert to notice when...

Read More
Technical SEO
  • May 2, 2025

Exploring MCP Servers for Technical SEO Monitoring

I’ve been thinking about Model Context Protocol (MCP) and what it could mean for technical SEO monitoring and support. What is a MCP Server in...

Read More
Technical SEO
  • April 18, 2025

Edge SEO strategies from my BrightonSEO talk

At BrightonSEO this year, I shared a talk titled Unlocking SEO Wins Using Cloudflare Workers, no devs required. The session focused on how to use...

Read More
Technical SEO
  • April 6, 2025

What Is Crawl Budget and why should you care?

Crawl budget is the amount of attention search engines are willing to give your site. It’s a combination of how many pages they want to...

Read More
General
  • April 5, 2025

I’m speaking at BrightonSEO 2025

I’ve got some news I’ve been waiting years to share. This April, I’ll be speaking at BrightonSEO. It’s the world’s biggest SEO conference, and it’s...

Read More