- October 5, 2025
Do LLMs / AI Assistants respect the X-Robots-Tag?
I asked this recently on LinkedIn and got silence. So let’s dig into it properly here. The question is simple: do LLMs and AI assistants...

I asked this recently on LinkedIn and got silence. So let’s dig into it properly here. The question is simple: do LLMs and AI assistants...
If you’ve ever tried crawling a Shopify site at scale, you’ll know how quickly those dreaded 429 Too Many Requests errors can derail your audit....
Google’s Natural Language API is seriously underrated in SEO. It gives you insight into how Google might interpret a piece of content beyond just keywords,...
Technical SEO sounds complicated from the outside. And to be fair, sometimes it is. But you don’t need to be an expert to notice when...
I’ve been thinking about Model Context Protocol (MCP) and what it could mean for technical SEO monitoring and support. What is a MCP Server in...
At BrightonSEO this year, I shared a talk titled Unlocking SEO Wins Using Cloudflare Workers, no devs required. The session focused on how to use...
Crawl budget is the amount of attention search engines are willing to give your site. It’s a combination of how many pages they want to...
I’ve got some news I’ve been waiting years to share. This April, I’ll be speaking at BrightonSEO. It’s the world’s biggest SEO conference, and it’s...
Nginx doesn’t get much airtime in SEO conversations, but when you understand how it works, it opens up a layer of control that most sites...
Sitemaps often get treated as an afterthought. One of those jobs that gets done at the start of a project, ticked off, and then ignored....