Thrilled to welcome @screamingfrog.co.uk as a Tech Partner of Athens SEO 2026. They believed in us from the start, and if you work in tech SEO, you already know how much that means. Huge thanks to the whole team!
🎟️ Half of the onsite tickets are gone. Livestream available.
athenseo.com/buy-tickets/
Hi Will, if you're using the near duplicate analysis, then you can refine the content area used for it. More here in our tutorial - www.screamingfrog.co.uk/seo-spider/t.... We strip out the nav, footer etc by default. But welcome to refine further!
Daniel is the imposter! Both Ben and Euan in your sceenshot are on the PPC team at SF as well 😂 The SF FPL league this year is a close one!
🌍 How to use embeddings to map hreflang tags at scale - A clever use of @screamingfrog.co.uk Open AI API integration to implement hreflang by @pelogia.bsky.social - Check it out: www.guspelogia.com/embeddings-h...
Just released a small update to 23.3 of the @screamingfrog.co.uk SEO Spider - www.screamingfrog.co.uk/blog/seo-spi.... Includes an update to issue 'HTML Document Over 2MB' with Google's update on file size limits, alongside small improvements and bug fixes.
Little tip - Under ‘Config > Spider > Limits’ you can limit the number of URLs crawled per subdomain. This little-known config can be useful when performing research, such as crawling a sample number of URLs per subdomain in list mode.
Little tip - If you’re using vector embeddings for redirect mapping, you can add a rule to define the URL patterns used for semantic similarity analysis via ‘Config > Content > Embeddings', such as from a staging to a live website. More here - www.screamingfrog.co.uk/seo-spider/t...
Little tip - If you don't want to keep crawls you can adjust the crawl retention settings via ‘File > Settings > Crawl Retention’ to auto delete after a period of time. You can also prevent projects and crawls from being cleaned up via right click 'Lock' in 'File > Crawls'.
😂 Can we stop the league now pls 🤝
I did see a request for a team Sephora calendar this year, which made me laugh (and spit my tea out when I looked at it!).
Hat on
Hey Adam! No, nothing changed there. It will be present in a 'Spider' mode export, but not in a 'list' mode export obviously (as we don't know the source - which pages link to the URLs you upload). Perhaps that's the confusion? Cheers
Just released a small update to 23.1 of the @screamingfrog.co.uk SEO Spider - www.screamingfrog.co.uk/blog/seo-spi.... Mostly small improvements, and bug fixes to the latest release.
Little tip - You can right click and 'Show Inlinks', 'Show Inlinks to Children', or perform the same for 'Outlinks' to see all inlink and outlink relationships in our site visualisations.
The @brightonseo.com Crawling Clinic October ’25 -
screamingfrog.co.uk/blog/brighto...
Come and chat about any crawling issues you're experiencing, or grab some new SF swag!
We've introduced crawl retention settings today (www.screamingfrog.co.uk/blog/seo-spi...), which might help with your previous request.
Just released @screamingfrog.co.uk SEO Spider v.23:
screamingfrog.co.uk/blog/seo-spi...
Includes -
💡Lighthouse & PSI Updated to Insight Audits
⚙️Crawl Retention Config
🧑🤝🧑Semantic Similarity Embedding Rules
📊Display All Links in Visualisations
🍇Links in Content Cluster Diagram
& more!
GreenSEO group photo
🌿 Less than a month to go until our next GreenSEO event!
Join us in Brighton on Thursday 22nd Oct for an evening of sessions on SEO and the environment.
🎟️ Grab your free ticket here: greenseo.org/brightonseo
Part of the @brightonseo.com Fringe. Sponsored by Climb Trees and @screamingfrog.co.uk.
Little tip - You can fetch API data without any crawling. Just go to 'Mode > APIs', select your APIs such as GA4, GSC, PSI or link metrics - and upload the list of URLs to pull data quickly.
My first public “vibe-coded” idea-to-product: storeratings.co
Building this was fun but definitely tested my patience. A combination of Vercel, GitHub, and Cursor, I got there in the end. I am not a developer or designer, go easy.
So long, and thanks for all the fishes, uhm, memories. I'll miss you, Mr Wiseguy. RIP @alanbleiweiss.bsky.social
Little tip - You can run prompts against specific segments. You can also segment against issues. So you can easily generate alt text only for images missing alt text for example.
Finally getting around to playing with @screamingfrog.co.uk's LLM API integration. My goodness, that's cool.
I need another month off football but here's the FPL link for the SEO league. @screamingfrog.co.uk Here you go!
Auto-join: fantasy.premierleague.com/leagues/auto...
code: 0xxnvz
Was just thinking the same 😂 Come round quick!! Will give it a share now ⚽👍
AI search is booming, but SEO is still not dead - searchengineland.com/ai-search-bo... from @lilyray.nyc
Little tip - You can customise the OpenAI endpoint to use LLMs that are compatible with the OpenAI API format. For example, this means you can use Grok or DeepSeek by updating the endpoint, and API key.
Currently you need to filter for the way around you wish to redirect and export. It 'can' find a closest neighbour on the same subdomain (rather than target) which might not be helpful - so will likely add a config at some stage to help with that (as it wasn't really purpose-built for this task!).
We made a decision not to offer that a long time ago I am afraid, after seeing many businesses like ours find out it's simply not sustainable.
