Screaming Blog

For a digital industry there’s much to be said for how much we all love an in-person lecture. Maybe it’s a collective longing for those rosy university days, or perhaps it’s just the buzz (and the beer) found at many of our favourite industry events. Seemingly though, if you want...

I'm delighted to announce the release of Screaming Frog SEO Spider 9.0, codenamed internally as '8-year Monkey'. Our team have been busy in development working on exciting new features. In our last update, we released a new user interface, in this release we have a new and extremely powerful hybrid...

Canonical URLs can be marked up as a link element within the head of a page, or by rel="canonical" HTTP headers to signal to search engines which page is the "preferred" URL to rank - usually in situations where content is duplicated or shared across many pages. The use of...

I wanted to put together this rapid-fire guide after a question on Twitter from Charlie Whitworth, asking if anyone knew of a way to get around country specific IP redirection, when attempting to perform a crawl using the Screaming Frog SEO Spider. Anyone know how to dodge an IP Redirect...

We've had a few customers notice that our robots.txt tester tool, in version 8.1 of the SEO Spider, gives different results than the robots.txt tester in Google Search Console . This variation in behaviour is around the handling of non-ASCII characters, as highlighted below. Giuseppe Pastore blogged about this issue...

I'm excited to announce the release of Screaming Frog SEO Spider 8.0, codenamed internally as 'All J's must go'. Our team have been busy in development working on some exciting new features, so let's get straight to it, and talk about what's new in version 8.0. 1) Updated User Interface...

It's time for another giveaway. This time, you can win some very cool Screaming Frog aluminium drinking bottles. You've probably been told you should drink more (water), so why not keep hydrated in SEOtyle? Sorry. The large capacity (770ml) and twist on lid make them perfect for water at your...

Log Files are an incredibly powerful, yet underutilised way to gain valuable insights about how each search engine crawls your site. They allow you to see exactly what the search engines have experienced, over a period of time. Logs remove the guesswork, and the data allows you to view exactly...

From time to time, we've struggled to get access to Google Search Console quickly from a client to perform a fetch and render. Or, we've just wanted to perform a fetch and render on a third party site that isn't verified to us, to understand how it renders, or test...

I am delighted to announce the release of the Screaming Frog Log File Analyser 2.0, codenamed 'Snoop'. Since launch last year, we've released eight smaller updates to the Log File Analyser, but this is a much larger and more significant update, with some very exciting new and unique features. Let's...