Screaming Frog SEO Spider Tool

Download | User Guide | FAQ | Support | Terms | Purchase

The Screaming Frog SEO Spider is a small desktop program you can install locally on your PC, Mac or Linux machine which spiders websites’ links, images, CSS, script and apps from an SEO perspective. It fetches key onsite elements for SEO, presents them in tabs by type and allows you to filter for common SEO issues, or slice and dice the data how you see fit by exporting into Excel. You can view, analyse and filter the crawl data as it’s gathered and updated continuously in the program’s user interface.

The Screaming Frog SEO Spider allows you to quickly crawl, analyse and audit a site from an onsite SEO perspective. It’s particulary good for analysing medium to large sites, where manually checking every page would be extremely labour intensive (or impossible!) and where you can easily miss a redirect, meta refresh or duplicate page issue.

The SEO Spider allows you to export key onsite SEO elements (url, page title, meta description, headings etc) to Excel so it can easily be used as a base to make SEO recommendations from. Our video below provides a demonstration of what the SEO tool can do -

The SEO Spider Tool Crawls & Reports On The Following

A quick summary of some of the data collected in a crawl include –

The Screaming Frog SEO Spider is an SEO auditing tool, built by real SEOs with thousands of users worldwide.

Download Now – For Free!


Download Windows VersionDownload Mac Version
Download Mac VersionDownload Ubuntu Version

By downloading, installing and using the Screaming Frog SEO Spider, you agree to the terms and conditions.

Crawl Up To 500 URLs For Free

The standard ‘Lite’ version of the tool is completely free to download and use. However, this version is restricted to crawling a maximum of 500 URLs in a single crawl and it does not give you full access to the configuration, saving of crawls or the custom source code feature. You can crawl 500 URLs from the same website, or as many websites as you like as many times as you like though!

For just £99 per annum you can purchase an individual licence, which removes the 500 URL crawl limit, opens up the spider’s configuration options and custom source code search feature. Alternatively hit the ‘buy a licence’ button in the SEO Spider to buy a licence after downloading and trialling the software.

FAQs & User Guide

As default the SEO Spider crawls sites like Googlebot (it obeys allow, disallow directives and wildcard support like Googlebot), but presents its own user-agent ‘Screaming Frog SEO Spider’, which it will obey specific directives for in robots.txt. If there are no directives, it will crawl your site like Googlebot. while still presenting its own UA.

For more guidance and tips on our to use the Screaming Frog SEO crawler –

Support & Feedback

If you have any problems or any feedback or feature requests for the SEO Spider, then please just contact us via our support. We have lots planned and currently in development!

Keep Updated

Keep updated with future releases of the SEO Spider tool by subscribing to the Screaming Frog Blog RSS or following us on Twitter @screamingfrog.

Download Now For Free

Download Windows VersionDownload Mac VersionDownload Mac VersionDownload Ubuntu Version

Why Purchase A Licence?

Buy a Screaming Frog SEO Spider Licence
  • The 500 URI crawl limit is removed
  • You can access ALL the configuration options
  • You can save and re-upload crawls
  • You can search for anything in the source code of a website with the custom source code search feature
  • You get support for any technical issues with the software

Contact Us

Screaming Frog Ltd
Market Chambers,
33 Market Place,

Tel: +44 (0)1491 415070
Fax: +44 (0)1491 415071

Latest From Twitter

  • @zarapalevani no probs at all :-)

    Retweet Reply Favorite
  • @zarapalevani take a closer look at the specific website/crawl :-)

    Retweet Reply Favorite

Looking For Something?