Screaming Frog SEO Spider Tool

Download | User Guide | FAQ | Support | Terms | Purchase

The Screaming Frog SEO Spider is a small desktop program you can install locally on your PC, Mac or Linux machine which spiders websites’ links, images, CSS, script and apps from an SEO perspective. It fetches key onsite elements for SEO, presents them in tabs by type and allows you to filter for common SEO issues, or slice and dice the data how you see fit by exporting into Excel. You can view, analyse and filter the crawl data as it’s gathered and updated continuously in the program’s user interface.

The Screaming Frog SEO Spider allows you to quickly crawl, analyse and audit a site from an onsite SEO perspective. It’s particularly good for analysing medium to large sites, where manually checking every page would be extremely labour intensive (or impossible!) and where you can easily miss a redirect, meta refresh or duplicate page issue.

The SEO Spider allows you to export key onsite SEO elements (url, page title, meta description, headings etc) to Excel so it can easily be used as a base to make SEO recommendations from. Our video below provides a demonstration of what the SEO tool can do –

The SEO Spider Tool Crawls & Reports On The Following

A quick summary of some of the data collected in a crawl include –

The Screaming Frog SEO Spider is an SEO auditing tool, built by real SEOs with thousands of users worldwide.

Download Now – For Free!


Download Windows VersionDownload Mac Version
Download Mac VersionDownload Ubuntu Version

By downloading, installing and using the Screaming Frog SEO Spider, you agree to the terms and conditions.

Crawl Up To 500 URLs For Free

The standard ‘Lite’ version of the tool is completely free to download and use. However, this version is restricted to crawling a maximum of 500 URLs in a single crawl and it does not give you full access to the configuration, saving of crawls, the custom source search or extraction features and Google Analytics integration. You can crawl 500 URLs from the same website, or as many websites as you like as many times as you like though!

For just £99 per annum you can purchase an individual licence, which removes the 500 URL crawl limit, opens up the spider’s configuration options and custom source code search, extraction and Google Analytics integration features. Alternatively hit the ‘buy a licence’ button in the SEO Spider to buy a licence after downloading and trialling the software.

Please note, the SEO Spider cannot crawl an unlimited number of URLs with a licence, it is restricted by memory available and allocated.

FAQs & User Guide

As default the SEO Spider crawls sites like Googlebot (it obeys allow, disallow directives and wildcard support like Googlebot), but presents its own user-agent ‘Screaming Frog SEO Spider’, which it will obey specific directives for in robots.txt. If there are no directives, it will crawl your site like Googlebot. while still presenting its own UA.

For more guidance and tips on our to use the Screaming Frog SEO crawler –

Support & Feedback

If you have any problems or any feedback or feature requests for the SEO Spider, then please just contact us via our support. We have lots planned and currently in development!

Keep Updated

Keep updated with future releases of the SEO Spider tool by subscribing to the Screaming Frog Blog RSS or following us on Twitter @screamingfrog.

Download Now For Free

Download Windows VersionDownload Mac VersionDownload Mac VersionDownload Ubuntu Version

Why Purchase A Licence?

Buy a Screaming Frog SEO Spider Licence
  • The 500 URI crawl limit is removed
  • You can access ALL the configuration options
  • You can save & re-upload crawls
  • You can search for anything in the source code, & collect any data from the HTML of a URL using XPath, CSS Path or regex
  • You can connect to the Google Analytics API & pull in data directly during a crawl
  • You get support for any technical issues with the software

Contact Us

Screaming Frog Ltd
6 Greys Road,

Tel: +44 (0)1491 415070
Fax: +44 (0)1491 578134