Tutorials

Getting Started Guide

Our beginners guide to getting started using the SEO Spider. Including initial set-up, crawling, and viewing reports and issues discovered.

How To Find Broken Links Using The SEO Spider

Learn how to crawl your website and find broken links (404 errors), view which pages link to them, the link text, and export in bulk.

Site Architecture & Crawl Visualisations Guide

Visualise site architecture and internal linking to help communicate ideas and reveal underlying patterns that are harder to uncover in data, and spreadsheets.

How To Compare Crawls

Compare crawls to see how data, issues and opportunities have changed over time to track progress and monitor site health.

How To Crawl JavaScript Websites

Render web pages using the integrated Chromium WRS to crawl dynamic, JavaScript rich websites and frameworks, such as Angular, React and Vue.js.

How To Crawl Large Websites

Crawl large websites by switching to database storage mode, increasing memory and by configuring the crawl to extract the data you need.

How To Crawl A Staging Website

Find out how to crawl a staging or development website, considering robots.txt, authentication, and the SEO Spider configuration.

How To Automate Crawl Reports In Looker Studio

Learn how to set-up fully automated Google Looker Studio crawl reports to monitor site health, detect issues, & track performance.

How To Audit Core Web Vitals

Analyse which pages pass or fail Google's Core Web Vitals assessment using field data from CrUX to improve page speed.

How to Run the Screaming Frog SEO Spider in the Cloud

Learn how to run the Screaming Frog SEO Spider in the cloud, using Google Compute Engine.

How To Check For Duplicate Content

Minimise duplicate content by identifying exact duplicate pages, and near-duplicate content where some text matches between pages on a website.

How to Work in Teams Using the SEO Spider

Find out the best ways to work collaboratively when using the SEO Spider.