Tutorials
For the SEO Spider
Getting Started Guide
Our beginners guide to getting started using the SEO Spider. Including initial set-up, crawling, and viewing reports and issues discovered.
How To Find Broken Links Using The SEO Spider
Learn how to crawl your website and find broken links (404 errors), view which pages link to them, the link text, and export in bulk.
Site Architecture & Crawl Visualisations Guide
Visualise site architecture and internal linking to help communicate ideas and reveal underlying patterns that are harder to uncover in data, and spreadsheets.
How To Compare Crawls
Compare crawls to see how data, issues and opportunities have changed over time to track progress and monitor site health.
How To Crawl JavaScript Websites
Render web pages using the integrated Chromium WRS to crawl dynamic, JavaScript rich websites and frameworks, such as Angular, React and Vue.js.
How To Crawl Large Websites
Crawl large websites by switching to database storage mode, increasing memory and by configuring the crawl to extract the data you need.
How To Crawl A Staging Website
Find out how to crawl a staging or development website, considering robots.txt, authentication, and the SEO Spider configuration.
How To Automate Crawl Reports In Looker Studio
Learn how to set-up fully automated Google Looker Studio crawl reports to monitor site health, detect issues, & track performance.
How To Audit Core Web Vitals
Analyse which pages pass or fail Google's Core Web Vitals assessment using field data from CrUX to improve page speed.
How to Run the Screaming Frog SEO Spider in the Cloud
Learn how to run the Screaming Frog SEO Spider in the cloud, using Google Compute Engine.
How To Check For Duplicate Content
Minimise duplicate content by identifying exact duplicate pages, and near-duplicate content where some text matches between pages on a website.
How to Crawl with ChatGPT
Open up a world of possibilities by communicating with OpenAI’s ChatGPT during a crawl.
How To Perform A Web Accessibility Audit
Learn how to run an automated accessibility audit of a site using the integrated AXE engine for automated accessibility validation.
Internal Linking Audit With the SEO Spider
An introduction to the various ways the SEO Spider can be used to improve internal linking.
How to Work in Teams Using the SEO Spider
Find out the best ways to work collaboratively when using the SEO Spider.
How To Test & Validate Structured Data
Audit and validate structured data against Schema.org specifications, and Google’s search feature requirements to enable special search result features.
How To Find Missing Image Alt Text & Attributes
Find pages that are missing image alt text and alt attributes, preview the images and bulk export the source pages and images to be corrected.
How To Use List Mode
Upload a list of URLs using 'list mode', and control what other elements are crawled, such as external links, or images for laser-focused crawling.
Web Scraping & Custom Extraction
Scrape any data from the HTML of a page using CSS Path, XPath and regex to enhance a crawl, such as author name, comments, shares or more.
Spell & Grammar Check Your Website
A guide on how to find spelling and grammar errors at scale across your website, ignoring words, customising the dictionary and the content checked.
