Tutorials
For the SEO Spider
Getting Started Guide
Our beginners guide to getting started using the SEO Spider. Including initial set-up, crawling, and viewing reports and issues discovered.
How To Find Broken Links Using The SEO Spider
Learn how to crawl your website and find broken links (404 errors), view which pages link to them, the link text, and export in bulk.
Site Architecture & Crawl Visualisations Guide
Visualise site architecture and internal linking to help communicate ideas and reveal underlying patterns that are harder to uncover in data, and spreadsheets.
How To Compare Crawls
Compare crawls to see how data, issues and opportunities have changed over time to track progress and monitor site health.
How To Crawl A Staging Website
Find out how to crawl a staging or development website, considering robots.txt, authentication, and the SEO Spider configuration.
How to Run the Screaming Frog SEO Spider in the Cloud
Learn how to run the Screaming Frog SEO Spider in the cloud, using Google Compute Engine.
How To Check For Duplicate Content
Minimise duplicate content by identifying exact duplicate pages, and near-duplicate content where some text matches between pages on a website.
How to Work in Teams Using the SEO Spider
Find out the best ways to work collaboratively when using the SEO Spider.
How To Find Missing Image Alt Text & Attributes
Find pages that are missing image alt text and alt attributes, preview the images and bulk export the source pages and images to be corrected.
How To Use List Mode
Upload a list of URLs using 'list mode', and control what other elements are crawled, such as external links, or images for laser-focused crawling.
Spell & Grammar Check Your Website
A guide on how to find spelling and grammar errors at scale across your website, ignoring words, customising the dictionary and the content checked.
How To Debug Missing Pages In A Crawl
Find out why pages might be missing in a crawl, and how to debug and analyse why they are not being crawled.
How To Audit Canonicals
A step-by-step tutorial on how to audit canonical link elements found in the HTML and HTTP Headers for common errors and issues.
How To Audit & Validate Accelerated Mobile Pages (AMP)
This tutorial walks you through how to audit Accelerated Mobile Pages (AMP). The SEO Spider uses the official AMP validator to allow bulk URL validation.
How To Audit Hreflang
Hreflang is a simple concept, but incredibly difficult to get right at scale, and often implemented incorrectly. Find out how to audit them!
How To Audit rel="next" and rel="prev" Pagination Attributes
While Google no longer use rel=”next” and rel=”prev” pagination attributes, Bing use them as a hint. Learn how to audit your pagination set-up.
How To Audit XML Sitemaps
XML Sitemaps should be up to date, error free, and include indexable, canonical URLs only. Learn how to audit them for common issues.
How To Bulk Check Redirects
Check redirects by crawling your site, or by uploading a list of URLs in bulk. Discover if they are 301s or 302s, loops and chains.
How To Find Orphan Pages
Connect to Google Analytics and Search Console, integrate XML Sitemaps and discover orphan pages, that are not linked to internally from the website.
HTTP Status Codes - Why Won't My Website Crawl?
If the SEO Spider only crawls one page, or not as expected, the 'Status' and 'Status Code' are the first things to check. Learn more in our guide.
XML Sitemap Generator
Learn how to generate an XML Sitemap (and image sitemap), including the URLs, last modified, priority and change frequency you want.
How To Find Broken Bookmarks
Find and fix broken bookmarks also referred to as ‘jump links’, ‘named anchors’, and ‘skip links'.
How To Test Readability
Learn about the Flesch reading-ease score and how to assess readability across a website at scale.
How To Audit PDFs
Crawl, parse and audit PDFs for common issues and use-cases, such as broken links, or document titles.
An SEOs Guide To Crawling HSTS
HSTS declares to a client that it should only be accessed via HTTPS & can show as a 307 redirect. Find out why & how to see the real status code.
Resolving Google Analytics / Google Search Console Connection Issues
If you've experienced a 'Failed to Connect To Google Analytics / Search Console' security message, this guide will help you debug and resolve the issue.
