User Guide
For the SEO Spider
Configuration Options
Spider Crawl Tab
Check links outside of start folder
Follow internal or external ‘nofollow’
Spider Extraction Tab
Spider Limits Tab
Spider Rendering Tab
Spider Advanced Tab
Ignore non-indexable URLs for Issues
Ignore paginated URLs for duplicate filters
Respect self referencing meta refresh
Extract images from img srcset attribute
Spider Preferences Tab
Page title & meta description width
Other Configuration Options
Google Search Console integration
Tabs
Top Tabs
Lower Window Tabs
Right Side Window Tabs
Tutorials
How To Find Broken Links Using The SEO Spider
Site Architecture & Crawl Visualisations Guide
How To Crawl JavaScript Websites
How To Crawl A Staging Website
How To Automate Crawl Reports In Looker Studio
How to Run the Screaming Frog SEO Spider in the Cloud
How To Check For Duplicate Content
Internal Linking Audit With the SEO Spider
How to Work in Teams Using the SEO Spider
How To Test & Validate Structured Data
How To Find Missing Image Alt Text & Attributes
Web Scraping & Custom Extraction
Spell & Grammar Check Your Website
How To Audit Redirects In A Site Migration Using The SEO Spider
How To Debug Missing Pages In A Crawl
How To Audit & Validate Accelerated Mobile Pages (AMP)
How To Audit rel=”next” and rel=”prev” Pagination Attributes
HTTP Status Codes – Why Won’t My Website Crawl?
Robots.txt Testing In The SEO Spider
How To Use The SEO Spider In A Site Migration
How To Bypass Geo IP Redirection In A Crawl
How To Automate The URL Inspection API
How To Use The SEO Spider For Broken Link Building
How To Debug Invalid HTML Elements In The Head
An SEOs Guide To Crawling HSTS
Configure X Virtual Framebuffer
Resolving Google Analytics / Google Search Console Connection Issues
