Tutorials
For the SEO Spider
Site Architecture & Crawl Visualisations Guide
Visualise site architecture and internal linking to help communicate ideas and reveal underlying patterns that are harder to uncover in data, and spreadsheets.
How To Crawl JavaScript Websites
Render web pages using the integrated Chromium WRS to crawl dynamic, JavaScript rich websites and frameworks, such as Angular, React and Vue.js.
How To Crawl A Staging Website
Find out how to crawl a staging or development website, considering robots.txt, authentication, and the SEO Spider configuration.
How To Automate Crawl Reports In Looker Studio
Learn how to set-up fully automated Google Looker Studio crawl reports to monitor site health, detect issues, & track performance.
How To Audit Core Web Vitals
Analyse which pages pass or fail Google's Core Web Vitals assessment using field data from CrUX to improve page speed.
How to Crawl with ChatGPT
Open up a world of possibilities by communicating with OpenAI’s ChatGPT during a crawl.
How To Perform A Web Accessibility Audit
Learn how to run an automated accessibility audit of a site using the integrated AXE engine for automated accessibility validation.
How To Test & Validate Structured Data
Audit and validate structured data against Schema.org specifications, and Google’s search feature requirements to enable special search result features.
How To Find Missing Image Alt Text & Attributes
Find pages that are missing image alt text and alt attributes, preview the images and bulk export the source pages and images to be corrected.
Web Scraping & Custom Extraction
Scrape any data from the HTML of a page using CSS Path, XPath and regex to enhance a crawl, such as author name, comments, shares or more.
How To Audit Redirects In A Site Migration Using The SEO Spider
Learn how to crawl a list of URLs, follow redirect chains, identify the final target & identify errors & non-indexable pages.
How To Audit Canonicals
A step-by-step tutorial on how to audit canonical link elements found in the HTML and HTTP Headers for common errors and issues.
How To Audit Mobile Usability
Mobile now accounts for over 60% of worldwide traffic, making mobile usability more important than ever for delivering an inclusive experience to all users
How To Audit & Validate Accelerated Mobile Pages (AMP)
This tutorial walks you through how to audit Accelerated Mobile Pages (AMP). The SEO Spider uses the official AMP validator to allow bulk URL validation.
How To Audit rel="next" and rel="prev" Pagination Attributes
While Google no longer use rel=”next” and rel=”prev” pagination attributes, Bing use them as a hint. Learn how to audit your pagination set-up.
How To Audit XML Sitemaps
XML Sitemaps should be up to date, error free, and include indexable, canonical URLs only. Learn how to audit them for common issues.
How To Bulk Check Redirects
Check redirects by crawling your site, or by uploading a list of URLs in bulk. Discover if they are 301s or 302s, loops and chains.
How To Find Orphan Pages
Connect to Google Analytics and Search Console, integrate XML Sitemaps and discover orphan pages, that are not linked to internally from the website.
Robots.txt Testing In The SEO Spider
View URLs blocked by robots.txt, the disallow lines & use the custom robots.txt to check & validate a site's robots.txt thoroughly, and at scale.
XML Sitemap Generator
Learn how to generate an XML Sitemap (and image sitemap), including the URLs, last modified, priority and change frequency you want.
