Tutorials
For the SEO Spider
How To Audit Redirects In A Site Migration Using The SEO Spider
Learn how to crawl a list of URLs, follow redirect chains, identify the final target & identify errors & non-indexable pages.
How To Debug Missing Pages In A Crawl
Find out why pages might be missing in a crawl, and how to debug and analyse why they are not being crawled.
How To Use N-Grams
Learn how to use N-grams in the SEO Spider for text analysis, on-page alignment and even finding internal linking opportunities at scale.
How To Audit Canonicals
A step-by-step tutorial on how to audit canonical link elements found in the HTML and HTTP Headers for common errors and issues.
How To Audit Mobile Usability
Mobile now accounts for over 60% of worldwide traffic, making mobile usability more important than ever for delivering an inclusive experience to all users
How To Audit & Validate Accelerated Mobile Pages (AMP)
This tutorial walks you through how to audit Accelerated Mobile Pages (AMP). The SEO Spider uses the official AMP validator to allow bulk URL validation.
How To Audit Hreflang
Hreflang is a simple concept, but incredibly difficult to get right at scale, and often implemented incorrectly. Find out how to audit them!
How To Audit rel="next" and rel="prev" Pagination Attributes
While Google no longer use rel=”next” and rel=”prev” pagination attributes, Bing use them as a hint. Learn how to audit your pagination set-up.
How To Audit XML Sitemaps
XML Sitemaps should be up to date, error free, and include indexable, canonical URLs only. Learn how to audit them for common issues.
How To Bulk Check Redirects
Check redirects by crawling your site, or by uploading a list of URLs in bulk. Discover if they are 301s or 302s, loops and chains.
How To Find Orphan Pages
Connect to Google Analytics and Search Console, integrate XML Sitemaps and discover orphan pages, that are not linked to internally from the website.
How To Use Custom Search
Find anything you want in the HTML or text of a website, such as old brand names, keywords for internal linking, or verifying tracking tags.
HTTP Status Codes - Why Won't My Website Crawl?
If the SEO Spider only crawls one page, or not as expected, the 'Status' and 'Status Code' are the first things to check. Learn more in our guide.
Robots.txt Testing In The SEO Spider
View URLs blocked by robots.txt, the disallow lines & use the custom robots.txt to check & validate a site's robots.txt thoroughly, and at scale.
What Is Link Score?
Find out more about our Link Score algorithm which calculates the relative importance of URLs based on the internal linking of a site.
XML Sitemap Generator
Learn how to generate an XML Sitemap (and image sitemap), including the URLs, last modified, priority and change frequency you want.
How To Use The SEO Spider In A Site Migration
Learn how to use the SEO Spider's crawling and features in a site migration to work more efficiently, and improve chances of success.
How To Bypass Geo IP Redirection In A Crawl
Learn how to set your preferred country using web form authentication to crawl a site when it uses automatic GEO IP redirection.
How To Perform A Cookie Audit
Perform a cookie audit for compliance to identify all cookies that are being automatically set without explicit user consent at scale.
How To Find Broken Bookmarks
Find and fix broken bookmarks also referred to as ‘jump links’, ‘named anchors’, and ‘skip links'.
