Getting Started Guide

Our beginners guide to getting started using the SEO Spider. Including initial set-up, crawling, and viewing reports and issues discovered.

How To Find Broken Links Using The SEO Spider

Learn how to crawl your website and find broken links (404 errors), view which pages link to them, the link text, and export in bulk.

Site Architecture & Crawl Visualisations Guide

Visualise site architecture and internal linking to help communicate ideas and reveal underlying patterns that are harder to uncover in data, and spreadsheets.

How To Crawl JavaScript Websites

Render web pages using the integrated Chromium WRS to crawl dynamic, JavaScript rich websites and frameworks, such as Angular, React and Vue.js.

How To Audit Redirects In A Site Migration Using The SEO Spider

Learn how to crawl a list of URLs, follow redirect chains, identify the final target & identify errors & non-indexable pages.

How To Crawl Large Websites

Crawl large websites by switching to database storage mode, increasing memory and by configuring the crawl to extract the data you need.

How To Check For Duplicate Content

Minimise duplicate content by identifying exact duplicate pages, and near-duplicate content where some text matches between pages on a website.

How To Test & Validate Structured Data

Audit and validate structured data against Schema.org specifications, and Google’s search feature requirements to enable special search result features.

How To Find Missing Image Alt Text & Attributes

Find pages that are missing image alt text and alt attributes, preview the images and bulk export the source pages and images to be corrected.

How To Use List Mode

Upload a list of URLs using 'list mode', and control what other elements are crawled, such as external links, or images for laser-focused crawling.

Web Scraping & Custom Extraction

Scrape any data from the HTML of a page using CSS Path, XPath and regex to enhance a crawl, such as author name, comments, shares...

Spell & Grammar Check Your Website

A guide on how to find spelling and grammar errors at scale across your website, ignoring words, customising the dictionary and the content checked.

Back to top