Tutorials
For the SEO Spider
How To Find Broken Links Using The SEO Spider
Learn how to crawl your website and find broken links (404 errors), view which pages link to them, the link text, and export in bulk.
Site Architecture & Crawl Visualisations Guide
Visualise site architecture and internal linking to help communicate ideas and reveal underlying patterns that are harder to uncover in data, and spreadsheets.
How To Crawl JavaScript Websites
Render web pages using the integrated Chromium WRS to crawl dynamic, JavaScript rich websites and frameworks, such as Angular, React and Vue.js.
How To Check For Duplicate Content
Minimise duplicate content by identifying exact duplicate pages, and near-duplicate content where some text matches between pages on a website.
How To Test & Validate Structured Data
Audit and validate structured data against Schema.org specifications, and Google’s search feature requirements to enable special search result features.
How To Find Missing Image Alt Text & Attributes
Find pages that are missing image alt text and alt attributes, preview the images and bulk export the source pages and images to be corrected.
How To Use List Mode
Upload a list of URLs using 'list mode', and control what other elements are crawled, such as external links, or images for laser-focused crawling.
Web Scraping & Custom Extraction
Scrape any data from the HTML of a page using CSS Path, XPath and regex to enhance a crawl, such as author name, comments, shares or more.