Archive website

Dan Sharp

Posted 7 May, 2024 by Dan Sharp in

Archive website

Configuration > Spider > Rendering > JavaScript > Archive Website

When enabled, the SEO Spider will download and store all HTML and resources found during a crawl and save the files locally.

There are two options –

Hierarchical URL Archive – The website will be stored locally based upon the the directory file path of the website. These files are not compressed.
WARC – The Web ARChive standard format for archiving websites. The WARC file format can be viewed in many open source tools and is compressed.

The archived files can be viewed in C:\Users\Your Name\.ScreamingFrogSEOSpider\ProjectInstanceData\\results_\siteArchive folder and bulk exported via ‘Bulk Export > Web > Archived Website’.

You can view an archived page in the app by right clicking and choosing ‘Open Archived Page in Browser’ to view an offline version.

Dan Sharp

Dan Sharp is founder & Director of Screaming Frog. He has developed search strategies for a variety of clients from international brands to small and medium-sized businesses and designed and managed the build of the innovative SEO Spider software.