Crawl Retention

Dan Sharp

Posted 20 October, 2025 by in

Crawl Retention

File > Settings > Crawl Retention (Windows, Linux)
Screaming Frog SEO Spider > Settings > Crawl Retention (macOS)

Crawls are automatically saved and available to be opened or deleted via the ‘File > Crawls’ menu in default database storage mode.

However, users are able to automate deleting crawls after a period of time by adjusting the crawl retention settings. This is useful for anyone who doesn’t want to keep crawls, but does want to take advantage of the scale that database storage mode offers (over memory storage).

Crawl Retention settings

You can ‘Lock’ projects or specific crawls in the ‘File > Crawls’ menu from being deleted by crawl retention settings.

If you wish to lock a single crawl or all crawls in a project, just right click and select ‘Lock’.

Crawls Dialog

For project folders, this will lock all existing and future crawl files, including scheduled crawls, from being automatically deleted via the retention policy settings.


Dan Sharp is founder & Director of Screaming Frog. He has developed search strategies for a variety of clients from international brands to small and medium-sized businesses and designed and managed the build of the innovative SEO Spider software.

Comments are closed.

Back to top