Limit max folder depth
si digital
Posted 27 November, 2015 by si digital in
Limit max folder depth
Configuration > Spider > Limits > Limit Max Folder Depth
Control the number of folders (or subdirectories) the SEO Spider will crawl.
The Spider classifies folders as part of the URL path after the domain that end in a trailing slash:
- https://www.screamingfrog.co.uk/ – folder depth 0
- https://www.screamingfrog.co.uk/seo-spider/ – folder depth 1
- https://www.screamingfrog.co.uk/seo-spider/#download – folder depth 1
- https://www.screamingfrog.co.uk/seo-spider/fake-page.html – folder depth 1
- https://www.screamingfrog.co.uk/seo-spider/user-guide/ – folder depth 2