Crawl outside of start folder
si digital
Posted 27 November, 2015 by si digital in
Crawl outside of start folder
Configuration > Spider > Crawl > Crawl Outside of Start Folder
By default the SEO Spider will only crawl the subfolder (or sub directory) you crawl from forwards. However, if you wish to start a crawl from a specific sub folder, but crawl the entire website, use this option.