Follow internal or external ‘nofollow’
si digital
Posted 27 November, 2015 by si digital in
Follow internal or external ‘nofollow’
Configuration > Spider > Crawl > Follow Internal/External “Nofollow”
By default the SEO Spider will not crawl internal or external links with the ‘nofollow’, ‘sponsored’ and ‘ugc’ attributes, or links from pages with the meta nofollow tag and nofollow in the X-Robots-Tag HTTP Header.
If you would like the SEO Spider to crawl these, simply enable this configuration option.