Limit crawl total

si digital

Posted 27 November, 2015 by in

Limit crawl total

Configuration > Spider > Limits > Limit Crawl Total

The free version of the software has a 500 URL crawl limit. If you have a licensed version of the tool this will be replaced with 5 million URLs, but you can include any number here for greater control over the number of pages you wish to crawl.

Like us on Facebook Connect with us on LinkedIn Follow us on Twitter Subscribe to our channel us YouTube View our RSS feed

Join the mailing list for updates, tips & giveaways

How we use the data in this form

Get in touch

For an in-depth proposal on our services, complete our contact form to request a proposal.

Contact us

We'll get back to you asap.

Comments are closed.

Back to top