Max links per URL to crawl

Dan Sharp

Posted 3 February, 2026 by in

Max links per URL to crawl

Configuration > Spider > Limits > Max Links per URL to Crawl

Control the number of hyperlinks crawled on each page.

There’s a default is 10,000, which can be increased. If a page has a high number of links on a page, it can take a long time to process.

Dan Sharp is founder & Director of Screaming Frog. He has developed search strategies for a variety of clients from international brands to small and medium-sized businesses and designed and managed the build of the innovative SEO Spider software.

Like us on Facebook Connect with us on LinkedIn Follow us on X Subscribe to our channel us YouTube View our RSS feed

Join the mailing list for updates, tips & giveaways

How we use the data in this form

Get in touch

For an in-depth proposal on our services, complete our contact form to request a proposal.

Contact us

We'll get back to you asap.

Comments are closed.

Back to top