Assume pages are HTML
Dan Sharp
Posted 7 May, 2024 by Dan Sharp in
Assume pages are HTML
Configuration > Spider > Advanced > Assume Pages are HTML
When enabled, any URL without a content-type will be assumed to be HTML and crawled.
Dan Sharp
Posted 7 May, 2024 by Dan Sharp in
Configuration > Spider > Advanced > Assume Pages are HTML
When enabled, any URL without a content-type will be assumed to be HTML and crawled.
Dan Sharp is founder & Director of Screaming Frog. He has developed search strategies for a variety of clients from international brands to small and medium-sized businesses and designed and managed the build of the innovative SEO Spider software.
For an in-depth proposal on our services, complete our contact form to request a proposal.
Contact usWe'll get back to you asap.
Looks like you're running...
Looks like you're running...
Unsure which download is right for you?
See our FAQLooks like you're running...
Using a different Operating System?
Looks like you're running...
Looks like you're running...
Unsure which download is right for you?
See our FAQLooks like you're running...
Using a different Operating System?
Fill out the form below to open a support ticket for the SEO Spider.
Alternatively email us at support@screamingfrog.co.uk
Fill out the form below to open a support ticket for the Log File Analyser.
Alternatively email us at lfasupport@screamingfrog.co.uk