Best practice with the TextUnited Website Crawler

In this article we are going to outline the best practice and limitations of the TextUnited Crawler


The size of your website matters...

Our crawler is meant specifically for small to medium websites, without 1000s of subpages. Although the crawler is powerful, scanning pages takes time and due to the complexity and security mechanism put in place by certain websites, may come up with an error. 

Contact us if you need help from us to run a specific test on your website. See that chat icon in the bottom right of your screen? Click there to get in touch with us quickly!