Monthly Archives: April 2014

Blocking Semalt Web Crawler

Blocking Semalt Web Crawler

The web crawler is useless. The services they claim to provide (if you pay) offer no better analysis on your website than the free ones you’re already using. Semalt also uses a persistent web crawler, which inflates your web statistics, ignores Robots.txt protocols, and even ignores their own Website […]

Posted in: Web Development


Tagged: , , , ,