On January 24th Andrew Timchenko from Semalt sent me a Private message on Facebook:
Dear Stephen
From now on your websites:
tty.org.uk
Canalplan.org.UK
Canalplan.EU
Canalplan.co.UK
Pubnight.org.uk
won’t be visited by our robots.
I would like to bring apology on the behalf of our company if our service caused you some troubles.
I’d told him that I wanted all subdomains on those domains removing from their systems and I was stupid enough to believe him although for a while their annoying bots stopped visiting.
But they came back – not as stupidly fast as before but doing exactly the same call to the home page, over and over again.
So if you’ve had promises from Semalt to take your domains out of their system.. double check and make sure that you’ve got a rule in your .htaccess rule to ban them