My May bill included charges for extra bandwidth, I suspect I am being hit with Search engine bots, as I do not have that much user traffic. Is there a way to turn on logging? Is there a way to see my traffic? I added two likely Search Engines, that are also hitting some of my other sites hosted on other servers.

Hi Rick,

Logging is on. You can see your logs at yoursite.com/config instead of yoursite.com/eve

Login and you'll see the icon for stats/logs on the top row, second from the right. That will give you webalizer or the raw logs if you want to parse them out.

You can then add a robots.txt file to the top level using the file manager to excluse any search engine pots you want to exclude.

Thanks David,

Just as you said, the logs are there and I am getting bombarded by the Twiceler and Majestic bots, I already added to my robots.txt, and it looks like Majestic stopped already, I'm going to give the twiceler another day or two then email Jim, his email address is at http://www.cuill.com/twiceler/robot.html
in case anyone else needs it.

This message has been edited. Last edited by: RickP23,

I've heard about twiceler from a few people lately. It's creating a whole lot of havoc for a search crawler that doesn't even have a website yet. It's not well behaved at all. I'd ban it outright, Rick. There is no reason to have these people running your bandwidth up while they are working out the kinks in their technology.