- This topic is empty.
-
Posts
-
My server emails me when a bot is trapped by ignoring robots.txt. The IP address of this one, 65.222.176.122, belongs to the company Cyveillance.com
Just their name is a little intimidating, but luckily my trap caught them early on and prevented them from accessing anything much. I emailed them to politely but firmly request that they cut the shit. I also gave them a link to robotstxt.org in case they needed information on how legitimate bots should function.
I did find an interesting web site though about someone else’s experiences with this company.
http
/cyveillance.linuxgod.net/He says the U.S. Government is one of their clients. So naturally, the “conspiracy theory” side of me says, hmm, maybe they’re trying to identify gambling portals now so that they can intimidate them into shutting down later (or sooner). I can’t verify anything the guy on this web site says, and he clearly has a chip on his shoulder, but I thought I’d share.
Anyone else get hit by this bot? The user agent, conspicuously enough, is:
Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+XP)
They try to make it look like they were just casually browsing (at 20 pages a second, lol), because your logs will show your home page or sitemap as the referring page.
EDIT: Found another good resource about Cyveillance: http
/www.wellsofjustice.com/cyveillance.htmI saw this bot on my site about 2 months ago, however it seemed it came when I put a link up to DMOZ. Some larger companies do use this to check for DUP content as I believe they did with mine.
Interesting, but my site isn’t listed in DMOZ (I submitted a couple months ago so it won’t even get looked at for several more months).
Wikipedia even has a page on cyveillance. The average webmaster’s opinion of them is not very good. http://en.wikipedia.org/wiki/Cyveillance
In any event, I’ve blocked all their IP address ranges that I could find.
SlotsJunkie wrote:In any event, I’ve blocked all their IP address ranges that I could find.
As did I, I don’t like snoopers!
occ wrote:As did I, I don’t like snoopers!
:bigsmile: Me either.Okay I’ll probably let it go after this [don’t hold me to that though], but here’s a wonderful article about Cyveillance and what they do.
http://www.gulker.com/stories/2003/05/06/whatToThinkAboutCyveillanc
