- This topic is empty.
Viewing 3 posts - 1 through 3 (of 3 total)
-
Posts
-
Check this out. It’s kind of interesting.
http://www.whitehouse.gov/robots.txtHmm, lots of stuff they don’t want spidered.
Lookis like all of their Iraq stuff isn’t going to be spidered.
Interesting indeed. But why would they want to put all that stuff up on the web in the first place if they don’t want people reading it?
Bart
Viewing 3 posts - 1 through 3 (of 3 total)