Check this out. It’s kind of interesting.
http://www.whitehouse.gov/robots.txt
http://www.whitehouse.gov/robots.txt
2 Answers
Hmm, lots of stuff they don’t want spidered.
Lookis like all of their Iraq stuff isn’t going to be spidered.
Please login or Register to submit your answer