WH robots.txt [bsa_pro_ad_space id=2] This topic is empty. Viewing 3 posts - 1 through 3 (of 3 total) Author Posts November 27, 2005 at 3:33 am #591288 AnonymousGuest Check this out. It’s kind of interesting. http://www.whitehouse.gov/robots.txt November 27, 2005 at 3:08 pm #677289 AnonymousInactive Hmm, lots of stuff they don’t want spidered. Lookis like all of their Iraq stuff isn’t going to be spidered. November 27, 2005 at 5:52 pm #677296 AnonymousInactive Interesting indeed. But why would they want to put all that stuff up on the web in the first place if they don’t want people reading it? Bart Author Posts Viewing 3 posts - 1 through 3 (of 3 total)