- This topic is empty.
-
Posts
-
if Google is indexing this subforum,it won’t be super secret….
we run a Dutch forum for casino webmasters
and have it forbidden in robots.txt for google e.o.wouldn’t this also be appropriate to have this subforum being blocked??
Arjun says that
Index New Posts in Search Engine
(Setting this to ‘No’ will prevent anyone from being able to search in this forum)is currently set to No.
So only logged in users can see it
He says that google will index it as a forum lurker, logged out.
Index New Posts in Search Engine
(Setting this to ‘No’ will prevent anyone from being able to search in this forum)This setting is for the intern forum search engine,
it has nothing to do with google or other SE`s.Normally private forums cannot be spidered if all is set correct.
To be double safe, you can disallow private.php in robots.txtok thanks!
If the forums only show for members who are invited then Google would never see the links to be able to index them (unless one of us links into a private discussion page). Just the same, using robots.txt wouldn’t hurt since it explicitly denies an SE spider from indexing the part of the website that is excluded. The smaller SE’s may not pay attention to robots.txt, but the big one’s definitely do.
