pointdexterish
Limp Gawd
- Joined
- Jul 27, 2003
- Messages
- 171
I've noticed that the [H] forums have been dutifully reindexed by Google since it has been resurrected.
Is this by design, or will there be a robots.txt added in to kill off the spiders eventually? One advantage of cutting out search engine spiders is that the traffic they generate by eating through every post/profile on the site does not end up on your bill. I am also curious to know because my forum handle (like many other's I assume) is tied in with other communication means (email, IM, ect..).
Thanks!
Is this by design, or will there be a robots.txt added in to kill off the spiders eventually? One advantage of cutting out search engine spiders is that the traffic they generate by eating through every post/profile on the site does not end up on your bill. I am also curious to know because my forum handle (like many other's I assume) is tied in with other communication means (email, IM, ect..).
Thanks!