[Haskell-cafe] haskell wiki indexing
Claus Reinke
claus.reinke at talk21.com
Tue May 22 10:44:44 EDT 2007
> The wiki could be configured to use /haskellwiki/index.php?.. urls for
> diffs (I believe this can be done by changing $wgScript). Then
> robots.txt could be changed to
> > Disallow: /haskellwiki/index.php
> Which bans robots from everything except normal pages.
that sounds like the most promising approach to me (meta tags
for history pages already have noindex,nofollow; so that didn't
help, it seems? also, fewer robots look at meta tags than at
robots.txt).
claus
More information about the Haskell-Cafe
mailing list