[Haskell-cafe] haskell wiki indexing

Claus Reinke claus.reinke at talk21.com
Tue May 22 10:44:44 EDT 2007


> The wiki could be configured to use /haskellwiki/index.php?.. urls for 
> diffs (I believe this can be done by changing $wgScript). Then 
> robots.txt could be changed to
> > Disallow: /haskellwiki/index.php
> Which bans robots from everything except normal pages.

that sounds like the most promising approach to me (meta tags 
for history pages already have noindex,nofollow; so that didn't 
help, it seems? also, fewer robots look at meta tags than at
robots.txt).

claus


More information about the Haskell-Cafe mailing list