I'm writing an application that scrapes some data from some websites. I was using Network.Browser from <a href="http://haskell.org/http/">http://haskell.org/http/</a>. So far, so good. However, now I need to scrape some websites that use SSL.
Network.Browser doesn't seem to support this (although for some reason it does work on one of the sites so maybe I'm getting this wrong). Someone on #haskell pointed me at hsgnutls which is an wrapper for parts of GNU TLS. But I actually had more success writing a wrapper around wget. I know that darcs uses curl in a similar way for some stuff but it still feels like I'm doing the Wrong Thing. Does anyone know of a Haskell library that does support scraping SSL enabled web pages? Or would adding it to
Network.Browser be terribly difficult? Looking at GNU TLS it looks more complicated than I imagined.<br><br>Thanks in advance for your help,<br><br>Tom<br><br><br>